[2025-09-14T16:30:07.763413] [INFO ] [MAIN ] Using last completed trading day: 2025-09-12 [2025-09-14T16:30:07.763586] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-14T16:30:07.763714] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-14T16:30:07.763783] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-14T16:30:09.515710] [DEBUG] [SYMBOL ] Found 2422 valid NYSE symbols. [2025-09-14T16:30:09.515873] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-14T16:30:09.516078] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-14T16:30:09.516634] [INFO ] [LOCAL ] Symbols cache updated with 2370 symbols. [2025-09-14T16:30:09.516712] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-14T16:30:09.516754] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-14T16:30:09.516824] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-14T16:30:09.516948] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-14T16:30:09.517310] [DEBUG] [LOCAL ] Found 2370 symbols in cached list. [2025-09-14T16:30:09.517356] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-14T16:30:09.517514] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-14T16:30:09.517557] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2370 valid symbols. [2025-09-14T16:30:09.517597] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-14T16:30:09.517655] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-14T16:30:09.519993] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/JBK.csv (symbol JBK no longer active). [2025-09-14T16:30:09.520660] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/KTH.csv (symbol KTH no longer active). [2025-09-14T16:30:09.520940] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/KTN.csv (symbol KTN no longer active). [2025-09-14T16:30:09.521684] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/ECCF.csv (symbol ECCF no longer active). [2025-09-14T16:30:09.523048] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/MOGU.csv (symbol MOGU no longer active). [2025-09-14T16:30:09.524120] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/MFSM.csv (symbol MFSM no longer active). [2025-09-14T16:30:09.524976] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/GJH.csv (symbol GJH no longer active). [2025-09-14T16:30:09.526754] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/HTFB.csv (symbol HTFB no longer active). [2025-09-14T16:30:09.531391] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/JENA.csv (symbol JENA no longer active). [2025-09-14T16:30:09.532030] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/HG.csv (symbol HG no longer active). [2025-09-14T16:30:09.533150] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/GJR.csv (symbol GJR no longer active). [2025-09-14T16:30:09.533411] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/EIIA.csv (symbol EIIA no longer active). [2025-09-14T16:30:09.533870] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/WLYB.csv (symbol WLYB no longer active). [2025-09-14T16:30:09.534474] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/MHNC.csv (symbol MHNC no longer active). [2025-09-14T16:30:09.535723] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/SPMA.csv (symbol SPMA no longer active). [2025-09-14T16:30:09.536545] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/EVAC.csv (symbol EVAC no longer active). [2025-09-14T16:30:09.537343] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/NTZ.csv (symbol NTZ no longer active). [2025-09-14T16:30:09.537706] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/RAC.csv (symbol RAC no longer active). [2025-09-14T16:30:09.539380] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/IGCB.csv (symbol IGCB no longer active). [2025-09-14T16:30:09.540341] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/PDPA.csv (symbol PDPA no longer active). [2025-09-14T16:30:09.543143] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/PYT.csv (symbol PYT no longer active). [2025-09-14T16:30:09.544272] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/AOMN.csv (symbol AOMN no longer active). [2025-09-14T16:30:09.545814] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/RCC.csv (symbol RCC no longer active). [2025-09-14T16:30:09.547690] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/ECCV.csv (symbol ECCV no longer active). [2025-09-14T16:30:09.548686] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/STXI.csv (symbol STXI no longer active). [2025-09-14T16:30:09.550993] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-14T16:30:09.552209] [DEBUG] [LOCAL ] RCC: Removed from QA tracker. [2025-09-14T16:30:09.553386] [DEBUG] [LOCAL ] ECCV: Removed from QA tracker. [2025-09-14T16:30:09.554296] [DEBUG] [LOCAL ] IGCB: Removed from QA tracker. [2025-09-14T16:30:09.555361] [DEBUG] [LOCAL ] JBK: Removed from QA tracker. [2025-09-14T16:30:09.556214] [DEBUG] [LOCAL ] MFSM: Removed from QA tracker. [2025-09-14T16:30:09.557067] [DEBUG] [LOCAL ] STXI: Removed from QA tracker. [2025-09-14T16:30:09.557889] [DEBUG] [LOCAL ] GJR: Removed from QA tracker. [2025-09-14T16:30:09.558678] [DEBUG] [LOCAL ] GJH: Removed from QA tracker. [2025-09-14T16:30:09.559462] [DEBUG] [LOCAL ] KTN: Removed from QA tracker. [2025-09-14T16:30:09.560200] [DEBUG] [LOCAL ] KTH: Removed from QA tracker. [2025-09-14T16:30:09.560965] [DEBUG] [LOCAL ] EIIA: Removed from QA tracker. [2025-09-14T16:30:09.561764] [DEBUG] [LOCAL ] MOGU: Removed from QA tracker. [2025-09-14T16:30:09.562501] [DEBUG] [LOCAL ] WLYB: Removed from QA tracker. [2025-09-14T16:30:09.563195] [DEBUG] [LOCAL ] RAC: Removed from QA tracker. [2025-09-14T16:30:09.563919] [DEBUG] [LOCAL ] PYT: Removed from QA tracker. [2025-09-14T16:30:09.564565] [DEBUG] [LOCAL ] SPMA: Removed from QA tracker. [2025-09-14T16:30:09.565197] [DEBUG] [LOCAL ] JENA: Removed from QA tracker. [2025-09-14T16:30:09.565851] [DEBUG] [LOCAL ] NTZ: Removed from QA tracker. [2025-09-14T16:30:09.566459] [DEBUG] [LOCAL ] ECCF: Removed from QA tracker. [2025-09-14T16:30:09.567061] [DEBUG] [LOCAL ] MHNC: Removed from QA tracker. [2025-09-14T16:30:09.567632] [DEBUG] [LOCAL ] EVAC: Removed from QA tracker. [2025-09-14T16:30:09.568189] [DEBUG] [LOCAL ] HTFB: Removed from QA tracker. [2025-09-14T16:30:09.568740] [DEBUG] [LOCAL ] AOMN: Removed from QA tracker. [2025-09-14T16:30:09.569244] [DEBUG] [LOCAL ] PDPA: Removed from QA tracker. [2025-09-14T16:30:09.569304] [INFO ] [LOCAL ] Deleted 25 obsolete data files. [2025-09-14T16:30:09.569354] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-14T16:30:09.569426] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-14T16:30:09.569474] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-14T16:30:09.569689] [WARN ] [STATE ] State set to: RUNNING [2025-09-14T16:30:09.569811] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-14T16:30:09.570183] [DEBUG] [LOCAL ] Found 2370 symbols in cached list. [2025-09-14T16:30:09.570237] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-14T16:30:09.570291] [INFO ] [MAIN ] Starting incremental update for 2370 symbols. [2025-09-14T16:30:09.570326] [INFO ] [MAIN ] Running in parallel mode [2025-09-14T16:30:09.570515] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2370 symbols [2025-09-14T16:30:10.111589] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:10.231920] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:10.266867] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:10.330126] [INFO ] [MAIN ] AACT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:10.335315] [DEBUG] [LOCAL ] AAM: Loaded 324 existing records from primary storage. [2025-09-14T16:30:10.336403] [INFO ] [MAIN ] AAM: Loaded 324 existing records. [2025-09-14T16:30:10.461568] [DEBUG] [LOCAL ] AACT: Loaded 4723 existing records from primary storage. [2025-09-14T16:30:10.472211] [INFO ] [MAIN ] AACT: Loaded 4723 existing records. [2025-09-14T16:30:10.483743] [DEBUG] [LOCAL ] A: Loaded 22259 existing records from primary storage. [2025-09-14T16:30:10.546330] [INFO ] [MAIN ] A: Loaded 22259 existing records. [2025-09-14T16:30:10.640701] [DEBUG] [LOCAL ] AA: Loaded 23992 existing records from primary storage. [2025-09-14T16:30:10.695531] [INFO ] [MAIN ] AA: Loaded 23992 existing records. [2025-09-14T16:30:10.733674] [INFO ] [MAIN ] AAM: No missing trading days found. Data is up to date. [2025-09-14T16:30:10.781097] [INFO ] [MAIN ] Update Progress: 1/2370 symbols completed. AAM took 1.1s. Estimated remaining: 47m 48s. Rate: 49.6 symbols/min [2025-09-14T16:30:11.073057] [INFO ] [MAIN ] AACT: No missing trading days found. Data is up to date. [2025-09-14T16:30:11.160498] [INFO ] [MAIN ] A: No missing trading days found. Data is up to date. [2025-09-14T16:30:11.177039] [INFO ] [MAIN ] Update Progress: 2/2370 symbols completed. AACT took 1.6s. Estimated remaining: 31m 42s. Rate: 74.7 symbols/min [2025-09-14T16:30:11.179154] [INFO ] [MAIN ] Update Progress: 3/2370 symbols completed. A took 1.6s. Estimated remaining: 21m 9s. Rate: 111.9 symbols/min [2025-09-14T16:30:11.453442] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:11.415036] [INFO ] [MAIN ] AA: No missing trading days found. Data is up to date. [2025-09-14T16:30:11.513398] [INFO ] [MAIN ] Update Progress: 4/2370 symbols completed. AA took 1.9s. Estimated remaining: 19m 9s. Rate: 123.5 symbols/min [2025-09-14T16:30:11.819793] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:11.820788] [DEBUG] [LOCAL ] AAMI: Loaded 11127 existing records from primary storage. [2025-09-14T16:30:11.831674] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:11.847705] [INFO ] [MAIN ] AAMI: Loaded 11127 existing records. [2025-09-14T16:30:11.995667] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:12.077127] [DEBUG] [LOCAL ] AAP: Loaded 23111 existing records from primary storage. [2025-09-14T16:30:12.082899] [INFO ] [MAIN ] AAP: Loaded 23111 existing records. [2025-09-14T16:30:12.111216] [DEBUG] [LOCAL ] AAT: Loaded 13479 existing records from primary storage. [2025-09-14T16:30:12.144500] [INFO ] [MAIN ] AAT: Loaded 13479 existing records. [2025-09-14T16:30:12.213258] [INFO ] [MAIN ] AAMI: No missing trading days found. Data is up to date. [2025-09-14T16:30:12.180473] [DEBUG] [LOCAL ] AAUC: Loaded 5794 existing records from primary storage. [2025-09-14T16:30:12.267896] [INFO ] [MAIN ] AAUC: Loaded 5794 existing records. [2025-09-14T16:30:12.282282] [INFO ] [MAIN ] Update Progress: 5/2370 symbols completed. AAMI took 1.4s. Estimated remaining: 21m 23s. Rate: 110.6 symbols/min [2025-09-14T16:30:12.720802] [INFO ] [MAIN ] AAP: No missing trading days found. Data is up to date. [2025-09-14T16:30:12.774226] [INFO ] [MAIN ] Update Progress: 6/2370 symbols completed. AAP took 1.6s. Estimated remaining: 21m 2s. Rate: 112.4 symbols/min [2025-09-14T16:30:12.852285] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:12.906329] [INFO ] [MAIN ] AAUC: No missing trading days found. Data is up to date. [2025-09-14T16:30:12.866021] [INFO ] [MAIN ] AAT: No missing trading days found. Data is up to date. [2025-09-14T16:30:12.941724] [INFO ] [MAIN ] Update Progress: 7/2370 symbols completed. AAUC took 1.4s. Estimated remaining: 18m 58s. Rate: 124.6 symbols/min [2025-09-14T16:30:12.988123] [INFO ] [MAIN ] Update Progress: 8/2370 symbols completed. AAT took 1.7s. Estimated remaining: 16m 49s. Rate: 140.4 symbols/min [2025-09-14T16:30:13.125325] [DEBUG] [LOCAL ] AB: Loaded 10001 existing records from primary storage. [2025-09-14T16:30:13.262249] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:13.259754] [INFO ] [MAIN ] AB: Loaded 10001 existing records. [2025-09-14T16:30:13.400233] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:13.492231] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:13.657387] [DEBUG] [LOCAL ] ABBV: Loaded 24058 existing records from primary storage. [2025-09-14T16:30:13.664897] [INFO ] [MAIN ] ABBV: Loaded 24058 existing records. [2025-09-14T16:30:13.656214] [INFO ] [MAIN ] AB: No missing trading days found. Data is up to date. [2025-09-14T16:30:13.679195] [INFO ] [MAIN ] Update Progress: 9/2370 symbols completed. AB took 1.4s. Estimated remaining: 17m 58s. Rate: 131.4 symbols/min [2025-09-14T16:30:13.703524] [DEBUG] [LOCAL ] ABCB: Loaded 13335 existing records from primary storage. [2025-09-14T16:30:13.734607] [INFO ] [MAIN ] ABCB: Loaded 13335 existing records. [2025-09-14T16:30:13.734462] [DEBUG] [LOCAL ] ABEV: Loaded 23949 existing records from primary storage. [2025-09-14T16:30:13.805028] [INFO ] [MAIN ] ABEV: Loaded 23949 existing records. [2025-09-14T16:30:14.254232] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:14.351933] [INFO ] [MAIN ] ABBV: No missing trading days found. Data is up to date. [2025-09-14T16:30:14.449298] [INFO ] [MAIN ] ABCB: No missing trading days found. Data is up to date. [2025-09-14T16:30:14.476286] [INFO ] [MAIN ] ABEV: No missing trading days found. Data is up to date. [2025-09-14T16:30:14.478313] [INFO ] [MAIN ] Update Progress: 10/2370 symbols completed. ABBV took 1.6s. Estimated remaining: 19m 18s. Rate: 122.3 symbols/min [2025-09-14T16:30:14.484079] [INFO ] [MAIN ] Update Progress: 11/2370 symbols completed. ABCB took 1.5s. Estimated remaining: 17m 34s. Rate: 134.3 symbols/min [2025-09-14T16:30:14.537208] [DEBUG] [LOCAL ] ABG: Loaded 8212 existing records from primary storage. [2025-09-14T16:30:14.552623] [INFO ] [MAIN ] Update Progress: 12/2370 symbols completed. ABEV took 1.5s. Estimated remaining: 16m 19s. Rate: 144.5 symbols/min [2025-09-14T16:30:14.598576] [INFO ] [MAIN ] ABG: Loaded 8212 existing records. [2025-09-14T16:30:15.069440] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:15.148441] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:15.203921] [INFO ] [MAIN ] ABG: No missing trading days found. Data is up to date. [2025-09-14T16:30:15.266478] [INFO ] [MAIN ] Update Progress: 13/2370 symbols completed. ABG took 1.6s. Estimated remaining: 17m 13s. Rate: 136.9 symbols/min [2025-09-14T16:30:15.268700] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:15.394261] [DEBUG] [LOCAL ] ABM: Loaded 14683 existing records from primary storage. [2025-09-14T16:30:15.407634] [INFO ] [MAIN ] ABM: Loaded 14683 existing records. [2025-09-14T16:30:15.435613] [DEBUG] [LOCAL ] ABR: Loaded 23060 existing records from primary storage. [2025-09-14T16:30:15.519612] [INFO ] [MAIN ] ABR: Loaded 23060 existing records. [2025-09-14T16:30:15.582846] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:15.720784] [DEBUG] [LOCAL ] ABT: Loaded 24020 existing records from primary storage. [2025-09-14T16:30:15.794036] [INFO ] [MAIN ] ABT: Loaded 24020 existing records. [2025-09-14T16:30:15.827751] [INFO ] [MAIN ] ABM: No missing trading days found. Data is up to date. [2025-09-14T16:30:15.883663] [INFO ] [MAIN ] Update Progress: 14/2370 symbols completed. ABM took 1.4s. Estimated remaining: 17m 42s. Rate: 133.1 symbols/min [2025-09-14T16:30:15.900409] [DEBUG] [LOCAL ] ACA: Loaded 10019 existing records from primary storage. [2025-09-14T16:30:16.026728] [INFO ] [MAIN ] ACA: Loaded 10019 existing records. [2025-09-14T16:30:16.107314] [INFO ] [MAIN ] ABR: No missing trading days found. Data is up to date. [2025-09-14T16:30:16.143171] [INFO ] [MAIN ] Update Progress: 15/2370 symbols completed. ABR took 1.6s. Estimated remaining: 17m 12s. Rate: 136.9 symbols/min [2025-09-14T16:30:16.464325] [INFO ] [MAIN ] ABT: No missing trading days found. Data is up to date. [2025-09-14T16:30:16.604754] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:16.629812] [INFO ] [MAIN ] Update Progress: 16/2370 symbols completed. ABT took 2.0s. Estimated remaining: 17m 19s. Rate: 136.0 symbols/min [2025-09-14T16:30:16.662291] [INFO ] [MAIN ] ACA: No missing trading days found. Data is up to date. [2025-09-14T16:30:16.692390] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:16.704785] [INFO ] [MAIN ] Update Progress: 17/2370 symbols completed. ACA took 1.4s. Estimated remaining: 16m 27s. Rate: 143.0 symbols/min [2025-09-14T16:30:16.927725] [DEBUG] [LOCAL ] ACCO: Loaded 15942 existing records from primary storage. [2025-09-14T16:30:16.932111] [DEBUG] [LOCAL ] ACEL: Loaded 11135 existing records from primary storage. [2025-09-14T16:30:16.964018] [INFO ] [MAIN ] ACCO: Loaded 15942 existing records. [2025-09-14T16:30:16.948595] [INFO ] [MAIN ] ACEL: Loaded 11135 existing records. [2025-09-14T16:30:17.097134] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:17.176954] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:17.424701] [INFO ] [MAIN ] ACEL: No missing trading days found. Data is up to date. [2025-09-14T16:30:17.469230] [INFO ] [MAIN ] ACCO: No missing trading days found. Data is up to date. [2025-09-14T16:30:17.469513] [INFO ] [MAIN ] Update Progress: 18/2370 symbols completed. ACEL took 1.3s. Estimated remaining: 17m 12s. Rate: 136.7 symbols/min [2025-09-14T16:30:17.486722] [DEBUG] [LOCAL ] ACI: Loaded 23796 existing records from primary storage. [2025-09-14T16:30:17.485880] [INFO ] [MAIN ] Update Progress: 19/2370 symbols completed. ACCO took 1.5s. Estimated remaining: 16m 19s. Rate: 144.0 symbols/min [2025-09-14T16:30:17.545401] [DEBUG] [LOCAL ] ACHR: Loaded 24180 existing records from primary storage. [2025-09-14T16:30:17.576049] [INFO ] [MAIN ] ACI: Loaded 23796 existing records. [2025-09-14T16:30:17.576228] [INFO ] [MAIN ] ACHR: Loaded 24180 existing records. [2025-09-14T16:30:17.919725] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:18.147105] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:18.153718] [INFO ] [MAIN ] ACI: No missing trading days found. Data is up to date. [2025-09-14T16:30:18.175332] [INFO ] [MAIN ] Update Progress: 20/2370 symbols completed. ACI took 1.4s. Estimated remaining: 16m 51s. Rate: 139.5 symbols/min [2025-09-14T16:30:18.279012] [INFO ] [MAIN ] ACHR: No missing trading days found. Data is up to date. [2025-09-14T16:30:18.333178] [INFO ] [MAIN ] Update Progress: 21/2370 symbols completed. ACHR took 1.6s. Estimated remaining: 16m 20s. Rate: 143.8 symbols/min [2025-09-14T16:30:18.360855] [DEBUG] [LOCAL ] ACM: Loaded 18918 existing records from primary storage. [2025-09-14T16:30:18.412748] [INFO ] [MAIN ] ACM: Loaded 18918 existing records. [2025-09-14T16:30:18.548160] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:18.439737] [DEBUG] [LOCAL ] ACN: Loaded 23971 existing records from primary storage. [2025-09-14T16:30:18.584889] [INFO ] [MAIN ] ACN: Loaded 23971 existing records. [2025-09-14T16:30:18.862997] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:18.930588] [DEBUG] [LOCAL ] ACP: Loaded 13507 existing records from primary storage. [2025-09-14T16:30:19.020269] [INFO ] [MAIN ] ACP: Loaded 13507 existing records. [2025-09-14T16:30:19.065292] [DEBUG] [LOCAL ] ACR: Loaded 2258 existing records from primary storage. [2025-09-14T16:30:19.064767] [INFO ] [MAIN ] ACN: No missing trading days found. Data is up to date. [2025-09-14T16:30:19.116134] [INFO ] [MAIN ] ACM: No missing trading days found. Data is up to date. [2025-09-14T16:30:19.142208] [INFO ] [MAIN ] Update Progress: 22/2370 symbols completed. ACN took 1.6s. Estimated remaining: 17m 2s. Rate: 137.9 symbols/min [2025-09-14T16:30:19.132577] [INFO ] [MAIN ] ACR: Loaded 2258 existing records. [2025-09-14T16:30:19.158787] [INFO ] [MAIN ] Update Progress: 23/2370 symbols completed. ACM took 1.7s. Estimated remaining: 16m 18s. Rate: 143.9 symbols/min [2025-09-14T16:30:19.570405] [INFO ] [MAIN ] ACP: No missing trading days found. Data is up to date. [2025-09-14T16:30:19.622527] [INFO ] [MAIN ] Update Progress: 24/2370 symbols completed. ACP took 1.4s. Estimated remaining: 16m 23s. Rate: 143.3 symbols/min [2025-09-14T16:30:19.763900] [INFO ] [MAIN ] ACR: No missing trading days found. Data is up to date. [2025-09-14T16:30:19.775196] [INFO ] [MAIN ] Update Progress: 25/2370 symbols completed. ACR took 1.4s. Estimated remaining: 15m 57s. Rate: 147.0 symbols/min [2025-09-14T16:30:19.889218] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:20.013513] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:20.239537] [DEBUG] [LOCAL ] ACV: Loaded 2675 existing records from primary storage. [2025-09-14T16:30:20.246717] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:20.247387] [INFO ] [MAIN ] ACV: Loaded 2675 existing records. [2025-09-14T16:30:20.268032] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:20.350336] [DEBUG] [LOCAL ] ACRE: Loaded 14580 existing records from primary storage. [2025-09-14T16:30:20.374549] [DEBUG] [LOCAL ] AD: Loaded 4587 existing records from primary storage. [2025-09-14T16:30:20.379901] [INFO ] [MAIN ] ACRE: Loaded 14580 existing records. [2025-09-14T16:30:20.404760] [INFO ] [MAIN ] AD: Loaded 4587 existing records. [2025-09-14T16:30:20.715107] [INFO ] [MAIN ] ACV: No missing trading days found. Data is up to date. [2025-09-14T16:30:20.746459] [DEBUG] [LOCAL ] ACVA: Loaded 21723 existing records from primary storage. [2025-09-14T16:30:20.756608] [INFO ] [MAIN ] Update Progress: 26/2370 symbols completed. ACV took 1.5s. Estimated remaining: 16m 48s. Rate: 139.5 symbols/min [2025-09-14T16:30:20.763015] [INFO ] [MAIN ] ACVA: Loaded 21723 existing records. [2025-09-14T16:30:21.065173] [INFO ] [MAIN ] ACRE: No missing trading days found. Data is up to date. [2025-09-14T16:30:21.161580] [INFO ] [MAIN ] Update Progress: 27/2370 symbols completed. ACRE took 2.0s. Estimated remaining: 16m 46s. Rate: 139.8 symbols/min [2025-09-14T16:30:21.158410] [INFO ] [MAIN ] AD: No missing trading days found. Data is up to date. [2025-09-14T16:30:21.203311] [INFO ] [MAIN ] Update Progress: 28/2370 symbols completed. AD took 1.4s. Estimated remaining: 16m 13s. Rate: 144.4 symbols/min [2025-09-14T16:30:21.328884] [INFO ] [MAIN ] ACVA: No missing trading days found. Data is up to date. [2025-09-14T16:30:21.466189] [INFO ] [MAIN ] Update Progress: 29/2370 symbols completed. ACVA took 1.7s. Estimated remaining: 16m 0s. Rate: 146.3 symbols/min [2025-09-14T16:30:21.488797] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:21.838072] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:21.863632] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:21.875489] [DEBUG] [LOCAL ] ADC: Loaded 20466 existing records from primary storage. [2025-09-14T16:30:21.914025] [INFO ] [MAIN ] ADC: Loaded 20466 existing records. [2025-09-14T16:30:21.975407] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:22.153387] [INFO ] [MAIN ] ADC: No missing trading days found. Data is up to date. [2025-09-14T16:30:22.154997] [DEBUG] [LOCAL ] ADM: Loaded 23929 existing records from primary storage. [2025-09-14T16:30:22.154221] [INFO ] [MAIN ] Update Progress: 30/2370 symbols completed. ADC took 1.4s. Estimated remaining: 16m 22s. Rate: 143.0 symbols/min [2025-09-14T16:30:22.154459] [DEBUG] [LOCAL ] ADCT: Loaded 16452 existing records from primary storage. [2025-09-14T16:30:22.155470] [INFO ] [MAIN ] ADM: Loaded 23929 existing records. [2025-09-14T16:30:22.166414] [INFO ] [MAIN ] ADCT: Loaded 16452 existing records. [2025-09-14T16:30:22.437718] [DEBUG] [LOCAL ] ADNT: Loaded 20986 existing records from primary storage. [2025-09-14T16:30:22.438007] [INFO ] [MAIN ] ADNT: Loaded 20986 existing records. [2025-09-14T16:30:22.636876] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:22.686907] [INFO ] [MAIN ] ADCT: No missing trading days found. Data is up to date. [2025-09-14T16:30:22.768519] [INFO ] [MAIN ] Update Progress: 31/2370 symbols completed. ADCT took 1.6s. Estimated remaining: 16m 36s. Rate: 140.9 symbols/min [2025-09-14T16:30:22.780315] [INFO ] [MAIN ] ADM: No missing trading days found. Data is up to date. [2025-09-14T16:30:22.810353] [INFO ] [MAIN ] Update Progress: 32/2370 symbols completed. ADM took 1.6s. Estimated remaining: 16m 7s. Rate: 145.0 symbols/min [2025-09-14T16:30:23.033343] [INFO ] [MAIN ] ADNT: No missing trading days found. Data is up to date. [2025-09-14T16:30:23.065941] [INFO ] [MAIN ] Update Progress: 33/2370 symbols completed. ADNT took 1.6s. Estimated remaining: 15m 56s. Rate: 146.7 symbols/min [2025-09-14T16:30:23.180711] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:23.189233] [DEBUG] [LOCAL ] ADT: Loaded 23933 existing records from primary storage. [2025-09-14T16:30:23.208631] [INFO ] [MAIN ] ADT: Loaded 23933 existing records. [2025-09-14T16:30:23.371803] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:23.513828] [DEBUG] [LOCAL ] ADX: Loaded 12600 existing records from primary storage. [2025-09-14T16:30:23.569960] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:23.575826] [INFO ] [MAIN ] ADX: Loaded 12600 existing records. [2025-09-14T16:30:23.611061] [INFO ] [MAIN ] ADT: No missing trading days found. Data is up to date. [2025-09-14T16:30:23.618291] [INFO ] [MAIN ] Update Progress: 34/2370 symbols completed. ADT took 1.5s. Estimated remaining: 16m 5s. Rate: 145.2 symbols/min [2025-09-14T16:30:23.680978] [DEBUG] [LOCAL ] AEFC: Loaded 3302 existing records from primary storage. [2025-09-14T16:30:23.764967] [INFO ] [MAIN ] AEFC: Loaded 3302 existing records. [2025-09-14T16:30:23.784543] [DEBUG] [LOCAL ] AEE: Loaded 22433 existing records from primary storage. [2025-09-14T16:30:23.800929] [INFO ] [MAIN ] AEE: Loaded 22433 existing records. [2025-09-14T16:30:24.163244] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:24.206129] [INFO ] [MAIN ] ADX: No missing trading days found. Data is up to date. [2025-09-14T16:30:24.252208] [INFO ] [MAIN ] Update Progress: 35/2370 symbols completed. ADX took 1.5s. Estimated remaining: 16m 19s. Rate: 143.0 symbols/min [2025-09-14T16:30:24.371095] [INFO ] [MAIN ] AEE: No missing trading days found. Data is up to date. [2025-09-14T16:30:24.373517] [INFO ] [MAIN ] AEFC: No missing trading days found. Data is up to date. [2025-09-14T16:30:24.399711] [INFO ] [MAIN ] Update Progress: 36/2370 symbols completed. AEE took 1.6s. Estimated remaining: 16m 1s. Rate: 145.7 symbols/min [2025-09-14T16:30:24.459497] [INFO ] [MAIN ] Update Progress: 37/2370 symbols completed. AEFC took 1.3s. Estimated remaining: 15m 39s. Rate: 149.1 symbols/min [2025-09-14T16:30:24.563956] [DEBUG] [LOCAL ] AEG: Loaded 21976 existing records from primary storage. [2025-09-14T16:30:24.597093] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:24.619327] [INFO ] [MAIN ] AEG: Loaded 21976 existing records. [2025-09-14T16:30:24.834206] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:24.927917] [INFO ] [MAIN ] AEG: No missing trading days found. Data is up to date. [2025-09-14T16:30:24.930388] [INFO ] [MAIN ] Update Progress: 38/2370 symbols completed. AEG took 1.3s. Estimated remaining: 15m 43s. Rate: 148.4 symbols/min [2025-09-14T16:30:24.931935] [DEBUG] [LOCAL ] AEM: Loaded 23918 existing records from primary storage. [2025-09-14T16:30:24.932036] [INFO ] [MAIN ] AEM: Loaded 23918 existing records. [2025-09-14T16:30:25.111960] [DEBUG] [LOCAL ] AEO: Loaded 24035 existing records from primary storage. [2025-09-14T16:30:25.120086] [INFO ] [MAIN ] AEO: Loaded 24035 existing records. [2025-09-14T16:30:25.120031] [INFO ] [MAIN ] AEM: No missing trading days found. Data is up to date. [2025-09-14T16:30:25.182880] [INFO ] [MAIN ] Update Progress: 39/2370 symbols completed. AEM took 0.9s. Estimated remaining: 15m 33s. Rate: 149.9 symbols/min [2025-09-14T16:30:25.304136] [INFO ] [MAIN ] AEO: No missing trading days found. Data is up to date. [2025-09-14T16:30:25.305014] [INFO ] [MAIN ] Update Progress: 40/2370 symbols completed. AEO took 0.8s. Estimated remaining: 15m 17s. Rate: 152.5 symbols/min [2025-09-14T16:30:26.214492] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:26.264966] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:26.339467] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:26.396393] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:26.424845] [DEBUG] [LOCAL ] AFB: Loaded 4658 existing records from primary storage. [2025-09-14T16:30:26.425447] [INFO ] [MAIN ] AFB: Loaded 4658 existing records. [2025-09-14T16:30:26.560311] [DEBUG] [LOCAL ] AES: Loaded 24036 existing records from primary storage. [2025-09-14T16:30:26.590474] [INFO ] [MAIN ] AES: Loaded 24036 existing records. [2025-09-14T16:30:26.590845] [DEBUG] [LOCAL ] AER: Loaded 21504 existing records from primary storage. [2025-09-14T16:30:26.591422] [DEBUG] [LOCAL ] AESI: Loaded 21926 existing records from primary storage. [2025-09-14T16:30:26.648924] [INFO ] [MAIN ] AER: Loaded 21504 existing records. [2025-09-14T16:30:26.724838] [INFO ] [MAIN ] AESI: Loaded 21926 existing records. [2025-09-14T16:30:26.835785] [INFO ] [MAIN ] AFB: No missing trading days found. Data is up to date. [2025-09-14T16:30:26.877106] [INFO ] [MAIN ] Update Progress: 41/2370 symbols completed. AFB took 1.6s. Estimated remaining: 16m 23s. Rate: 142.1 symbols/min [2025-09-14T16:30:27.122357] [INFO ] [MAIN ] AES: No missing trading days found. Data is up to date. [2025-09-14T16:30:27.261017] [INFO ] [MAIN ] AER: No missing trading days found. Data is up to date. [2025-09-14T16:30:27.259946] [INFO ] [MAIN ] Update Progress: 42/2370 symbols completed. AES took 2.0s. Estimated remaining: 16m 21s. Rate: 142.5 symbols/min [2025-09-14T16:30:27.318507] [INFO ] [MAIN ] AESI: No missing trading days found. Data is up to date. [2025-09-14T16:30:27.324358] [INFO ] [MAIN ] Update Progress: 43/2370 symbols completed. AER took 2.0s. Estimated remaining: 16m 1s. Rate: 145.3 symbols/min [2025-09-14T16:30:27.398255] [INFO ] [MAIN ] Update Progress: 44/2370 symbols completed. AESI took 2.0s. Estimated remaining: 15m 42s. Rate: 148.1 symbols/min [2025-09-14T16:30:27.678529] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:27.914092] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:27.946670] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:27.980134] [DEBUG] [LOCAL ] AFG: Loaded 14359 existing records from primary storage. [2025-09-14T16:30:28.007091] [INFO ] [MAIN ] AFG: Loaded 14359 existing records. [2025-09-14T16:30:28.075921] [DEBUG] [LOCAL ] AFGC: Loaded 1425 existing records from primary storage. [2025-09-14T16:30:28.070546] [DEBUG] [LOCAL ] AFGB: Loaded 928 existing records from primary storage. [2025-09-14T16:30:28.091721] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:28.091837] [INFO ] [MAIN ] AFGC: Loaded 1425 existing records. [2025-09-14T16:30:28.112777] [INFO ] [MAIN ] AFGB: Loaded 928 existing records. [2025-09-14T16:30:28.161573] [DEBUG] [LOCAL ] AFGD: Loaded 700 existing records from primary storage. [2025-09-14T16:30:28.240876] [INFO ] [MAIN ] AFGD: Loaded 700 existing records. [2025-09-14T16:30:28.407339] [INFO ] [MAIN ] AFG: No missing trading days found. Data is up to date. [2025-09-14T16:30:28.476947] [INFO ] [MAIN ] Update Progress: 45/2370 symbols completed. AFG took 1.5s. Estimated remaining: 16m 17s. Rate: 142.8 symbols/min [2025-09-14T16:30:28.840169] [INFO ] [MAIN ] AFGB: No missing trading days found. Data is up to date. [2025-09-14T16:30:28.780908] [INFO ] [MAIN ] AFGC: No missing trading days found. Data is up to date. [2025-09-14T16:30:28.893638] [INFO ] [MAIN ] AFGD: No missing trading days found. Data is up to date. [2025-09-14T16:30:28.899377] [INFO ] [MAIN ] Update Progress: 46/2370 symbols completed. AFGB took 1.6s. Estimated remaining: 16m 17s. Rate: 142.8 symbols/min [2025-09-14T16:30:28.934603] [INFO ] [MAIN ] Update Progress: 47/2370 symbols completed. AFGC took 1.5s. Estimated remaining: 15m 57s. Rate: 145.6 symbols/min [2025-09-14T16:30:28.984522] [INFO ] [MAIN ] Update Progress: 48/2370 symbols completed. AFGD took 1.5s. Estimated remaining: 15m 39s. Rate: 148.3 symbols/min [2025-09-14T16:30:29.440439] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:29.404081] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:29.547398] [DEBUG] [LOCAL ] AFGE: Loaded 1199 existing records from primary storage. [2025-09-14T16:30:29.585135] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:29.595750] [INFO ] [MAIN ] AFGE: Loaded 1199 existing records. [2025-09-14T16:30:29.657468] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:29.779204] [DEBUG] [LOCAL ] AG: Loaded 6234 existing records from primary storage. [2025-09-14T16:30:29.786829] [DEBUG] [LOCAL ] AFL: Loaded 23755 existing records from primary storage. [2025-09-14T16:30:29.805936] [INFO ] [MAIN ] AG: Loaded 6234 existing records. [2025-09-14T16:30:29.806323] [DEBUG] [LOCAL ] AGCO: Loaded 4654 existing records from primary storage. [2025-09-14T16:30:29.834075] [INFO ] [MAIN ] AFL: Loaded 23755 existing records. [2025-09-14T16:30:29.881190] [INFO ] [MAIN ] AFGE: No missing trading days found. Data is up to date. [2025-09-14T16:30:29.873709] [INFO ] [MAIN ] AGCO: Loaded 4654 existing records. [2025-09-14T16:30:29.928062] [INFO ] [MAIN ] Update Progress: 49/2370 symbols completed. AFGE took 1.4s. Estimated remaining: 16m 4s. Rate: 144.4 symbols/min [2025-09-14T16:30:30.406855] [INFO ] [MAIN ] AG: No missing trading days found. Data is up to date. [2025-09-14T16:30:30.449063] [INFO ] [MAIN ] Update Progress: 50/2370 symbols completed. AG took 1.5s. Estimated remaining: 16m 9s. Rate: 143.7 symbols/min [2025-09-14T16:30:30.577743] [INFO ] [MAIN ] AGCO: No missing trading days found. Data is up to date. [2025-09-14T16:30:30.642785] [INFO ] [MAIN ] Update Progress: 51/2370 symbols completed. AGCO took 1.5s. Estimated remaining: 15m 58s. Rate: 145.2 symbols/min [2025-09-14T16:30:30.683089] [INFO ] [MAIN ] AFL: No missing trading days found. Data is up to date. [2025-09-14T16:30:30.721266] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:30.737141] [INFO ] [MAIN ] Update Progress: 52/2370 symbols completed. AFL took 1.8s. Estimated remaining: 15m 44s. Rate: 147.4 symbols/min [2025-09-14T16:30:30.911106] [DEBUG] [LOCAL ] AGD: Loaded 2313 existing records from primary storage. [2025-09-14T16:30:30.990012] [INFO ] [MAIN ] AGD: Loaded 2313 existing records. [2025-09-14T16:30:31.316526] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:31.278237] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:31.375737] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:31.471943] [INFO ] [MAIN ] AGD: No missing trading days found. Data is up to date. [2025-09-14T16:30:31.472345] [DEBUG] [LOCAL ] AGM: Loaded 4970 existing records from primary storage. [2025-09-14T16:30:31.474970] [INFO ] [MAIN ] Update Progress: 53/2370 symbols completed. AGD took 1.4s. Estimated remaining: 15m 58s. Rate: 145.2 symbols/min [2025-09-14T16:30:31.476175] [INFO ] [MAIN ] AGM: Loaded 4970 existing records. [2025-09-14T16:30:31.572366] [DEBUG] [LOCAL ] AGI: Loaded 23883 existing records from primary storage. [2025-09-14T16:30:31.589270] [DEBUG] [LOCAL ] AGL: Loaded 23346 existing records from primary storage. [2025-09-14T16:30:31.618786] [INFO ] [MAIN ] AGL: Loaded 23346 existing records. [2025-09-14T16:30:31.609617] [INFO ] [MAIN ] AGI: Loaded 23883 existing records. [2025-09-14T16:30:32.099188] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:32.070857] [INFO ] [MAIN ] AGM: No missing trading days found. Data is up to date. [2025-09-14T16:30:32.140469] [INFO ] [MAIN ] Update Progress: 54/2370 symbols completed. AGM took 1.3s. Estimated remaining: 16m 8s. Rate: 143.6 symbols/min [2025-09-14T16:30:32.210938] [INFO ] [MAIN ] AGI: No missing trading days found. Data is up to date. [2025-09-14T16:30:32.249659] [INFO ] [MAIN ] AGL: No missing trading days found. Data is up to date. [2025-09-14T16:30:32.269630] [INFO ] [MAIN ] Update Progress: 55/2370 symbols completed. AGI took 1.7s. Estimated remaining: 15m 55s. Rate: 145.4 symbols/min [2025-09-14T16:30:32.299688] [INFO ] [MAIN ] Update Progress: 56/2370 symbols completed. AGL took 1.6s. Estimated remaining: 15m 39s. Rate: 147.8 symbols/min [2025-09-14T16:30:32.404373] [DEBUG] [LOCAL ] AGO: Loaded 12293 existing records from primary storage. [2025-09-14T16:30:32.538695] [INFO ] [MAIN ] AGO: Loaded 12293 existing records. [2025-09-14T16:30:32.710213] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:32.847732] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:32.950542] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:33.017659] [INFO ] [MAIN ] AGO: No missing trading days found. Data is up to date. [2025-09-14T16:30:33.019032] [INFO ] [MAIN ] Update Progress: 57/2370 symbols completed. AGO took 1.5s. Estimated remaining: 15m 52s. Rate: 145.9 symbols/min [2025-09-14T16:30:33.020136] [DEBUG] [LOCAL ] AGX: Loaded 14694 existing records from primary storage. [2025-09-14T16:30:33.032302] [INFO ] [MAIN ] AGX: Loaded 14694 existing records. [2025-09-14T16:30:33.048872] [WARN ] [STATE ] Received SIGINT signal. Initiating graceful shutdown... [2025-09-14T16:30:33.083334] [DEBUG] [LOCAL ] AGRO: Loaded 13326 existing records from primary storage. [2025-09-14T16:30:33.140243] [WARN ] [STATE ] Operation was interrupted, setting state to COMPLETED_ERROR [2025-09-14T16:30:33.257670] [WARN ] [STATE ] State set to: COMPLETED_ERROR [2025-09-14T16:30:33.313507] [DEBUG] [LOCAL ] AHH: Loaded 17265 existing records from primary storage. [2025-09-14T16:30:33.333221] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:30:33.354676] [INFO ] [STATE ] Last completion updated: 2025-09-14T16:30:33.310668 [2025-09-14T16:30:33.376153] [WARN ] [MAIN ] Main thread: Shutdown detected, cancelling 2 pending tasks [2025-09-14T16:30:33.405033] [WARN ] [MAIN ] Shutting down thread pool executor... [2025-09-14T16:30:33.423785] [DEBUG] [LOCAL ] AHL: Loaded 10934 existing records from primary storage. [2025-09-14T16:30:33.424073] [WARN ] [MAIN ] Update INTERRUPTED after 23.9s. Processed 61/2370 symbols before shutdown. [2025-09-14T16:30:33.871610] [WARN ] [STATE ] Already shutting down, please wait... [2025-09-14T16:30:33.918481] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_ERROR: TDM All Symbols Update Failed' [2025-09-14T16:30:33.919312] [WARN ] [STATE ] State set to: RUNNING [2025-09-14T16:30:33.919391] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-09-14T16:30:33.919540] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-09-14T16:30:33.919624] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-09-14T16:30:33.919809] [INFO ] [LOCAL ] Deleted 0 derivative data files. [2025-09-14T16:30:33.919866] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-09-14T16:30:33.922315] [INFO ] [LOCAL ] Found 2360 symbols with primary data. [2025-09-14T16:30:33.922565] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2360 symbols [2025-09-14T16:30:33.922680] [WARN ] [MAIN ] Main thread: Shutdown detected, stopping task submission [2025-09-14T16:30:33.922734] [WARN ] [MAIN ] Shutting down thread pool executor... [2025-09-14T16:30:33.922797] [WARN ] [MAIN ] Derivative generation INTERRUPTED after 0.0s. Processed 0/2360 symbols before shutdown. [2025-09-14T16:30:34.419198] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_ERROR: TDM All Symbols Derivative Generation Failed' [2025-09-14T16:30:34.419730] [WARN ] [STATE ] State set to: COMPLETED_ERROR [2025-09-14T16:30:34.419881] [INFO ] [STATE ] Last completion updated: 2025-09-14T16:30:34.419798 [2025-09-14T16:30:34.420213] [INFO ] [STATE ] TDM shutdown complete. [2025-09-14T16:37:10.662735] [INFO ] [MAIN ] Using last completed trading day: 2025-09-12 [2025-09-14T16:37:10.662905] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-14T16:37:10.663012] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-14T16:37:10.663075] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-14T16:37:11.657847] [DEBUG] [SYMBOL ] Found 2422 valid NYSE symbols. [2025-09-14T16:37:11.658019] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-14T16:37:11.658227] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-14T16:37:11.658746] [INFO ] [LOCAL ] Symbols cache updated with 2370 symbols. [2025-09-14T16:37:11.658805] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-14T16:37:11.658838] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-14T16:37:11.658902] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-14T16:37:11.659009] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-14T16:37:11.659385] [DEBUG] [LOCAL ] Found 2370 symbols in cached list. [2025-09-14T16:37:11.659434] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-14T16:37:11.659602] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-14T16:37:11.659667] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2370 valid symbols. [2025-09-14T16:37:11.659711] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-14T16:37:11.659754] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-14T16:37:11.688396] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-14T16:37:11.688550] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-14T16:37:11.688626] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-14T16:37:11.688696] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-14T16:37:11.688735] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-14T16:37:11.688913] [WARN ] [STATE ] State set to: RUNNING [2025-09-14T16:37:11.689004] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-14T16:37:11.689374] [DEBUG] [LOCAL ] Found 2370 symbols in cached list. [2025-09-14T16:37:11.689423] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-14T16:37:11.689468] [INFO ] [MAIN ] Starting incremental update for 2370 symbols. [2025-09-14T16:37:11.689506] [INFO ] [MAIN ] Running in parallel mode [2025-09-14T16:37:11.689613] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2370 symbols [2025-09-14T16:37:12.293274] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:12.426685] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:12.423865] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:12.428224] [INFO ] [MAIN ] AACT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:12.437108] [DEBUG] [LOCAL ] AAM: Loaded 324 existing records from primary storage. [2025-09-14T16:37:12.437519] [INFO ] [MAIN ] AAM: Loaded 324 existing records. [2025-09-14T16:37:12.563232] [DEBUG] [LOCAL ] AACT: Loaded 4723 existing records from primary storage. [2025-09-14T16:37:12.590225] [INFO ] [MAIN ] AACT: Loaded 4723 existing records. [2025-09-14T16:37:12.686085] [WARN ] [MAIN ] AAM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:12.771188] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-14T16:37:12.752813] [DEBUG] [LOCAL ] AA: Loaded 23992 existing records from primary storage. [2025-09-14T16:37:12.774663] [INFO ] [MAIN ] AA: Loaded 23992 existing records. [2025-09-14T16:37:12.753445] [DEBUG] [LOCAL ] A: Loaded 22259 existing records from primary storage. [2025-09-14T16:37:12.774749] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-14T16:37:12.800797] [INFO ] [MAIN ] A: Loaded 22259 existing records. [2025-09-14T16:37:12.840765] [DEBUG] [LOCAL ] AAM: Deleted primary data file. [2025-09-14T16:37:13.026448] [WARN ] [MAIN ] AACT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:13.042675] [DEBUG] [LOCAL ] AAM: Removed from QA tracker. [2025-09-14T16:37:13.080351] [INFO ] [MAIN ] AACT: Wiping existing primary data before full refresh. [2025-09-14T16:37:13.068674] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-14T16:37:13.129571] [INFO ] [LOCAL ] AACT: Starting deletion of primary data. [2025-09-14T16:37:13.283844] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:13.302412] [DEBUG] [LOCAL ] AACT: Deleted primary data file. [2025-09-14T16:37:13.302803] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-09-14T16:37:13.358508] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-14T16:37:13.358419] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:13.391769] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-09-14T16:37:13.386336] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-09-14T16:37:13.397075] [DEBUG] [LOCAL ] AACT: Removed from QA tracker. [2025-09-14T16:37:13.416829] [INFO ] [MAIN ] AACT: Starting full primary refresh. [2025-09-14T16:37:13.416540] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-14T16:37:13.439284] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-09-14T16:37:13.490319] [DEBUG] [LOCAL ] AA: Removed from QA tracker. [2025-09-14T16:37:13.563413] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-09-14T16:37:13.594748] [DEBUG] [LOCAL ] A: Removed from QA tracker. [2025-09-14T16:37:13.653690] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-09-14T16:37:14.734905] [INFO ] [REMOTE ] AAM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:14.958697] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-14T16:37:15.063125] [INFO ] [REMOTE ] AA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:15.126231] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-09-14T16:37:15.161447] [INFO ] [REMOTE ] AACT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:15.198514] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-02. [2025-09-14T16:37:15.230163] [INFO ] [REMOTE ] A: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:15.230923] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-09-14T16:37:15.592626] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-14T16:37:15.595543] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-14T16:37:15.595657] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-14T16:37:15.597425] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-03. [2025-09-14T16:37:16.148404] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-14T16:37:16.149498] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-14T16:37:16.183048] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-14T16:37:16.184766] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-04. [2025-09-14T16:37:16.562725] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-14T16:37:16.563810] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-14T16:37:16.859104] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T16:37:16.888186] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-14T16:37:16.900033] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-14T16:37:16.888959] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-09-14T16:37:16.903539] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T16:37:16.914039] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-09-14T16:37:17.101910] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-14T16:37:17.104553] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-05. [2025-09-14T16:37:17.189525] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-14T16:37:17.190473] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-14T16:37:17.473407] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-14T16:37:17.474366] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-14T16:37:17.806570] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-14T16:37:17.807703] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-14T16:37:17.930250] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T16:37:17.932864] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-06. [2025-09-14T16:37:18.110938] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-14T16:37:18.111669] [INFO ] [REMOTE ] AAM: Full fetch complete (708 records). [2025-09-14T16:37:18.111766] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-14T16:37:18.293450] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 139 unique days, need 150 days [2025-09-14T16:37:18.293676] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:37:18.293730] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:37:18.293789] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-14T16:37:18.293865] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-14T16:37:18.293916] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-14T16:37:18.293962] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-14T16:37:18.294062] [INFO ] [MAIN ] Update Progress: 1/2370 symbols completed. AAM took 6.6s. Estimated remaining: 4h 20m 46s. Rate: 9.1 symbols/min [2025-09-14T16:37:18.464874] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:18.480282] [DEBUG] [LOCAL ] AAMI: Loaded 11127 existing records from primary storage. [2025-09-14T16:37:18.480427] [INFO ] [MAIN ] AAMI: Loaded 11127 existing records. [2025-09-14T16:37:18.659185] [WARN ] [MAIN ] AAMI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:18.659572] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-14T16:37:18.659659] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-14T16:37:18.660296] [DEBUG] [LOCAL ] AAMI: Deleted primary data file. [2025-09-14T16:37:18.660895] [DEBUG] [LOCAL ] AAMI: Removed from QA tracker. [2025-09-14T16:37:18.660963] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-14T16:37:18.793745] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T16:37:18.952415] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-09-14T16:37:18.995816] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-14T16:37:19.078873] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:19.079200] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-07. [2025-09-14T16:37:19.079748] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-09-14T16:37:19.159227] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-14T16:37:19.170619] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-09-14T16:37:19.942218] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-14T16:37:19.945300] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-08. [2025-09-14T16:37:20.049736] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-14T16:37:20.053561] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-09-14T16:37:20.517604] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-14T16:37:20.520544] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-09. [2025-09-14T16:37:20.894729] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T16:37:20.906385] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-09-14T16:37:21.173798] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T16:37:21.178906] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-09-14T16:37:21.236153] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T16:37:21.238257] [INFO ] [REMOTE ] AACT: Full fetch complete (9334 records). [2025-09-14T16:37:21.238358] [DEBUG] [VALIDATOR ] AACT: Validating primary data. [2025-09-14T16:37:21.636535] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-14T16:37:21.669392] [DEBUG] [VALIDATOR ] AACT: All expected trading days are present. [2025-09-14T16:37:21.669793] [DEBUG] [VALIDATOR ] AACT: Primary data validation passed. [2025-09-14T16:37:21.670006] [INFO ] [MAIN ] AACT: Fetched primary data is valid. [2025-09-14T16:37:21.670289] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-09-14T16:37:21.670420] [DEBUG] [LOCAL ] AACT: Saving primary data. [2025-09-14T16:37:21.671997] [DEBUG] [LOCAL ] AACT: Trimmed 9334 records to 8258 (keeping 150 days of data) [2025-09-14T16:37:21.724419] [DEBUG] [LOCAL ] AACT: Primary data saved (8258 records). [2025-09-14T16:37:21.724576] [INFO ] [MAIN ] AACT: Full history saved. [2025-09-14T16:37:21.724716] [INFO ] [MAIN ] Update Progress: 2/2370 symbols completed. AACT took 10.0s. Estimated remaining: 3h 18m 2s. Rate: 12.0 symbols/min [2025-09-14T16:37:21.897259] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:21.920466] [DEBUG] [LOCAL ] AAP: Loaded 23111 existing records from primary storage. [2025-09-14T16:37:21.920634] [INFO ] [MAIN ] AAP: Loaded 23111 existing records. [2025-09-14T16:37:22.101722] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:22.102003] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-09-14T16:37:22.102068] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-14T16:37:22.102730] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-09-14T16:37:22.103297] [DEBUG] [LOCAL ] AAP: Removed from QA tracker. [2025-09-14T16:37:22.103364] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-09-14T16:37:22.511866] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-14T16:37:22.517249] [INFO ] [REMOTE ] AAP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:22.523571] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-09-14T16:37:22.524385] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-09-14T16:37:22.606605] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T16:37:22.618301] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-09-14T16:37:23.495802] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-14T16:37:23.501431] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-09-14T16:37:23.734044] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-14T16:37:23.745635] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-09-14T16:37:23.992514] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-14T16:37:24.002567] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-09-14T16:37:24.030765] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T16:37:24.041736] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-09-14T16:37:24.684474] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-14T16:37:24.689757] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-09-14T16:37:25.693110] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-14T16:37:25.704284] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-09-14T16:37:25.842623] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-14T16:37:25.854165] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-09-14T16:37:25.889797] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T16:37:25.896344] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-09-14T16:37:26.016551] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-14T16:37:26.027962] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-09-14T16:37:27.079495] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T16:37:27.085311] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-09-14T16:37:27.350475] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-14T16:37:27.356523] [INFO ] [REMOTE ] AAMI: Full fetch complete (26022 records). [2025-09-14T16:37:27.356725] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-09-14T16:37:27.778458] [DEBUG] [VALIDATOR ] AAMI: All expected trading days are present. [2025-09-14T16:37:27.780375] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-14T16:37:27.780441] [DEBUG] [VALIDATOR ] AAMI: Primary data validation passed. [2025-09-14T16:37:27.791950] [INFO ] [MAIN ] AAMI: Fetched primary data is valid. [2025-09-14T16:37:27.792278] [DEBUG] [LOCAL ] AAMI: Saving primary data. [2025-09-14T16:37:27.794092] [DEBUG] [LOCAL ] AAMI: Trimmed 26022 records to 18336 (keeping 150 days of data) [2025-09-14T16:37:27.793965] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-09-14T16:37:27.936449] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-14T16:37:27.977444] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-09-14T16:37:27.983090] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-14T16:37:27.997619] [DEBUG] [LOCAL ] AAMI: Primary data saved (18336 records). [2025-09-14T16:37:27.998395] [INFO ] [MAIN ] AAMI: Full history saved. [2025-09-14T16:37:27.998676] [INFO ] [MAIN ] Update Progress: 3/2370 symbols completed. AAMI took 9.7s. Estimated remaining: 3h 34m 28s. Rate: 11.0 symbols/min [2025-09-14T16:37:28.004838] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-09-14T16:37:28.174284] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:28.190460] [DEBUG] [LOCAL ] AAT: Loaded 13479 existing records from primary storage. [2025-09-14T16:37:28.190636] [INFO ] [MAIN ] AAT: Loaded 13479 existing records. [2025-09-14T16:37:28.368917] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:28.369164] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-09-14T16:37:28.369225] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-14T16:37:28.369728] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-09-14T16:37:28.370333] [DEBUG] [LOCAL ] AAT: Removed from QA tracker. [2025-09-14T16:37:28.370393] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-09-14T16:37:28.733133] [INFO ] [REMOTE ] AAT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:28.733540] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-09-14T16:37:28.747596] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T16:37:28.753289] [INFO ] [REMOTE ] A: Full fetch complete (55286 records). [2025-09-14T16:37:28.753415] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-09-14T16:37:29.138906] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-09-14T16:37:29.139018] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-09-14T16:37:29.139619] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-09-14T16:37:29.139710] [DEBUG] [LOCAL ] A: Saving primary data. [2025-09-14T16:37:29.141114] [DEBUG] [LOCAL ] A: Trimmed 55286 records to 38079 (keeping 150 days of data) [2025-09-14T16:37:29.397225] [DEBUG] [LOCAL ] A: Primary data saved (38079 records). [2025-09-14T16:37:29.397394] [INFO ] [MAIN ] A: Full history saved. [2025-09-14T16:37:29.397508] [INFO ] [MAIN ] Update Progress: 4/2370 symbols completed. A took 17.7s. Estimated remaining: 2h 54m 34s. Rate: 13.6 symbols/min [2025-09-14T16:37:29.566845] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:29.574757] [DEBUG] [LOCAL ] AAUC: Loaded 5794 existing records from primary storage. [2025-09-14T16:37:29.574900] [INFO ] [MAIN ] AAUC: Loaded 5794 existing records. [2025-09-14T16:37:29.755706] [WARN ] [MAIN ] AAUC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:29.756232] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-14T16:37:29.756340] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-14T16:37:29.756907] [DEBUG] [LOCAL ] AAUC: Deleted primary data file. [2025-09-14T16:37:29.757685] [DEBUG] [LOCAL ] AAUC: Removed from QA tracker. [2025-09-14T16:37:29.757755] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-14T16:37:30.095705] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-14T16:37:30.199949] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:30.179312] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-09-14T16:37:30.200517] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-02. [2025-09-14T16:37:30.217939] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-14T16:37:30.224112] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-09-14T16:37:30.264346] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-14T16:37:30.277700] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-09-14T16:37:30.497101] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:37:30.497507] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-02 [2025-09-14T16:37:30.498011] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-03. [2025-09-14T16:37:30.741700] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:37:30.742085] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-03 [2025-09-14T16:37:30.742582] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-04. [2025-09-14T16:37:30.811197] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T16:37:30.817145] [INFO ] [REMOTE ] AA: Full fetch complete (58254 records). [2025-09-14T16:37:30.817309] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-09-14T16:37:31.009490] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:37:31.071211] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-04 [2025-09-14T16:37:31.094950] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-05. [2025-09-14T16:37:31.241484] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-09-14T16:37:31.241844] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-09-14T16:37:31.242459] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-09-14T16:37:31.242681] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-09-14T16:37:31.244593] [DEBUG] [LOCAL ] AA: Trimmed 58254 records to 40362 (keeping 150 days of data) [2025-09-14T16:37:31.373706] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-14T16:37:31.384434] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-09-14T16:37:31.473966] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:37:31.508709] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-05 [2025-09-14T16:37:31.510167] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-06. [2025-09-14T16:37:31.548509] [DEBUG] [LOCAL ] AA: Primary data saved (40362 records). [2025-09-14T16:37:31.548709] [INFO ] [MAIN ] AA: Full history saved. [2025-09-14T16:37:31.548821] [INFO ] [MAIN ] Update Progress: 5/2370 symbols completed. AA took 19.9s. Estimated remaining: 2h 36m 33s. Rate: 15.1 symbols/min [2025-09-14T16:37:31.732787] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:31.745824] [DEBUG] [LOCAL ] AB: Loaded 10001 existing records from primary storage. [2025-09-14T16:37:31.746035] [INFO ] [MAIN ] AB: Loaded 10001 existing records. [2025-09-14T16:37:31.924895] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:31.925216] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-09-14T16:37:31.925301] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-09-14T16:37:31.925762] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-09-14T16:37:31.926450] [DEBUG] [LOCAL ] AB: Removed from QA tracker. [2025-09-14T16:37:31.926514] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-09-14T16:37:32.289603] [INFO ] [REMOTE ] AB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:32.290313] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-09-14T16:37:32.298412] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-14T16:37:32.301403] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-07. [2025-09-14T16:37:32.332499] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-14T16:37:32.345503] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-09-14T16:37:32.789959] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-14T16:37:32.797822] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-09-14T16:37:32.832522] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-14T16:37:32.835265] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-08. [2025-09-14T16:37:33.835044] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-14T16:37:33.856624] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-14T16:37:33.856030] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-09-14T16:37:33.862387] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-09. [2025-09-14T16:37:33.895533] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T16:37:33.907747] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-09-14T16:37:34.104715] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-14T16:37:34.111666] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-09-14T16:37:34.556287] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T16:37:34.558696] [INFO ] [REMOTE ] AAUC: Full fetch complete (6222 records). [2025-09-14T16:37:34.558809] [DEBUG] [VALIDATOR ] AAUC: Validating primary data. [2025-09-14T16:37:34.742459] [WARN ] [VALIDATOR ] AAUC: Validation failed - insufficient historical data. Have 67 unique days, need 150 days [2025-09-14T16:37:34.742735] [FATAL] [MAIN ] AAUC: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:37:34.742798] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:37:34.742843] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-14T16:37:34.742917] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-14T16:37:34.742971] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-14T16:37:34.743017] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-14T16:37:34.743110] [INFO ] [MAIN ] Update Progress: 6/2370 symbols completed. AAUC took 5.3s. Estimated remaining: 2h 31m 23s. Rate: 15.6 symbols/min [2025-09-14T16:37:34.915160] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:34.939149] [DEBUG] [LOCAL ] ABBV: Loaded 24058 existing records from primary storage. [2025-09-14T16:37:34.939313] [INFO ] [MAIN ] ABBV: Loaded 24058 existing records. [2025-09-14T16:37:35.124576] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:35.125340] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-09-14T16:37:35.125537] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-14T16:37:35.126430] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-09-14T16:37:35.127227] [DEBUG] [LOCAL ] ABBV: Removed from QA tracker. [2025-09-14T16:37:35.127294] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-09-14T16:37:35.364697] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T16:37:35.465276] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-09-14T16:37:35.508187] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-14T16:37:35.574469] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:35.575008] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-09-14T16:37:35.576722] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-09-14T16:37:35.702424] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T16:37:35.713802] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-09-14T16:37:36.070665] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-14T16:37:36.075981] [INFO ] [REMOTE ] AAP: Full fetch complete (56703 records). [2025-09-14T16:37:36.076131] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-09-14T16:37:36.475758] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-09-14T16:37:36.475907] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-09-14T16:37:36.476748] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-09-14T16:37:36.476829] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-09-14T16:37:36.478578] [DEBUG] [LOCAL ] AAP: Trimmed 56703 records to 39164 (keeping 150 days of data) [2025-09-14T16:37:36.736465] [DEBUG] [LOCAL ] AAP: Primary data saved (39164 records). [2025-09-14T16:37:36.736761] [INFO ] [MAIN ] AAP: Full history saved. [2025-09-14T16:37:36.736904] [INFO ] [MAIN ] Update Progress: 7/2370 symbols completed. AAP took 15.0s. Estimated remaining: 2h 20m 55s. Rate: 16.8 symbols/min [2025-09-14T16:37:36.915411] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:36.933310] [DEBUG] [LOCAL ] ABCB: Loaded 13335 existing records from primary storage. [2025-09-14T16:37:36.933562] [INFO ] [MAIN ] ABCB: Loaded 13335 existing records. [2025-09-14T16:37:37.139499] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:37.161987] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-14T16:37:37.162124] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-09-14T16:37:37.162305] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-09-14T16:37:37.172507] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-09-14T16:37:37.172678] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-09-14T16:37:37.193467] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-14T16:37:37.200503] [DEBUG] [LOCAL ] ABCB: Removed from QA tracker. [2025-09-14T16:37:37.201371] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-09-14T16:37:37.234309] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-09-14T16:37:37.565322] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:37.566003] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-09-14T16:37:37.619430] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-14T16:37:37.629901] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-09-14T16:37:38.482620] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-14T16:37:38.489123] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-09-14T16:37:38.566742] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-14T16:37:38.574045] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-09-14T16:37:38.603076] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-14T16:37:38.612629] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-09-14T16:37:39.271207] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T16:37:39.274552] [INFO ] [REMOTE ] AAT: Full fetch complete (33027 records). [2025-09-14T16:37:39.274698] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-09-14T16:37:39.658045] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-09-14T16:37:39.658236] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-09-14T16:37:39.658620] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-09-14T16:37:39.658697] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-09-14T16:37:39.659631] [DEBUG] [LOCAL ] AAT: Trimmed 33027 records to 22768 (keeping 150 days of data) [2025-09-14T16:37:39.786229] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-14T16:37:39.793032] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-09-14T16:37:39.863315] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-14T16:37:39.884038] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-09-14T16:37:39.887539] [DEBUG] [LOCAL ] AAT: Primary data saved (22768 records). [2025-09-14T16:37:39.887849] [INFO ] [MAIN ] AAT: Full history saved. [2025-09-14T16:37:39.888111] [INFO ] [MAIN ] Update Progress: 8/2370 symbols completed. AAT took 11.9s. Estimated remaining: 2h 18m 46s. Rate: 17.0 symbols/min [2025-09-14T16:37:40.068106] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-14T16:37:40.093432] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:40.094359] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-09-14T16:37:40.119453] [DEBUG] [LOCAL ] ABEV: Loaded 23949 existing records from primary storage. [2025-09-14T16:37:40.119617] [INFO ] [MAIN ] ABEV: Loaded 23949 existing records. [2025-09-14T16:37:40.298908] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:40.299182] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-09-14T16:37:40.299243] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-09-14T16:37:40.299948] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-09-14T16:37:40.300463] [DEBUG] [LOCAL ] ABEV: Removed from QA tracker. [2025-09-14T16:37:40.300522] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-09-14T16:37:40.661055] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:40.661429] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-09-14T16:37:41.064385] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-14T16:37:41.070355] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-09-14T16:37:41.569682] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-14T16:37:41.582172] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-09-14T16:37:41.670764] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T16:37:41.682250] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-09-14T16:37:41.964715] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-14T16:37:41.970783] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-09-14T16:37:42.433447] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T16:37:42.443792] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-09-14T16:37:42.900170] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-14T16:37:42.914593] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-09-14T16:37:42.916425] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-14T16:37:42.919929] [INFO ] [REMOTE ] AB: Full fetch complete (33796 records). [2025-09-14T16:37:42.920077] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-09-14T16:37:43.295370] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-09-14T16:37:43.295483] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-09-14T16:37:43.295953] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-09-14T16:37:43.296014] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-09-14T16:37:43.296925] [DEBUG] [LOCAL ] AB: Trimmed 33796 records to 18396 (keeping 150 days of data) [2025-09-14T16:37:43.411872] [DEBUG] [LOCAL ] AB: Primary data saved (18396 records). [2025-09-14T16:37:43.412140] [INFO ] [MAIN ] AB: Full history saved. [2025-09-14T16:37:43.412289] [INFO ] [MAIN ] Update Progress: 9/2370 symbols completed. AB took 11.9s. Estimated remaining: 2h 18m 42s. Rate: 17.0 symbols/min [2025-09-14T16:37:43.595307] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:43.605214] [DEBUG] [LOCAL ] ABG: Loaded 8212 existing records from primary storage. [2025-09-14T16:37:43.605371] [INFO ] [MAIN ] ABG: Loaded 8212 existing records. [2025-09-14T16:37:43.767457] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-14T16:37:43.830477] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:43.831003] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-09-14T16:37:43.831118] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-09-14T16:37:43.832038] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-14T16:37:43.832439] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-09-14T16:37:43.833169] [DEBUG] [LOCAL ] ABG: Removed from QA tracker. [2025-09-14T16:37:43.833233] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-09-14T16:37:44.164546] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-14T16:37:44.239565] [INFO ] [REMOTE ] ABG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:44.234337] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-09-14T16:37:44.241493] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-09-14T16:37:44.446690] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-14T16:37:44.458260] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-09-14T16:37:45.311706] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T16:37:45.315942] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-09-14T16:37:45.517467] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-14T16:37:45.525516] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-09-14T16:37:45.689202] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-14T16:37:45.700842] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-09-14T16:37:46.428740] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-14T16:37:46.433939] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-09-14T16:37:46.476356] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-14T16:37:46.489067] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-09-14T16:37:46.574047] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-14T16:37:46.581204] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-09-14T16:37:46.838105] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-14T16:37:46.842937] [INFO ] [REMOTE ] ABCB: Full fetch complete (33236 records). [2025-09-14T16:37:46.843124] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-09-14T16:37:47.242078] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-09-14T16:37:47.242236] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-09-14T16:37:47.242729] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-09-14T16:37:47.242818] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-09-14T16:37:47.243972] [DEBUG] [LOCAL ] ABCB: Trimmed 33236 records to 22109 (keeping 150 days of data) [2025-09-14T16:37:47.377108] [DEBUG] [LOCAL ] ABCB: Primary data saved (22109 records). [2025-09-14T16:37:47.377280] [INFO ] [MAIN ] ABCB: Full history saved. [2025-09-14T16:37:47.377411] [INFO ] [MAIN ] Update Progress: 10/2370 symbols completed. ABCB took 10.6s. Estimated remaining: 2h 20m 22s. Rate: 16.8 symbols/min [2025-09-14T16:37:47.580619] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:47.596285] [DEBUG] [LOCAL ] ABM: Loaded 14683 existing records from primary storage. [2025-09-14T16:37:47.596441] [INFO ] [MAIN ] ABM: Loaded 14683 existing records. [2025-09-14T16:37:47.780730] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:47.781200] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-09-14T16:37:47.781300] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-09-14T16:37:47.781975] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-09-14T16:37:47.782546] [DEBUG] [LOCAL ] ABM: Removed from QA tracker. [2025-09-14T16:37:47.782619] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-09-14T16:37:47.955931] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-14T16:37:48.045835] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-09-14T16:37:48.190438] [INFO ] [REMOTE ] ABM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:48.190871] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-09-14T16:37:48.324909] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T16:37:48.336665] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-09-14T16:37:48.868394] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T16:37:48.872044] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-09-14T16:37:49.249585] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-14T16:37:49.255092] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-09-14T16:37:49.671516] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-14T16:37:49.675479] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-09-14T16:37:50.024507] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T16:37:50.035547] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-09-14T16:37:50.297434] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-14T16:37:50.304635] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-09-14T16:37:50.771513] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-14T16:37:50.776559] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-09-14T16:37:51.179897] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (5.48 seconds). [2025-09-14T16:37:51.192345] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-09-14T16:37:51.614158] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T16:37:51.627685] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-09-14T16:37:51.898471] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T16:37:51.903924] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-09-14T16:37:51.927052] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-14T16:37:51.935385] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-09-14T16:37:52.363708] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-14T16:37:52.365740] [INFO ] [REMOTE ] ABG: Full fetch complete (20418 records). [2025-09-14T16:37:52.365846] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-09-14T16:37:52.739412] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-09-14T16:37:52.739538] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-09-14T16:37:52.739909] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-09-14T16:37:52.740010] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-09-14T16:37:52.740946] [DEBUG] [LOCAL ] ABG: Trimmed 20418 records to 13231 (keeping 150 days of data) [2025-09-14T16:37:52.823759] [DEBUG] [LOCAL ] ABG: Primary data saved (13231 records). [2025-09-14T16:37:52.823942] [INFO ] [MAIN ] ABG: Full history saved. [2025-09-14T16:37:52.824103] [INFO ] [MAIN ] Update Progress: 11/2370 symbols completed. ABG took 9.4s. Estimated remaining: 2h 27m 1s. Rate: 16.0 symbols/min [2025-09-14T16:37:52.997733] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:53.020972] [DEBUG] [LOCAL ] ABR: Loaded 23060 existing records from primary storage. [2025-09-14T16:37:53.021148] [INFO ] [MAIN ] ABR: Loaded 23060 existing records. [2025-09-14T16:37:53.202635] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:53.202966] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-09-14T16:37:53.203157] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-14T16:37:53.209035] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-09-14T16:37:53.218284] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T16:37:53.223689] [DEBUG] [LOCAL ] ABR: Removed from QA tracker. [2025-09-14T16:37:53.224122] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-09-14T16:37:53.255829] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-09-14T16:37:53.590217] [INFO ] [REMOTE ] ABR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:53.590700] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-09-14T16:37:53.622834] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-14T16:37:53.665119] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-09-14T16:37:53.672280] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-09-14T16:37:53.684784] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-09-14T16:37:54.325473] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T16:37:54.331215] [INFO ] [REMOTE ] ABBV: Full fetch complete (58362 records). [2025-09-14T16:37:54.331381] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-09-14T16:37:54.730601] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-09-14T16:37:54.730873] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-09-14T16:37:54.731573] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-09-14T16:37:54.731687] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-09-14T16:37:54.733233] [DEBUG] [LOCAL ] ABBV: Trimmed 58362 records to 40433 (keeping 150 days of data) [2025-09-14T16:37:54.859047] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-14T16:37:54.870076] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-09-14T16:37:54.985390] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-14T16:37:55.019755] [INFO ] [REMOTE ] ABEV: Full fetch complete (57892 records). [2025-09-14T16:37:55.021389] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-09-14T16:37:55.432173] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-09-14T16:37:55.433155] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-09-14T16:37:55.435187] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-09-14T16:37:55.436107] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-09-14T16:37:55.441616] [DEBUG] [LOCAL ] ABEV: Trimmed 57892 records to 40061 (keeping 150 days of data) [2025-09-14T16:37:55.583144] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-14T16:37:55.584685] [DEBUG] [LOCAL ] ABBV: Primary data saved (40433 records). [2025-09-14T16:37:55.595225] [INFO ] [MAIN ] ABBV: Full history saved. [2025-09-14T16:37:55.595935] [INFO ] [MAIN ] Update Progress: 12/2370 symbols completed. ABBV took 20.9s. Estimated remaining: 2h 23m 48s. Rate: 16.4 symbols/min [2025-09-14T16:37:55.596763] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-09-14T16:37:55.780424] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:55.811785] [DEBUG] [LOCAL ] ABT: Loaded 24020 existing records from primary storage. [2025-09-14T16:37:55.813954] [INFO ] [MAIN ] ABT: Loaded 24020 existing records. [2025-09-14T16:37:56.093516] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:56.095528] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-09-14T16:37:56.104341] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-14T16:37:56.105714] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-09-14T16:37:56.119999] [DEBUG] [LOCAL ] ABT: Removed from QA tracker. [2025-09-14T16:37:56.134387] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-09-14T16:37:56.136034] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-14T16:37:56.183171] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-09-14T16:37:56.371914] [DEBUG] [LOCAL ] ABEV: Primary data saved (40061 records). [2025-09-14T16:37:56.430795] [INFO ] [MAIN ] ABEV: Full history saved. [2025-09-14T16:37:56.441100] [INFO ] [MAIN ] Update Progress: 13/2370 symbols completed. ABEV took 16.6s. Estimated remaining: 2h 15m 14s. Rate: 17.4 symbols/min [2025-09-14T16:37:56.621856] [INFO ] [REMOTE ] ABT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:56.622475] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-09-14T16:37:56.698123] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:56.710338] [DEBUG] [LOCAL ] ACA: Loaded 10019 existing records from primary storage. [2025-09-14T16:37:56.710501] [INFO ] [MAIN ] ACA: Loaded 10019 existing records. [2025-09-14T16:37:56.887472] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:56.887794] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-09-14T16:37:56.887880] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-09-14T16:37:56.888302] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-09-14T16:37:56.888905] [DEBUG] [LOCAL ] ACA: Removed from QA tracker. [2025-09-14T16:37:56.888966] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-09-14T16:37:57.256870] [INFO ] [REMOTE ] ACA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:57.257288] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-09-14T16:37:57.410546] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T16:37:57.421922] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-09-14T16:37:57.573943] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T16:37:57.581188] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-09-14T16:37:58.227590] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T16:37:58.232235] [INFO ] [REMOTE ] ABM: Full fetch complete (34054 records). [2025-09-14T16:37:58.232424] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-09-14T16:37:58.652131] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-09-14T16:37:58.652786] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-14T16:37:58.658497] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-09-14T16:37:58.659516] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-09-14T16:37:58.660197] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-09-14T16:37:58.660324] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-09-14T16:37:58.661758] [DEBUG] [LOCAL ] ABM: Trimmed 34054 records to 23534 (keeping 150 days of data) [2025-09-14T16:37:58.783314] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-14T16:37:58.795135] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-09-14T16:37:58.849032] [DEBUG] [LOCAL ] ABM: Primary data saved (23534 records). [2025-09-14T16:37:58.849212] [INFO ] [MAIN ] ABM: Full history saved. [2025-09-14T16:37:58.849335] [INFO ] [MAIN ] Update Progress: 14/2370 symbols completed. ABM took 11.5s. Estimated remaining: 2h 12m 16s. Rate: 17.8 symbols/min [2025-09-14T16:37:59.046222] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:37:59.065908] [DEBUG] [LOCAL ] ACCO: Loaded 15942 existing records from primary storage. [2025-09-14T16:37:59.066132] [INFO ] [MAIN ] ACCO: Loaded 15942 existing records. [2025-09-14T16:37:59.256019] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:37:59.256430] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-09-14T16:37:59.256511] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-14T16:37:59.257459] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-09-14T16:37:59.258476] [DEBUG] [LOCAL ] ACCO: Removed from QA tracker. [2025-09-14T16:37:59.258542] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-09-14T16:37:59.641934] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:37:59.642589] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-09-14T16:37:59.677944] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-14T16:37:59.691078] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-09-14T16:38:00.070492] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-14T16:38:00.077550] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-09-14T16:38:00.915404] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-14T16:38:00.927305] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-09-14T16:38:01.289415] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T16:38:01.295735] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-09-14T16:38:01.507681] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-14T16:38:01.510264] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T16:38:01.518489] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-09-14T16:38:01.530797] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-09-14T16:38:02.506351] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-14T16:38:02.513225] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-09-14T16:38:02.755601] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-14T16:38:02.767312] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-09-14T16:38:02.995941] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-14T16:38:03.006874] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-09-14T16:38:03.191078] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T16:38:03.199926] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-09-14T16:38:03.292448] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-14T16:38:03.297902] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-09-14T16:38:04.104543] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-14T16:38:04.110311] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-09-14T16:38:04.693110] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-14T16:38:04.709126] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-09-14T16:38:04.773736] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T16:38:04.782763] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-09-14T16:38:04.918842] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-14T16:38:04.925072] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-09-14T16:38:04.980757] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-14T16:38:04.992472] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-09-14T16:38:05.148182] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-09-14T16:38:05.150758] [INFO ] [REMOTE ] ACA: Full fetch complete (26635 records). [2025-09-14T16:38:05.150869] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-09-14T16:38:05.533861] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-09-14T16:38:05.534012] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-09-14T16:38:05.534506] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-09-14T16:38:05.534595] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-09-14T16:38:05.540276] [DEBUG] [LOCAL ] ACA: Trimmed 26635 records to 17137 (keeping 150 days of data) [2025-09-14T16:38:05.663206] [DEBUG] [LOCAL ] ACA: Primary data saved (17137 records). [2025-09-14T16:38:05.663680] [INFO ] [MAIN ] ACA: Full history saved. [2025-09-14T16:38:05.663839] [INFO ] [MAIN ] Update Progress: 15/2370 symbols completed. ACA took 9.2s. Estimated remaining: 2h 21m 14s. Rate: 16.7 symbols/min [2025-09-14T16:38:05.890708] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:38:05.908566] [DEBUG] [LOCAL ] ACEL: Loaded 11135 existing records from primary storage. [2025-09-14T16:38:05.908813] [INFO ] [MAIN ] ACEL: Loaded 11135 existing records. [2025-09-14T16:38:06.192194] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:38:06.214384] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-09-14T16:38:06.219400] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-14T16:38:06.220236] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-09-14T16:38:06.223189] [DEBUG] [LOCAL ] ACEL: Removed from QA tracker. [2025-09-14T16:38:06.226919] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-14T16:38:06.227311] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-09-14T16:38:06.277350] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-09-14T16:38:06.493710] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T16:38:06.563910] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-09-14T16:38:06.866414] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:38:06.892571] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-09-14T16:38:06.896683] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T16:38:06.958862] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-09-14T16:38:07.387937] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T16:38:07.598831] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T16:38:07.604604] [INFO ] [REMOTE ] ABR: Full fetch complete (56755 records). [2025-09-14T16:38:07.604831] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-09-14T16:38:07.762408] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-09-14T16:38:08.005520] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-09-14T16:38:08.005741] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-09-14T16:38:08.006555] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-09-14T16:38:08.006755] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-09-14T16:38:08.024146] [DEBUG] [LOCAL ] ABR: Trimmed 56755 records to 39178 (keeping 150 days of data) [2025-09-14T16:38:08.024715] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-14T16:38:08.277171] [DEBUG] [LOCAL ] ABR: Primary data saved (39178 records). [2025-09-14T16:38:08.277386] [INFO ] [MAIN ] ABR: Full history saved. [2025-09-14T16:38:08.277519] [INFO ] [MAIN ] Update Progress: 16/2370 symbols completed. ABR took 15.5s. Estimated remaining: 2h 18m 46s. Rate: 17.0 symbols/min [2025-09-14T16:38:08.451199] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:38:08.475811] [DEBUG] [LOCAL ] ACHR: Loaded 24180 existing records from primary storage. [2025-09-14T16:38:08.475992] [INFO ] [MAIN ] ACHR: Loaded 24180 existing records. [2025-09-14T16:38:08.567277] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-09-14T16:38:08.656017] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:38:08.656298] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-09-14T16:38:08.656372] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-14T16:38:08.657195] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-09-14T16:38:08.657788] [DEBUG] [LOCAL ] ACHR: Removed from QA tracker. [2025-09-14T16:38:08.657850] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-09-14T16:38:09.018695] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:38:09.056154] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-14T16:38:09.358886] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-09-14T16:38:09.438618] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T16:38:09.747438] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-14T16:38:10.158818] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-09-14T16:38:10.958843] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-09-14T16:38:11.146559] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T16:38:11.583823] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-14T16:38:11.758843] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-09-14T16:38:12.563998] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-09-14T16:38:12.568688] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T16:38:12.810406] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-14T16:38:13.358874] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-09-14T16:38:14.158840] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-09-14T16:38:14.396792] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-14T16:38:14.882576] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-14T16:38:14.958832] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-09-14T16:38:15.465045] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-14T16:38:15.468807] [INFO ] [REMOTE ] ACCO: Full fetch complete (41475 records). [2025-09-14T16:38:15.468920] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-09-14T16:38:15.759325] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-09-14T16:38:15.846406] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-09-14T16:38:15.846519] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-09-14T16:38:15.847047] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-09-14T16:38:15.847116] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-09-14T16:38:15.848122] [DEBUG] [LOCAL ] ACCO: Trimmed 41475 records to 27964 (keeping 150 days of data) [2025-09-14T16:38:16.012455] [DEBUG] [LOCAL ] ACCO: Primary data saved (27964 records). [2025-09-14T16:38:16.012629] [INFO ] [MAIN ] ACCO: Full history saved. [2025-09-14T16:38:16.012748] [INFO ] [MAIN ] Update Progress: 17/2370 symbols completed. ACCO took 17.2s. Estimated remaining: 2h 28m 23s. Rate: 15.9 symbols/min [2025-09-14T16:38:16.186163] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:38:16.201766] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T16:38:16.207806] [INFO ] [REMOTE ] ABT: Full fetch complete (58289 records). [2025-09-14T16:38:16.207960] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-09-14T16:38:16.389135] [DEBUG] [LOCAL ] ACI: Loaded 23796 existing records from primary storage. [2025-09-14T16:38:16.425725] [INFO ] [MAIN ] ACI: Loaded 23796 existing records. [2025-09-14T16:38:16.561532] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-09-14T16:38:16.786282] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-09-14T16:38:16.807567] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-09-14T16:38:16.807728] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:38:16.808369] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-09-14T16:38:16.808495] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-09-14T16:38:16.808683] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-09-14T16:38:16.808856] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-14T16:38:16.809513] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-09-14T16:38:16.810184] [DEBUG] [LOCAL ] ABT: Trimmed 58289 records to 40373 (keeping 150 days of data) [2025-09-14T16:38:16.810604] [DEBUG] [LOCAL ] ACI: Removed from QA tracker. [2025-09-14T16:38:16.810913] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-09-14T16:38:17.288730] [INFO ] [REMOTE ] ACI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:38:17.371193] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-09-14T16:38:17.447382] [DEBUG] [LOCAL ] ABT: Primary data saved (40373 records). [2025-09-14T16:38:17.447633] [INFO ] [MAIN ] ABT: Full history saved. [2025-09-14T16:38:17.447820] [INFO ] [MAIN ] Update Progress: 18/2370 symbols completed. ABT took 21.9s. Estimated remaining: 2h 23m 12s. Rate: 16.4 symbols/min [2025-09-14T16:38:17.639049] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:38:17.672057] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-09-14T16:38:17.699890] [DEBUG] [LOCAL ] ACM: Loaded 18918 existing records from primary storage. [2025-09-14T16:38:17.700076] [INFO ] [MAIN ] ACM: Loaded 18918 existing records. [2025-09-14T16:38:17.877151] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:38:17.877448] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-09-14T16:38:17.877519] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-09-14T16:38:17.878098] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-09-14T16:38:17.878728] [DEBUG] [LOCAL ] ACM: Removed from QA tracker. [2025-09-14T16:38:17.878790] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-09-14T16:38:18.167431] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-09-14T16:38:18.264802] [INFO ] [REMOTE ] ACM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:38:18.266602] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T16:38:18.958894] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-09-14T16:38:19.063812] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T16:38:19.758859] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-09-14T16:38:20.558795] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-09-14T16:38:20.650038] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T16:38:20.838275] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-14T16:38:21.090548] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-14T16:38:21.358854] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-09-14T16:38:22.158894] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-09-14T16:38:22.269897] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-14T16:38:22.958848] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-09-14T16:38:23.687279] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T16:38:23.690314] [INFO ] [REMOTE ] ACEL: Full fetch complete (30275 records). [2025-09-14T16:38:23.690434] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-09-14T16:38:23.761313] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-09-14T16:38:23.882606] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T16:38:24.109792] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-09-14T16:38:24.109940] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-09-14T16:38:24.110343] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-09-14T16:38:24.110564] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-09-14T16:38:24.111775] [DEBUG] [LOCAL ] ACEL: Trimmed 30275 records to 19768 (keeping 150 days of data) [2025-09-14T16:38:24.238664] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.88 seconds). [2025-09-14T16:38:24.285085] [DEBUG] [LOCAL ] ACEL: Primary data saved (19768 records). [2025-09-14T16:38:24.285317] [INFO ] [MAIN ] ACEL: Full history saved. [2025-09-14T16:38:24.285483] [INFO ] [MAIN ] Update Progress: 19/2370 symbols completed. ACEL took 18.6s. Estimated remaining: 2h 29m 43s. Rate: 15.7 symbols/min [2025-09-14T16:38:24.454814] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:38:24.479320] [DEBUG] [LOCAL ] ACN: Loaded 23971 existing records from primary storage. [2025-09-14T16:38:24.479507] [INFO ] [MAIN ] ACN: Loaded 23971 existing records. [2025-09-14T16:38:24.568373] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-09-14T16:38:24.656976] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:38:24.657245] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-09-14T16:38:24.657316] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-14T16:38:24.657953] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-09-14T16:38:24.658607] [DEBUG] [LOCAL ] ACN: Removed from QA tracker. [2025-09-14T16:38:24.658691] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-09-14T16:38:25.013860] [INFO ] [REMOTE ] ACN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:38:25.353488] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T16:38:25.363995] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-09-14T16:38:26.158861] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-09-14T16:38:26.208606] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-14T16:38:26.882218] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T16:38:26.958805] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-09-14T16:38:27.758833] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-09-14T16:38:27.892037] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T16:38:28.424118] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T16:38:28.558838] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-09-14T16:38:29.358882] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-09-14T16:38:29.682267] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T16:38:30.158919] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-09-14T16:38:30.229409] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T16:38:30.512037] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-14T16:38:30.958854] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-09-14T16:38:31.758883] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-09-14T16:38:32.323169] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-14T16:38:32.529094] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-14T16:38:32.558781] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-09-14T16:38:33.358834] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-09-14T16:38:33.605512] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-14T16:38:34.119430] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T16:38:34.158777] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-09-14T16:38:34.814117] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T16:38:34.819636] [INFO ] [REMOTE ] ACM: Full fetch complete (47141 records). [2025-09-14T16:38:34.819793] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-09-14T16:38:34.962141] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-09-14T16:38:35.209661] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-09-14T16:38:35.209912] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-09-14T16:38:35.210448] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-09-14T16:38:35.210522] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-09-14T16:38:35.212130] [DEBUG] [LOCAL ] ACM: Trimmed 47141 records to 31709 (keeping 150 days of data) [2025-09-14T16:38:35.346902] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-14T16:38:35.454751] [DEBUG] [LOCAL ] ACM: Primary data saved (31709 records). [2025-09-14T16:38:35.454928] [INFO ] [MAIN ] ACM: Full history saved. [2025-09-14T16:38:35.455035] [INFO ] [MAIN ] Update Progress: 20/2370 symbols completed. ACM took 18.0s. Estimated remaining: 2h 44m 2s. Rate: 14.3 symbols/min [2025-09-14T16:38:35.630120] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:38:35.644914] [DEBUG] [LOCAL ] ACP: Loaded 13507 existing records from primary storage. [2025-09-14T16:38:35.645071] [INFO ] [MAIN ] ACP: Loaded 13507 existing records. [2025-09-14T16:38:35.763985] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-09-14T16:38:35.836215] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:38:35.836479] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-09-14T16:38:35.836553] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-14T16:38:35.837057] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-09-14T16:38:35.837665] [DEBUG] [LOCAL ] ACP: Removed from QA tracker. [2025-09-14T16:38:35.837732] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-09-14T16:38:36.203971] [INFO ] [REMOTE ] ACP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:38:36.558843] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-09-14T16:38:36.982253] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-14T16:38:37.358861] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-09-14T16:38:37.714148] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-14T16:38:37.906504] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-14T16:38:38.008635] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T16:38:38.014170] [INFO ] [REMOTE ] ACI: Full fetch complete (57864 records). [2025-09-14T16:38:38.014300] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-09-14T16:38:38.166567] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-09-14T16:38:38.398175] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-09-14T16:38:38.398289] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-09-14T16:38:38.398880] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-09-14T16:38:38.398938] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-09-14T16:38:38.400217] [DEBUG] [LOCAL ] ACI: Trimmed 57864 records to 40065 (keeping 150 days of data) [2025-09-14T16:38:38.670454] [DEBUG] [LOCAL ] ACI: Primary data saved (40065 records). [2025-09-14T16:38:38.670670] [INFO ] [MAIN ] ACI: Full history saved. [2025-09-14T16:38:38.670817] [INFO ] [MAIN ] Update Progress: 21/2370 symbols completed. ACI took 22.7s. Estimated remaining: 2h 42m 9s. Rate: 14.5 symbols/min [2025-09-14T16:38:38.840591] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:38:38.844858] [DEBUG] [LOCAL ] ACR: Loaded 2258 existing records from primary storage. [2025-09-14T16:38:38.844973] [INFO ] [MAIN ] ACR: Loaded 2258 existing records. [2025-09-14T16:38:38.963925] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-09-14T16:38:39.027860] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:38:39.028273] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-09-14T16:38:39.028353] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-14T16:38:39.028632] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-09-14T16:38:39.029200] [DEBUG] [LOCAL ] ACR: Removed from QA tracker. [2025-09-14T16:38:39.029261] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-09-14T16:38:39.401929] [INFO ] [REMOTE ] ACR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:38:39.663205] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T16:38:39.758839] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-09-14T16:38:40.558891] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-09-14T16:38:40.855401] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T16:38:41.358886] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-09-14T16:38:41.653755] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-09-14T16:38:42.158796] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-09-14T16:38:42.519893] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T16:38:42.649231] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-14T16:38:42.958852] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-09-14T16:38:43.758872] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-09-14T16:38:44.329264] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T16:38:44.340504] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-14T16:38:44.558839] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-09-14T16:38:44.988979] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-09-14T16:38:45.141485] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-14T16:38:45.358838] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-09-14T16:38:46.158843] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-09-14T16:38:46.791525] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-14T16:38:46.958845] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-09-14T16:38:47.758843] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-09-14T16:38:48.462897] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-14T16:38:48.558842] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-09-14T16:38:48.708103] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T16:38:48.940665] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.78 seconds). [2025-09-14T16:38:49.286590] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-14T16:38:49.358795] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-09-14T16:38:50.120032] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-14T16:38:50.158788] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-09-14T16:38:50.958839] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-09-14T16:38:51.522763] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T16:38:51.528536] [INFO ] [REMOTE ] ACN: Full fetch complete (58010 records). [2025-09-14T16:38:51.528710] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-09-14T16:38:51.765486] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-09-14T16:38:51.930196] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-09-14T16:38:51.930312] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-09-14T16:38:51.930965] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-09-14T16:38:51.931028] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-09-14T16:38:51.933704] [DEBUG] [LOCAL ] ACN: Trimmed 58010 records to 40185 (keeping 150 days of data) [2025-09-14T16:38:52.188271] [DEBUG] [LOCAL ] ACN: Primary data saved (40185 records). [2025-09-14T16:38:52.188431] [INFO ] [MAIN ] ACN: Full history saved. [2025-09-14T16:38:52.188529] [INFO ] [MAIN ] Update Progress: 22/2370 symbols completed. ACN took 27.9s. Estimated remaining: 2h 58m 46s. Rate: 13.1 symbols/min [2025-09-14T16:38:52.326216] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-14T16:38:52.380916] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:38:52.399456] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-14T16:38:52.409994] [INFO ] [REMOTE ] ACHR: Full fetch complete (58498 records). [2025-09-14T16:38:52.410258] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-09-14T16:38:52.492865] [DEBUG] [LOCAL ] ACRE: Loaded 14580 existing records from primary storage. [2025-09-14T16:38:52.519122] [INFO ] [MAIN ] ACRE: Loaded 14580 existing records. [2025-09-14T16:38:52.567618] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-09-14T16:38:52.919356] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:38:52.920314] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-09-14T16:38:52.946569] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-14T16:38:53.014241] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-09-14T16:38:53.017600] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-09-14T16:38:53.017780] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-09-14T16:38:53.018536] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-09-14T16:38:53.019054] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-09-14T16:38:53.019378] [DEBUG] [LOCAL ] ACRE: Removed from QA tracker. [2025-09-14T16:38:53.019467] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-09-14T16:38:53.127890] [DEBUG] [LOCAL ] ACHR: Trimmed 58498 records to 40558 (keeping 150 days of data) [2025-09-14T16:38:53.359911] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-09-14T16:38:53.428873] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-14T16:38:53.492119] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:38:53.649921] [DEBUG] [LOCAL ] ACHR: Primary data saved (40558 records). [2025-09-14T16:38:53.650105] [INFO ] [MAIN ] ACHR: Full history saved. [2025-09-14T16:38:53.650239] [INFO ] [MAIN ] Update Progress: 23/2370 symbols completed. ACHR took 45.4s. Estimated remaining: 2h 53m 24s. Rate: 13.5 symbols/min [2025-09-14T16:38:53.827134] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:38:53.831615] [DEBUG] [LOCAL ] ACV: Loaded 2675 existing records from primary storage. [2025-09-14T16:38:53.831755] [INFO ] [MAIN ] ACV: Loaded 2675 existing records. [2025-09-14T16:38:54.019955] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:38:54.020214] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-09-14T16:38:54.020280] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-09-14T16:38:54.020575] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-09-14T16:38:54.021124] [DEBUG] [LOCAL ] ACV: Removed from QA tracker. [2025-09-14T16:38:54.021186] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-09-14T16:38:54.166187] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-09-14T16:38:54.389266] [INFO ] [REMOTE ] ACV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:38:54.558298] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-14T16:38:54.958839] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-09-14T16:38:55.455986] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T16:38:55.456971] [INFO ] [REMOTE ] ACR: Full fetch complete (7108 records). [2025-09-14T16:38:55.457056] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-09-14T16:38:55.775308] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-09-14T16:38:55.813824] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-09-14T16:38:55.813985] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-09-14T16:38:55.814337] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-09-14T16:38:55.814438] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-09-14T16:38:55.815463] [DEBUG] [LOCAL ] ACR: Trimmed 7108 records to 4230 (keeping 150 days of data) [2025-09-14T16:38:55.835739] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T16:38:55.869458] [DEBUG] [LOCAL ] ACR: Primary data saved (4230 records). [2025-09-14T16:38:55.869605] [INFO ] [MAIN ] ACR: Full history saved. [2025-09-14T16:38:55.869749] [INFO ] [MAIN ] Update Progress: 24/2370 symbols completed. ACR took 17.2s. Estimated remaining: 2h 49m 44s. Rate: 13.8 symbols/min [2025-09-14T16:38:56.041298] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:38:56.068864] [DEBUG] [LOCAL ] ACVA: Loaded 21723 existing records from primary storage. [2025-09-14T16:38:56.069039] [INFO ] [MAIN ] ACVA: Loaded 21723 existing records. [2025-09-14T16:38:56.243674] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:38:56.243948] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-09-14T16:38:56.244026] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-09-14T16:38:56.244667] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-09-14T16:38:56.245167] [DEBUG] [LOCAL ] ACVA: Removed from QA tracker. [2025-09-14T16:38:56.245227] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-09-14T16:38:56.563904] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-09-14T16:38:56.657697] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:38:56.663020] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T16:38:57.358846] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-09-14T16:38:57.920093] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-14T16:38:58.158832] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-09-14T16:38:58.220339] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-14T16:38:58.223533] [INFO ] [REMOTE ] ACP: Full fetch complete (34364 records). [2025-09-14T16:38:58.223664] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-09-14T16:38:58.599683] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-09-14T16:38:58.599836] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-09-14T16:38:58.600304] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-09-14T16:38:58.600368] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-09-14T16:38:58.601722] [DEBUG] [LOCAL ] ACP: Trimmed 34364 records to 23365 (keeping 150 days of data) [2025-09-14T16:38:58.747468] [DEBUG] [LOCAL ] ACP: Primary data saved (23365 records). [2025-09-14T16:38:58.747683] [INFO ] [MAIN ] ACP: Full history saved. [2025-09-14T16:38:58.747823] [INFO ] [MAIN ] Update Progress: 25/2370 symbols completed. ACP took 23.3s. Estimated remaining: 2h 47m 22s. Rate: 14.0 symbols/min [2025-09-14T16:38:58.929018] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:38:58.936184] [DEBUG] [LOCAL ] AD: Loaded 4587 existing records from primary storage. [2025-09-14T16:38:58.936323] [INFO ] [MAIN ] AD: Loaded 4587 existing records. [2025-09-14T16:38:58.969818] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-09-14T16:38:59.124127] [WARN ] [MAIN ] AD: Insufficient historical data. Have data from 2025-08-12, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:38:59.124391] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-14T16:38:59.124472] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-14T16:38:59.124773] [DEBUG] [LOCAL ] AD: Deleted primary data file. [2025-09-14T16:38:59.125371] [DEBUG] [LOCAL ] AD: Removed from QA tracker. [2025-09-14T16:38:59.125472] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-14T16:38:59.486751] [INFO ] [REMOTE ] AD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:38:59.590045] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-14T16:38:59.734593] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T16:38:59.758880] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-02. [2025-09-14T16:39:00.011118] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:39:00.011531] [WARN ] [REMOTE ] AD: No data returned for month 2025-02 [2025-09-14T16:39:00.558829] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-09-14T16:39:01.358844] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-03. [2025-09-14T16:39:01.632169] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:39:01.632549] [WARN ] [REMOTE ] AD: No data returned for month 2025-03 [2025-09-14T16:39:02.158828] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-09-14T16:39:02.228725] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T16:39:02.958837] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-09-14T16:39:03.758895] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-04. [2025-09-14T16:39:03.995831] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-14T16:39:04.009960] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-14T16:39:04.055713] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:39:04.056083] [WARN ] [REMOTE ] AD: No data returned for month 2025-04 [2025-09-14T16:39:04.558851] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-05. [2025-09-14T16:39:04.817165] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:39:04.817560] [WARN ] [REMOTE ] AD: No data returned for month 2025-05 [2025-09-14T16:39:05.358829] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-09-14T16:39:06.158833] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-09-14T16:39:06.451263] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T16:39:06.958836] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-06. [2025-09-14T16:39:07.027095] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-14T16:39:07.286317] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:39:07.286682] [WARN ] [REMOTE ] AD: No data returned for month 2025-06 [2025-09-14T16:39:07.758829] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-09-14T16:39:08.558840] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-09-14T16:39:09.233021] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-14T16:39:09.353266] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T16:39:09.363680] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-09-14T16:39:10.158810] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-09-14T16:39:10.845094] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T16:39:10.958818] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-07. [2025-09-14T16:39:11.256494] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:39:11.256881] [WARN ] [REMOTE ] AD: No data returned for month 2025-07 [2025-09-14T16:39:11.731070] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T16:39:11.758796] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-09-14T16:39:12.558851] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-08. [2025-09-14T16:39:13.358850] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-09-14T16:39:13.404374] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T16:39:13.729200] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-14T16:39:13.811158] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-14T16:39:14.158840] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-09. [2025-09-14T16:39:14.958824] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-09-14T16:39:14.986150] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-14T16:39:14.988576] [INFO ] [REMOTE ] AD: Full fetch complete (4587 records). [2025-09-14T16:39:14.988685] [DEBUG] [VALIDATOR ] AD: Validating primary data. [2025-09-14T16:39:15.171440] [WARN ] [VALIDATOR ] AD: Validation failed - insufficient historical data. Have 23 unique days, need 150 days [2025-09-14T16:39:15.171700] [FATAL] [MAIN ] AD: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:39:15.171797] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:39:15.171850] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-14T16:39:15.171942] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-14T16:39:15.172002] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-14T16:39:15.172125] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-14T16:39:15.172209] [INFO ] [MAIN ] Update Progress: 26/2370 symbols completed. AD took 16.4s. Estimated remaining: 3h 5m 32s. Rate: 12.6 symbols/min [2025-09-14T16:39:15.344148] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:39:15.364191] [DEBUG] [LOCAL ] ADC: Loaded 20466 existing records from primary storage. [2025-09-14T16:39:15.364365] [INFO ] [MAIN ] ADC: Loaded 20466 existing records. [2025-09-14T16:39:15.535833] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:39:15.536120] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-09-14T16:39:15.536181] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-14T16:39:15.536925] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-09-14T16:39:15.537451] [DEBUG] [LOCAL ] ADC: Removed from QA tracker. [2025-09-14T16:39:15.537509] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-09-14T16:39:15.764070] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-09-14T16:39:15.891307] [INFO ] [REMOTE ] ADC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:39:16.365619] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-14T16:39:16.468761] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-14T16:39:16.558809] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-09-14T16:39:17.002152] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-14T16:39:17.358890] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-09-14T16:39:18.158842] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-09-14T16:39:18.519086] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-14T16:39:18.523127] [INFO ] [REMOTE ] ACRE: Full fetch complete (37317 records). [2025-09-14T16:39:18.523285] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-09-14T16:39:18.903769] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-09-14T16:39:18.908323] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-09-14T16:39:18.908605] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T16:39:18.909226] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-09-14T16:39:18.909431] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-09-14T16:39:18.911834] [INFO ] [REMOTE ] ACV: Full fetch complete (7385 records). [2025-09-14T16:39:18.912102] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-09-14T16:39:18.912605] [DEBUG] [LOCAL ] ACRE: Trimmed 37317 records to 24833 (keeping 150 days of data) [2025-09-14T16:39:18.959701] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-09-14T16:39:19.565178] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-09-14T16:39:19.567365] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-09-14T16:39:19.567866] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-09-14T16:39:19.569080] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-09-14T16:39:19.610505] [DEBUG] [LOCAL ] ACV: Trimmed 7385 records to 4645 (keeping 150 days of data) [2025-09-14T16:39:19.620444] [DEBUG] [LOCAL ] ACRE: Primary data saved (24833 records). [2025-09-14T16:39:19.620625] [INFO ] [MAIN ] ACRE: Full history saved. [2025-09-14T16:39:19.620780] [INFO ] [MAIN ] Update Progress: 27/2370 symbols completed. ACRE took 27.4s. Estimated remaining: 3h 5m 2s. Rate: 12.7 symbols/min [2025-09-14T16:39:19.767225] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-09-14T16:39:19.845962] [DEBUG] [LOCAL ] ACV: Primary data saved (4645 records). [2025-09-14T16:39:19.846309] [INFO ] [MAIN ] ACV: Full history saved. [2025-09-14T16:39:19.857748] [INFO ] [MAIN ] Update Progress: 28/2370 symbols completed. ACV took 26.2s. Estimated remaining: 2h 58m 40s. Rate: 13.1 symbols/min [2025-09-14T16:39:20.049723] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:39:20.212763] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:39:20.225569] [DEBUG] [LOCAL ] ADCT: Loaded 16452 existing records from primary storage. [2025-09-14T16:39:20.226074] [INFO ] [MAIN ] ADCT: Loaded 16452 existing records. [2025-09-14T16:39:20.453912] [DEBUG] [LOCAL ] ADM: Loaded 23929 existing records from primary storage. [2025-09-14T16:39:20.454049] [INFO ] [MAIN ] ADM: Loaded 23929 existing records. [2025-09-14T16:39:20.453375] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:39:20.528301] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-09-14T16:39:20.551742] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-09-14T16:39:20.564951] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-09-14T16:39:20.634553] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:39:20.634888] [DEBUG] [LOCAL ] ADCT: Removed from QA tracker. [2025-09-14T16:39:20.635052] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-09-14T16:39:20.640515] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-09-14T16:39:20.678070] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-14T16:39:20.740169] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-09-14T16:39:20.781980] [DEBUG] [LOCAL ] ADM: Removed from QA tracker. [2025-09-14T16:39:20.850965] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-09-14T16:39:21.061469] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-14T16:39:21.223608] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:39:21.223994] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-09-14T16:39:21.372851] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-09-14T16:39:21.400067] [INFO ] [REMOTE ] ADM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:39:21.428568] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T16:39:22.158851] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-09-14T16:39:22.532618] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-14T16:39:22.961943] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-09-14T16:39:22.967410] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-14T16:39:23.758886] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-09-14T16:39:24.133288] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-14T16:39:24.319784] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-14T16:39:24.558839] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-09-14T16:39:25.358857] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-09-14T16:39:25.397552] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-14T16:39:25.649398] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-14T16:39:26.158888] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-09-14T16:39:26.958865] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-09-14T16:39:27.221784] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T16:39:27.539150] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-14T16:39:27.758859] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-09-14T16:39:28.558864] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-09-14T16:39:28.761805] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T16:39:29.358783] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-09-14T16:39:29.547463] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T16:39:29.775981] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T16:39:30.158826] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-09-14T16:39:30.958839] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-09-14T16:39:31.144915] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T16:39:31.356973] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T16:39:31.758874] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-09-14T16:39:32.558837] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-09-14T16:39:32.833021] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-14T16:39:32.911451] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-14T16:39:33.358864] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-09-14T16:39:33.689030] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-14T16:39:33.695923] [INFO ] [REMOTE ] ACVA: Full fetch complete (53547 records). [2025-09-14T16:39:33.696105] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-09-14T16:39:34.086461] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-09-14T16:39:34.086579] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-09-14T16:39:34.087140] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-09-14T16:39:34.087202] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-09-14T16:39:34.088504] [DEBUG] [LOCAL ] ACVA: Trimmed 53547 records to 36553 (keeping 150 days of data) [2025-09-14T16:39:34.179994] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-09-14T16:39:34.325510] [DEBUG] [LOCAL ] ACVA: Primary data saved (36553 records). [2025-09-14T16:39:34.325740] [INFO ] [MAIN ] ACVA: Full history saved. [2025-09-14T16:39:34.325864] [INFO ] [MAIN ] Update Progress: 29/2370 symbols completed. ACVA took 38.5s. Estimated remaining: 3h 11m 54s. Rate: 12.2 symbols/min [2025-09-14T16:39:34.499040] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:39:34.520108] [DEBUG] [LOCAL ] ADNT: Loaded 20986 existing records from primary storage. [2025-09-14T16:39:34.520317] [INFO ] [MAIN ] ADNT: Loaded 20986 existing records. [2025-09-14T16:39:34.711433] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:39:34.711761] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-09-14T16:39:34.711841] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-14T16:39:34.712575] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-09-14T16:39:34.713184] [DEBUG] [LOCAL ] ADNT: Removed from QA tracker. [2025-09-14T16:39:34.713257] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-09-14T16:39:34.963147] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-09-14T16:39:35.081316] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:39:35.111209] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T16:39:35.758872] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-09-14T16:39:35.995007] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T16:39:36.323209] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T16:39:36.327210] [INFO ] [REMOTE ] ADCT: Full fetch complete (36721 records). [2025-09-14T16:39:36.327315] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-09-14T16:39:36.571634] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-09-14T16:39:36.698393] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-09-14T16:39:36.698515] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-09-14T16:39:36.699061] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-09-14T16:39:36.699130] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-09-14T16:39:36.700161] [DEBUG] [LOCAL ] ADCT: Trimmed 36721 records to 25869 (keeping 150 days of data) [2025-09-14T16:39:36.845529] [DEBUG] [LOCAL ] ADCT: Primary data saved (25869 records). [2025-09-14T16:39:36.845709] [INFO ] [MAIN ] ADCT: Full history saved. [2025-09-14T16:39:36.845880] [INFO ] [MAIN ] Update Progress: 30/2370 symbols completed. ADCT took 17.2s. Estimated remaining: 3h 8m 42s. Rate: 12.4 symbols/min [2025-09-14T16:39:37.022031] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:39:37.047184] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-14T16:39:37.074124] [DEBUG] [LOCAL ] ADT: Loaded 23933 existing records from primary storage. [2025-09-14T16:39:37.074297] [INFO ] [MAIN ] ADT: Loaded 23933 existing records. [2025-09-14T16:39:37.255838] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:39:37.256116] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-09-14T16:39:37.256177] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-14T16:39:37.256874] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-09-14T16:39:37.257394] [DEBUG] [LOCAL ] ADT: Removed from QA tracker. [2025-09-14T16:39:37.257455] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-09-14T16:39:37.364173] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-09-14T16:39:37.625521] [INFO ] [REMOTE ] ADT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:39:38.158814] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-09-14T16:39:38.732929] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-14T16:39:38.958803] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-09-14T16:39:39.184253] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-14T16:39:39.613721] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-14T16:39:39.758791] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-09-14T16:39:40.558803] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-09-14T16:39:40.946471] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-14T16:39:41.078622] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-14T16:39:41.358922] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-09-14T16:39:41.887317] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-14T16:39:41.888224] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T16:39:41.902985] [INFO ] [REMOTE ] ADM: Full fetch complete (58069 records). [2025-09-14T16:39:41.903227] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-09-14T16:39:42.163938] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-09-14T16:39:42.296759] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-09-14T16:39:42.296889] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-09-14T16:39:42.297545] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-09-14T16:39:42.297657] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-09-14T16:39:42.299136] [DEBUG] [LOCAL ] ADM: Trimmed 58069 records to 40170 (keeping 150 days of data) [2025-09-14T16:39:42.545088] [DEBUG] [LOCAL ] ADM: Primary data saved (40170 records). [2025-09-14T16:39:42.545279] [INFO ] [MAIN ] ADM: Full history saved. [2025-09-14T16:39:42.545400] [INFO ] [MAIN ] Update Progress: 31/2370 symbols completed. ADM took 22.7s. Estimated remaining: 3h 9m 42s. Rate: 12.3 symbols/min [2025-09-14T16:39:42.722476] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:39:42.736597] [DEBUG] [LOCAL ] ADX: Loaded 12600 existing records from primary storage. [2025-09-14T16:39:42.736760] [INFO ] [MAIN ] ADX: Loaded 12600 existing records. [2025-09-14T16:39:42.917332] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:39:42.917580] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-09-14T16:39:42.917657] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-09-14T16:39:42.918069] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-09-14T16:39:42.918508] [DEBUG] [LOCAL ] ADX: Removed from QA tracker. [2025-09-14T16:39:42.918566] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-09-14T16:39:42.964031] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-09-14T16:39:43.272428] [INFO ] [REMOTE ] ADX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:39:43.758874] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-09-14T16:39:43.939606] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T16:39:44.064868] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T16:39:44.069973] [INFO ] [REMOTE ] ADC: Full fetch complete (50730 records). [2025-09-14T16:39:44.070114] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-09-14T16:39:44.442089] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-09-14T16:39:44.442197] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-09-14T16:39:44.442810] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-09-14T16:39:44.442887] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-09-14T16:39:44.444064] [DEBUG] [LOCAL ] ADC: Trimmed 50730 records to 35023 (keeping 150 days of data) [2025-09-14T16:39:44.563707] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-09-14T16:39:44.664031] [DEBUG] [LOCAL ] ADC: Primary data saved (35023 records). [2025-09-14T16:39:44.664216] [INFO ] [MAIN ] ADC: Full history saved. [2025-09-14T16:39:44.664338] [INFO ] [MAIN ] Update Progress: 32/2370 symbols completed. ADC took 29.5s. Estimated remaining: 3h 6m 17s. Rate: 12.6 symbols/min [2025-09-14T16:39:44.836246] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:39:44.879303] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-14T16:39:44.908125] [DEBUG] [LOCAL ] AEE: Loaded 22433 existing records from primary storage. [2025-09-14T16:39:44.908341] [INFO ] [MAIN ] AEE: Loaded 22433 existing records. [2025-09-14T16:39:45.083506] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:39:45.083807] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-09-14T16:39:45.083867] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-14T16:39:45.084474] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-09-14T16:39:45.084978] [DEBUG] [LOCAL ] AEE: Removed from QA tracker. [2025-09-14T16:39:45.085039] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-09-14T16:39:45.363978] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-09-14T16:39:45.433992] [INFO ] [REMOTE ] AEE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:39:45.911914] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-14T16:39:46.158847] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-09-14T16:39:46.958865] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-09-14T16:39:47.000476] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T16:39:47.759162] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-14T16:39:47.759373] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-09-14T16:39:48.389961] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T16:39:48.558901] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-09-14T16:39:49.358890] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-09-14T16:39:49.433318] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-14T16:39:50.161274] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-09-14T16:39:50.164676] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T16:39:50.958890] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-09-14T16:39:51.098162] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-14T16:39:51.229452] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T16:39:51.758890] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-09-14T16:39:52.558903] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-09-14T16:39:52.788931] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T16:39:53.061389] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-14T16:39:53.358886] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-09-14T16:39:54.012409] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T16:39:54.017171] [INFO ] [REMOTE ] ADNT: Full fetch complete (51532 records). [2025-09-14T16:39:54.017296] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-09-14T16:39:54.167616] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-09-14T16:39:54.404345] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-09-14T16:39:54.404719] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-09-14T16:39:54.405308] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-09-14T16:39:54.405457] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-09-14T16:39:54.407038] [DEBUG] [LOCAL ] ADNT: Trimmed 51532 records to 35484 (keeping 150 days of data) [2025-09-14T16:39:54.536600] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-14T16:39:54.657766] [DEBUG] [LOCAL ] ADNT: Primary data saved (35484 records). [2025-09-14T16:39:54.657942] [INFO ] [MAIN ] ADNT: Full history saved. [2025-09-14T16:39:54.658044] [INFO ] [MAIN ] Update Progress: 33/2370 symbols completed. ADNT took 20.3s. Estimated remaining: 3h 12m 21s. Rate: 12.1 symbols/min [2025-09-14T16:39:54.829280] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:39:54.834168] [DEBUG] [LOCAL ] AEFC: Loaded 3302 existing records from primary storage. [2025-09-14T16:39:54.834264] [INFO ] [MAIN ] AEFC: Loaded 3302 existing records. [2025-09-14T16:39:54.975080] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-09-14T16:39:55.014030] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:39:55.014480] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-09-14T16:39:55.014556] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-09-14T16:39:55.014873] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-09-14T16:39:55.015489] [DEBUG] [LOCAL ] AEFC: Removed from QA tracker. [2025-09-14T16:39:55.015550] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-09-14T16:39:55.362531] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:39:55.758841] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-09-14T16:39:56.133283] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-14T16:39:56.211701] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-14T16:39:56.529997] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T16:39:56.558863] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-09-14T16:39:57.358846] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-09-14T16:39:57.813566] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T16:39:58.158900] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-09-14T16:39:58.958879] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-09-14T16:39:59.243123] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T16:39:59.277044] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-14T16:39:59.758840] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-09-14T16:40:00.564615] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-09-14T16:40:00.565830] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T16:40:00.690570] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T16:40:01.358853] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-09-14T16:40:02.006543] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T16:40:02.158819] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-09-14T16:40:02.221103] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-14T16:40:02.958824] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-09-14T16:40:03.758848] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-09-14T16:40:04.035513] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-14T16:40:04.558794] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-09-14T16:40:04.745978] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T16:40:05.046250] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-14T16:40:05.358832] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-09-14T16:40:05.814773] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T16:40:06.158823] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-09-14T16:40:06.958831] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-09-14T16:40:07.006436] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-14T16:40:07.338683] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-14T16:40:07.758840] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-09-14T16:40:07.843211] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T16:40:07.847945] [INFO ] [REMOTE ] ADX: Full fetch complete (30809 records). [2025-09-14T16:40:07.848151] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-09-14T16:40:08.242000] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-09-14T16:40:08.242111] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-09-14T16:40:08.242466] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-09-14T16:40:08.242519] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-09-14T16:40:08.243353] [DEBUG] [LOCAL ] ADX: Trimmed 30809 records to 20648 (keeping 150 days of data) [2025-09-14T16:40:08.372768] [DEBUG] [LOCAL ] ADX: Primary data saved (20648 records). [2025-09-14T16:40:08.372933] [INFO ] [MAIN ] ADX: Full history saved. [2025-09-14T16:40:08.373059] [INFO ] [MAIN ] Update Progress: 34/2370 symbols completed. ADX took 25.8s. Estimated remaining: 3h 22m 19s. Rate: 11.5 symbols/min [2025-09-14T16:40:08.541762] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:40:08.564046] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-09-14T16:40:08.566568] [DEBUG] [LOCAL ] AEG: Loaded 21976 existing records from primary storage. [2025-09-14T16:40:08.566864] [INFO ] [MAIN ] AEG: Loaded 21976 existing records. [2025-09-14T16:40:08.744418] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:40:08.744690] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-09-14T16:40:08.744755] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-14T16:40:08.745383] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-09-14T16:40:08.745977] [DEBUG] [LOCAL ] AEG: Removed from QA tracker. [2025-09-14T16:40:08.746042] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-09-14T16:40:09.101848] [INFO ] [REMOTE ] AEG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:40:09.355931] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-14T16:40:09.360925] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-09-14T16:40:09.362551] [INFO ] [REMOTE ] ADT: Full fetch complete (58058 records). [2025-09-14T16:40:09.362667] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-09-14T16:40:09.740658] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-09-14T16:40:09.740769] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-09-14T16:40:09.741339] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-09-14T16:40:09.741397] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-09-14T16:40:09.742610] [DEBUG] [LOCAL ] ADT: Trimmed 58058 records to 40255 (keeping 150 days of data) [2025-09-14T16:40:09.992126] [DEBUG] [LOCAL ] ADT: Primary data saved (40255 records). [2025-09-14T16:40:09.992287] [INFO ] [MAIN ] ADT: Full history saved. [2025-09-14T16:40:09.992385] [INFO ] [MAIN ] Update Progress: 35/2370 symbols completed. ADT took 33.1s. Estimated remaining: 3h 18m 15s. Rate: 11.8 symbols/min [2025-09-14T16:40:10.137552] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-14T16:40:10.162886] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-09-14T16:40:10.188705] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:40:10.215320] [DEBUG] [LOCAL ] AEM: Loaded 23918 existing records from primary storage. [2025-09-14T16:40:10.215495] [INFO ] [MAIN ] AEM: Loaded 23918 existing records. [2025-09-14T16:40:10.405697] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:40:10.422700] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-09-14T16:40:10.423388] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-14T16:40:10.424534] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T16:40:10.436435] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-09-14T16:40:10.437141] [DEBUG] [LOCAL ] AEM: Removed from QA tracker. [2025-09-14T16:40:10.437209] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-09-14T16:40:10.841398] [INFO ] [REMOTE ] AEM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:40:10.958824] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-09-14T16:40:11.480307] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T16:40:11.486835] [INFO ] [REMOTE ] AEE: Full fetch complete (54975 records). [2025-09-14T16:40:11.487140] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-09-14T16:40:11.821160] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-09-14T16:40:12.044567] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T16:40:12.214449] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-09-14T16:40:12.214632] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-09-14T16:40:12.216788] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-09-14T16:40:12.216959] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-09-14T16:40:12.219237] [DEBUG] [LOCAL ] AEE: Trimmed 54975 records to 37637 (keeping 150 days of data) [2025-09-14T16:40:12.497805] [DEBUG] [LOCAL ] AEE: Primary data saved (37637 records). [2025-09-14T16:40:12.498008] [INFO ] [MAIN ] AEE: Full history saved. [2025-09-14T16:40:12.498115] [INFO ] [MAIN ] Update Progress: 36/2370 symbols completed. AEE took 27.8s. Estimated remaining: 3h 15m 22s. Rate: 11.9 symbols/min [2025-09-14T16:40:12.568577] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-09-14T16:40:12.690399] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:40:12.716600] [DEBUG] [LOCAL ] AEO: Loaded 24035 existing records from primary storage. [2025-09-14T16:40:12.716812] [INFO ] [MAIN ] AEO: Loaded 24035 existing records. [2025-09-14T16:40:12.899372] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:40:12.899683] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-09-14T16:40:12.899748] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-09-14T16:40:12.900508] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-09-14T16:40:12.901045] [DEBUG] [LOCAL ] AEO: Removed from QA tracker. [2025-09-14T16:40:12.901107] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-09-14T16:40:13.260183] [INFO ] [REMOTE ] AEO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:40:13.358846] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-09-14T16:40:13.453847] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-14T16:40:13.506968] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T16:40:14.158836] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-09-14T16:40:14.958877] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-09-14T16:40:15.134356] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T16:40:15.758893] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-09-14T16:40:15.938055] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-14T16:40:16.558836] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-09-14T16:40:16.676455] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T16:40:17.358822] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-09-14T16:40:17.669798] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T16:40:17.810815] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-14T16:40:17.812292] [INFO ] [REMOTE ] AEFC: Full fetch complete (9422 records). [2025-09-14T16:40:17.812397] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-09-14T16:40:18.159682] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-09-14T16:40:18.182663] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-09-14T16:40:18.182782] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-09-14T16:40:18.182999] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-09-14T16:40:18.183045] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-09-14T16:40:18.183492] [DEBUG] [LOCAL ] AEFC: Trimmed 9422 records to 5954 (keeping 150 days of data) [2025-09-14T16:40:18.222160] [DEBUG] [LOCAL ] AEFC: Primary data saved (5954 records). [2025-09-14T16:40:18.222339] [INFO ] [MAIN ] AEFC: Full history saved. [2025-09-14T16:40:18.222446] [INFO ] [MAIN ] Update Progress: 37/2370 symbols completed. AEFC took 23.6s. Estimated remaining: 3h 16m 2s. Rate: 11.9 symbols/min [2025-09-14T16:40:18.401882] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T16:40:18.958891] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-09-14T16:40:19.758902] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-09-14T16:40:20.062856] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-14T16:40:20.485846] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-14T16:40:20.558776] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-09-14T16:40:21.225626] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T16:40:21.358831] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-09-14T16:40:22.158802] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-09-14T16:40:22.241307] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-14T16:40:22.958884] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-09-14T16:40:23.144119] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T16:40:23.758860] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-09-14T16:40:24.343258] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-14T16:40:24.558794] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-09-14T16:40:24.641571] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-14T16:40:25.199627] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T16:40:25.358851] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-09-14T16:40:26.158854] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-09-14T16:40:26.550711] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-14T16:40:26.958869] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-09-14T16:40:27.066715] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T16:40:27.758842] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-09-14T16:40:28.330233] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-14T16:40:28.558844] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-09-14T16:40:28.654253] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-14T16:40:28.879717] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-14T16:40:28.884875] [INFO ] [REMOTE ] AEG: Full fetch complete (53612 records). [2025-09-14T16:40:28.885002] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-09-14T16:40:29.297037] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-09-14T16:40:29.297201] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-09-14T16:40:29.297954] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-09-14T16:40:29.298033] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-09-14T16:40:29.299953] [DEBUG] [LOCAL ] AEG: Trimmed 53612 records to 37400 (keeping 150 days of data) [2025-09-14T16:40:29.363829] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-09-14T16:40:29.537791] [DEBUG] [LOCAL ] AEG: Primary data saved (37400 records). [2025-09-14T16:40:29.538056] [INFO ] [MAIN ] AEG: Full history saved. [2025-09-14T16:40:29.538191] [INFO ] [MAIN ] Update Progress: 38/2370 symbols completed. AEG took 21.2s. Estimated remaining: 3h 22m 22s. Rate: 11.5 symbols/min [2025-09-14T16:40:30.824889] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-14T16:40:30.836754] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-09-14T16:40:31.372564] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T16:40:31.378160] [INFO ] [REMOTE ] AEO: Full fetch complete (58193 records). [2025-09-14T16:40:31.378320] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-09-14T16:40:31.802114] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-09-14T16:40:31.802284] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-09-14T16:40:31.803526] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-09-14T16:40:31.804682] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-14T16:40:31.804825] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-09-14T16:40:31.816899] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-09-14T16:40:31.818522] [DEBUG] [LOCAL ] AEO: Trimmed 58193 records to 40310 (keeping 150 days of data) [2025-09-14T16:40:32.062626] [DEBUG] [LOCAL ] AEO: Primary data saved (40310 records). [2025-09-14T16:40:32.062815] [INFO ] [MAIN ] AEO: Full history saved. [2025-09-14T16:40:32.062921] [INFO ] [MAIN ] Update Progress: 39/2370 symbols completed. AEO took 19.6s. Estimated remaining: 3h 19m 36s. Rate: 11.7 symbols/min [2025-09-14T16:40:33.649550] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-14T16:40:33.655453] [INFO ] [REMOTE ] AEM: Full fetch complete (58133 records). [2025-09-14T16:40:33.655670] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-09-14T16:40:34.040406] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-09-14T16:40:34.040521] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-09-14T16:40:34.041164] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-09-14T16:40:34.041230] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-09-14T16:40:34.042618] [DEBUG] [LOCAL ] AEM: Trimmed 58133 records to 40246 (keeping 150 days of data) [2025-09-14T16:40:34.322271] [DEBUG] [LOCAL ] AEM: Primary data saved (40246 records). [2025-09-14T16:40:34.322469] [INFO ] [MAIN ] AEM: Full history saved. [2025-09-14T16:40:34.322600] [INFO ] [MAIN ] Update Progress: 40/2370 symbols completed. AEM took 24.3s. Estimated remaining: 3h 16m 43s. Rate: 11.8 symbols/min [2025-09-14T16:40:34.945617] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:40:35.010511] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:40:35.055019] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:40:35.052181] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:40:35.065714] [DEBUG] [LOCAL ] AFB: Loaded 4658 existing records from primary storage. [2025-09-14T16:40:35.066095] [INFO ] [MAIN ] AFB: Loaded 4658 existing records. [2025-09-14T16:40:35.208447] [DEBUG] [LOCAL ] AER: Loaded 21504 existing records from primary storage. [2025-09-14T16:40:35.232119] [DEBUG] [LOCAL ] AESI: Loaded 21926 existing records from primary storage. [2025-09-14T16:40:35.242612] [INFO ] [MAIN ] AER: Loaded 21504 existing records. [2025-09-14T16:40:35.256971] [INFO ] [MAIN ] AESI: Loaded 21926 existing records. [2025-09-14T16:40:35.321054] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:40:35.300900] [DEBUG] [LOCAL ] AES: Loaded 24036 existing records from primary storage. [2025-09-14T16:40:35.385385] [INFO ] [MAIN ] AES: Loaded 24036 existing records. [2025-09-14T16:40:35.404997] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-09-14T16:40:35.575512] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-09-14T16:40:35.606283] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-09-14T16:40:35.765729] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:40:35.799065] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:40:35.815462] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-09-14T16:40:35.799110] [DEBUG] [LOCAL ] AFB: Removed from QA tracker. [2025-09-14T16:40:35.831500] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-09-14T16:40:35.836175] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:40:35.836032] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-14T16:40:35.836705] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-09-14T16:40:35.836395] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-14T16:40:35.836426] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-09-14T16:40:35.836924] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-09-14T16:40:35.865377] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-09-14T16:40:35.870795] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-09-14T16:40:35.879222] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-09-14T16:40:35.931499] [DEBUG] [LOCAL ] AESI: Removed from QA tracker. [2025-09-14T16:40:35.940659] [DEBUG] [LOCAL ] AER: Removed from QA tracker. [2025-09-14T16:40:35.951961] [DEBUG] [LOCAL ] AES: Removed from QA tracker. [2025-09-14T16:40:35.940889] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-09-14T16:40:35.952066] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-09-14T16:40:35.952312] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-09-14T16:40:36.867406] [INFO ] [REMOTE ] AFB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:40:36.970850] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-09-14T16:40:37.179498] [INFO ] [REMOTE ] AESI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:40:37.198782] [INFO ] [REMOTE ] AER: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:40:37.204601] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-09-14T16:40:37.210055] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-09-14T16:40:37.281877] [INFO ] [REMOTE ] AES: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:40:37.282178] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-09-14T16:40:37.919751] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-14T16:40:37.922527] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-09-14T16:40:38.643285] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T16:40:38.653406] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-09-14T16:40:38.967412] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-14T16:40:38.970813] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-09-14T16:40:39.018129] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T16:40:39.031804] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-09-14T16:40:39.158013] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T16:40:39.168450] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-09-14T16:40:39.764027] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-14T16:40:39.771860] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-09-14T16:40:40.163680] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T16:40:40.174671] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-09-14T16:40:40.396246] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-14T16:40:40.558875] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-09-14T16:40:40.623722] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-14T16:40:40.775322] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T16:40:41.358829] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-09-14T16:40:41.957359] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-14T16:40:42.158900] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-09-14T16:40:42.541907] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T16:40:42.958883] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-09-14T16:40:43.098506] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-14T16:40:43.758839] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-09-14T16:40:43.969572] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T16:40:44.558867] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-09-14T16:40:44.817972] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T16:40:45.358894] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-09-14T16:40:45.449694] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-14T16:40:46.158841] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-09-14T16:40:46.217945] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T16:40:46.925514] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T16:40:46.958781] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-09-14T16:40:47.758852] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-09-14T16:40:47.941012] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T16:40:48.558879] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-09-14T16:40:48.754780] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-14T16:40:49.358847] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-09-14T16:40:49.561271] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-14T16:40:49.925541] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-14T16:40:50.158863] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-09-14T16:40:50.790764] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-14T16:40:50.958809] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-09-14T16:40:51.758836] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-09-14T16:40:51.941144] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-14T16:40:52.463749] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-14T16:40:52.558851] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-09-14T16:40:52.951063] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-14T16:40:53.358849] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-09-14T16:40:54.158795] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-09-14T16:40:54.174172] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T16:40:54.238097] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-14T16:40:54.803623] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T16:40:54.809204] [INFO ] [REMOTE ] AES: Full fetch complete (58353 records). [2025-09-14T16:40:54.809345] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-09-14T16:40:54.963925] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-09-14T16:40:55.195907] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-09-14T16:40:55.196016] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-09-14T16:40:55.196622] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-09-14T16:40:55.196714] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-09-14T16:40:55.198158] [DEBUG] [LOCAL ] AES: Trimmed 58353 records to 40415 (keeping 150 days of data) [2025-09-14T16:40:55.447690] [DEBUG] [LOCAL ] AES: Primary data saved (40415 records). [2025-09-14T16:40:55.447848] [INFO ] [MAIN ] AES: Full history saved. [2025-09-14T16:40:55.447952] [INFO ] [MAIN ] Update Progress: 41/2370 symbols completed. AES took 21.1s. Estimated remaining: 3h 31m 51s. Rate: 11.0 symbols/min [2025-09-14T16:40:55.622243] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:40:55.639163] [DEBUG] [LOCAL ] AFG: Loaded 14359 existing records from primary storage. [2025-09-14T16:40:55.639346] [INFO ] [MAIN ] AFG: Loaded 14359 existing records. [2025-09-14T16:40:55.763918] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-09-14T16:40:55.828737] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:40:55.829088] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-09-14T16:40:55.834430] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-09-14T16:40:55.835172] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T16:40:55.837410] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-09-14T16:40:55.837725] [INFO ] [REMOTE ] AFB: Full fetch complete (12388 records). [2025-09-14T16:40:55.837931] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-09-14T16:40:55.838394] [DEBUG] [LOCAL ] AFG: Removed from QA tracker. [2025-09-14T16:40:55.843937] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-09-14T16:40:56.592033] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-09-14T16:40:56.622125] [INFO ] [REMOTE ] AFG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:40:56.622379] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-09-14T16:40:56.623084] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-09-14T16:40:56.623196] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-09-14T16:40:56.591830] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-09-14T16:40:56.623924] [DEBUG] [LOCAL ] AFB: Trimmed 12388 records to 8175 (keeping 150 days of data) [2025-09-14T16:40:56.679551] [DEBUG] [LOCAL ] AFB: Primary data saved (8175 records). [2025-09-14T16:40:56.679768] [INFO ] [MAIN ] AFB: Full history saved. [2025-09-14T16:40:56.679933] [INFO ] [MAIN ] Update Progress: 42/2370 symbols completed. AFB took 22.4s. Estimated remaining: 3h 27m 51s. Rate: 11.2 symbols/min [2025-09-14T16:40:56.866100] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:40:56.869061] [DEBUG] [LOCAL ] AFGB: Loaded 928 existing records from primary storage. [2025-09-14T16:40:56.869156] [INFO ] [MAIN ] AFGB: Loaded 928 existing records. [2025-09-14T16:40:57.052418] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:40:57.052718] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-09-14T16:40:57.052794] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-14T16:40:57.053050] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-09-14T16:40:57.053582] [DEBUG] [LOCAL ] AFGB: Removed from QA tracker. [2025-09-14T16:40:57.053710] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-09-14T16:40:57.360621] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-09-14T16:40:57.428776] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:40:57.444571] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-14T16:40:57.450330] [INFO ] [REMOTE ] AESI: Full fetch complete (53869 records). [2025-09-14T16:40:57.450670] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-09-14T16:40:57.567384] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-14T16:40:57.621788] [INFO ] [REMOTE ] AER: Full fetch complete (53141 records). [2025-09-14T16:40:57.659599] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-09-14T16:40:58.012894] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-09-14T16:40:58.034092] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-09-14T16:40:58.034767] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-09-14T16:40:58.072695] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-09-14T16:40:58.163945] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-09-14T16:40:58.169306] [DEBUG] [LOCAL ] AESI: Trimmed 53869 records to 37122 (keeping 150 days of data) [2025-09-14T16:40:58.303127] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-09-14T16:40:58.303273] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-09-14T16:40:58.303900] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-09-14T16:40:58.312165] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-09-14T16:40:58.343741] [DEBUG] [LOCAL ] AER: Trimmed 53141 records to 36323 (keeping 150 days of data) [2025-09-14T16:40:58.610905] [DEBUG] [LOCAL ] AESI: Primary data saved (37122 records). [2025-09-14T16:40:58.612278] [INFO ] [MAIN ] AESI: Full history saved. [2025-09-14T16:40:58.613368] [INFO ] [MAIN ] Update Progress: 43/2370 symbols completed. AESI took 24.3s. Estimated remaining: 3h 24m 40s. Rate: 11.4 symbols/min [2025-09-14T16:40:58.770128] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-14T16:40:58.859882] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-14T16:40:58.959308] [DEBUG] [LOCAL ] AER: Primary data saved (36323 records). [2025-09-14T16:40:58.959066] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-09-14T16:40:58.980940] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:40:58.983248] [INFO ] [MAIN ] AER: Full history saved. [2025-09-14T16:40:58.984135] [INFO ] [MAIN ] Update Progress: 44/2370 symbols completed. AER took 24.7s. Estimated remaining: 3h 20m 16s. Rate: 11.6 symbols/min [2025-09-14T16:40:59.094367] [DEBUG] [LOCAL ] AFGC: Loaded 1425 existing records from primary storage. [2025-09-14T16:40:59.097127] [INFO ] [MAIN ] AFGC: Loaded 1425 existing records. [2025-09-14T16:40:59.297256] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:40:59.363274] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:40:59.366084] [DEBUG] [LOCAL ] AFGD: Loaded 700 existing records from primary storage. [2025-09-14T16:40:59.366342] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-09-14T16:40:59.366545] [INFO ] [MAIN ] AFGD: Loaded 700 existing records. [2025-09-14T16:40:59.371803] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-14T16:40:59.439688] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-09-14T16:40:59.479578] [DEBUG] [LOCAL ] AFGC: Removed from QA tracker. [2025-09-14T16:40:59.494759] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-09-14T16:40:59.500130] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-14T16:40:59.636281] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:40:59.665260] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-09-14T16:40:59.670997] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-14T16:40:59.721918] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-09-14T16:40:59.767973] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-09-14T16:40:59.825327] [DEBUG] [LOCAL ] AFGD: Removed from QA tracker. [2025-09-14T16:40:59.830631] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-09-14T16:41:00.084039] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:41:00.366229] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:41:00.558838] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-09-14T16:41:01.358851] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-09-14T16:41:01.372490] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-14T16:41:01.485907] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T16:41:02.064673] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-14T16:41:02.158807] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-09-14T16:41:02.685076] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-14T16:41:02.958843] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-09-14T16:41:03.340213] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-14T16:41:03.758843] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-09-14T16:41:04.264237] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-14T16:41:04.558930] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-09-14T16:41:05.094065] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-14T16:41:05.358823] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-09-14T16:41:05.782532] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-14T16:41:06.158815] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-09-14T16:41:06.657183] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-14T16:41:06.958839] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-09-14T16:41:07.373900] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-14T16:41:07.758828] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-09-14T16:41:08.558895] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-09-14T16:41:08.924865] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-14T16:41:09.231558] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-14T16:41:09.358846] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-09-14T16:41:10.158839] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-09-14T16:41:10.567723] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-14T16:41:10.824505] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T16:41:10.958836] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-09-14T16:41:11.483335] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-14T16:41:11.758874] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-09-14T16:41:12.274231] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T16:41:12.275152] [INFO ] [REMOTE ] AFGD: Full fetch complete (2037 records). [2025-09-14T16:41:12.275261] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-09-14T16:41:12.563984] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-09-14T16:41:12.630856] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-09-14T16:41:12.630950] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-09-14T16:41:12.631059] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-09-14T16:41:12.631111] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-09-14T16:41:12.631476] [DEBUG] [LOCAL ] AFGD: Trimmed 2037 records to 1355 (keeping 150 days of data) [2025-09-14T16:41:12.641068] [DEBUG] [LOCAL ] AFGD: Primary data saved (1355 records). [2025-09-14T16:41:12.641149] [INFO ] [MAIN ] AFGD: Full history saved. [2025-09-14T16:41:12.641241] [INFO ] [MAIN ] Update Progress: 45/2370 symbols completed. AFGD took 13.7s. Estimated remaining: 3h 27m 29s. Rate: 11.2 symbols/min [2025-09-14T16:41:12.809676] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:41:12.812822] [DEBUG] [LOCAL ] AFGE: Loaded 1199 existing records from primary storage. [2025-09-14T16:41:12.812912] [INFO ] [MAIN ] AFGE: Loaded 1199 existing records. [2025-09-14T16:41:12.986469] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:41:12.986770] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-09-14T16:41:12.986831] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-14T16:41:12.987141] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-09-14T16:41:12.988539] [DEBUG] [LOCAL ] AFGE: Removed from QA tracker. [2025-09-14T16:41:12.988610] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-09-14T16:41:13.220460] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-14T16:41:13.355426] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:41:13.358793] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-09-14T16:41:14.158848] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-09-14T16:41:14.690110] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-14T16:41:14.896612] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-14T16:41:14.958865] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-09-14T16:41:15.445880] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-14T16:41:15.758877] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-09-14T16:41:16.145031] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-14T16:41:16.558832] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-09-14T16:41:17.068045] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-14T16:41:17.358854] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-09-14T16:41:17.874500] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-14T16:41:18.158825] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-09-14T16:41:18.606150] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-14T16:41:18.958826] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-09-14T16:41:19.447479] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-14T16:41:19.758850] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-09-14T16:41:20.402867] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-14T16:41:20.558857] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-09-14T16:41:21.064399] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-14T16:41:21.358885] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-09-14T16:41:21.971077] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-14T16:41:22.158822] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-09-14T16:41:22.629180] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T16:41:22.630118] [INFO ] [REMOTE ] AFGC: Full fetch complete (2701 records). [2025-09-14T16:41:22.630204] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-09-14T16:41:22.964710] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-09-14T16:41:22.994357] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-09-14T16:41:22.994475] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-09-14T16:41:22.994604] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-09-14T16:41:22.994727] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-09-14T16:41:22.995095] [DEBUG] [LOCAL ] AFGC: Trimmed 2701 records to 2041 (keeping 150 days of data) [2025-09-14T16:41:23.009223] [DEBUG] [LOCAL ] AFGC: Primary data saved (2041 records). [2025-09-14T16:41:23.009307] [INFO ] [MAIN ] AFGC: Full history saved. [2025-09-14T16:41:23.009392] [INFO ] [MAIN ] Update Progress: 46/2370 symbols completed. AFGC took 24.4s. Estimated remaining: 3h 31m 37s. Rate: 11.0 symbols/min [2025-09-14T16:41:23.181917] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:41:23.208052] [DEBUG] [LOCAL ] AFL: Loaded 23755 existing records from primary storage. [2025-09-14T16:41:23.208227] [INFO ] [MAIN ] AFL: Loaded 23755 existing records. [2025-09-14T16:41:23.382773] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:41:23.383072] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-09-14T16:41:23.383131] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-14T16:41:23.383878] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-09-14T16:41:23.384376] [DEBUG] [LOCAL ] AFL: Removed from QA tracker. [2025-09-14T16:41:23.384436] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-09-14T16:41:23.740014] [INFO ] [REMOTE ] AFL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:41:23.758835] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-09-14T16:41:24.149696] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-14T16:41:24.558844] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-09-14T16:41:25.007328] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-14T16:41:25.008228] [INFO ] [REMOTE ] AFGB: Full fetch complete (2656 records). [2025-09-14T16:41:25.008322] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-09-14T16:41:25.368337] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-09-14T16:41:25.375323] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-09-14T16:41:25.376615] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-09-14T16:41:25.376895] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-09-14T16:41:25.377005] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-09-14T16:41:25.377744] [DEBUG] [LOCAL ] AFGB: Trimmed 2656 records to 1672 (keeping 150 days of data) [2025-09-14T16:41:25.390543] [DEBUG] [LOCAL ] AFGB: Primary data saved (1672 records). [2025-09-14T16:41:25.390693] [INFO ] [MAIN ] AFGB: Full history saved. [2025-09-14T16:41:25.390823] [INFO ] [MAIN ] Update Progress: 47/2370 symbols completed. AFGB took 28.7s. Estimated remaining: 3h 28m 59s. Rate: 11.1 symbols/min [2025-09-14T16:41:25.569778] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T16:41:25.606359] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:41:25.619370] [DEBUG] [LOCAL ] AG: Loaded 6234 existing records from primary storage. [2025-09-14T16:41:25.619529] [INFO ] [MAIN ] AG: Loaded 6234 existing records. [2025-09-14T16:41:25.799009] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-08-21, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:41:25.799312] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-09-14T16:41:25.799376] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-14T16:41:25.799744] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-09-14T16:41:25.800249] [DEBUG] [LOCAL ] AG: Removed from QA tracker. [2025-09-14T16:41:25.800317] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-09-14T16:41:26.152364] [INFO ] [REMOTE ] AG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:41:26.158778] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-09-14T16:41:26.783952] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-14T16:41:26.958837] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-09-14T16:41:27.562615] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T16:41:27.566111] [INFO ] [REMOTE ] AFG: Full fetch complete (35773 records). [2025-09-14T16:41:27.566240] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-09-14T16:41:27.760681] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-09-14T16:41:27.950530] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-09-14T16:41:27.950675] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-09-14T16:41:27.951189] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-09-14T16:41:27.951269] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-09-14T16:41:27.952516] [DEBUG] [LOCAL ] AFG: Trimmed 35773 records to 23793 (keeping 150 days of data) [2025-09-14T16:41:28.109038] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T16:41:28.174907] [DEBUG] [LOCAL ] AFG: Primary data saved (23793 records). [2025-09-14T16:41:28.175200] [INFO ] [MAIN ] AFG: Full history saved. [2025-09-14T16:41:28.175430] [INFO ] [MAIN ] Update Progress: 48/2370 symbols completed. AFG took 32.7s. Estimated remaining: 3h 26m 48s. Rate: 11.2 symbols/min [2025-09-14T16:41:28.364089] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:41:28.372274] [DEBUG] [LOCAL ] AGCO: Loaded 4654 existing records from primary storage. [2025-09-14T16:41:28.372475] [INFO ] [MAIN ] AGCO: Loaded 4654 existing records. [2025-09-14T16:41:28.557924] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-08-21, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:41:28.558256] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-09-14T16:41:28.558362] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-09-14T16:41:28.558821] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-09-14T16:41:28.558716] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-09-14T16:41:28.560835] [DEBUG] [LOCAL ] AGCO: Removed from QA tracker. [2025-09-14T16:41:28.560910] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-09-14T16:41:28.927825] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:41:28.967978] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-14T16:41:29.358870] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-09-14T16:41:29.526730] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T16:41:29.903804] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-14T16:41:30.158832] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-09-14T16:41:30.728044] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-14T16:41:30.958857] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-09-14T16:41:31.758878] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-09-14T16:41:32.558884] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-09-14T16:41:32.986361] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T16:41:32.987270] [INFO ] [REMOTE ] AFGE: Full fetch complete (2650 records). [2025-09-14T16:41:32.987380] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-09-14T16:41:33.361489] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-09-14T16:41:33.407876] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-09-14T16:41:33.397409] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-14T16:41:33.420679] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-09-14T16:41:33.422545] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-09-14T16:41:33.422864] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-09-14T16:41:33.424314] [DEBUG] [LOCAL ] AFGE: Trimmed 2650 records to 1893 (keeping 150 days of data) [2025-09-14T16:41:33.437938] [DEBUG] [LOCAL ] AFGE: Primary data saved (1893 records). [2025-09-14T16:41:33.438463] [INFO ] [MAIN ] AFGE: Full history saved. [2025-09-14T16:41:33.438614] [INFO ] [MAIN ] Update Progress: 49/2370 symbols completed. AFGE took 20.8s. Estimated remaining: 3h 26m 38s. Rate: 11.2 symbols/min [2025-09-14T16:41:33.588087] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-14T16:41:33.667577] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:41:33.672941] [DEBUG] [LOCAL ] AGD: Loaded 2313 existing records from primary storage. [2025-09-14T16:41:33.673128] [INFO ] [MAIN ] AGD: Loaded 2313 existing records. [2025-09-14T16:41:33.858923] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-08-21, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:41:33.859247] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-09-14T16:41:33.859312] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-09-14T16:41:33.859697] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-09-14T16:41:33.860211] [DEBUG] [LOCAL ] AGD: Removed from QA tracker. [2025-09-14T16:41:33.860275] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-09-14T16:41:34.163944] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-09-14T16:41:34.219986] [INFO ] [REMOTE ] AGD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:41:34.958813] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-09-14T16:41:35.307063] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T16:41:35.758921] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-09-14T16:41:35.958893] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T16:41:36.418787] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-14T16:41:36.558853] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-09-14T16:41:36.752198] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T16:41:37.358866] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-09-14T16:41:37.469232] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-14T16:41:38.158869] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-09-14T16:41:38.912169] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T16:41:38.958838] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-09-14T16:41:39.758809] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-09-14T16:41:40.283490] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-14T16:41:40.383825] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T16:41:40.558799] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-09-14T16:41:40.771720] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-14T16:41:41.358836] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-09-14T16:41:42.158820] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-09-14T16:41:42.357918] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-14T16:41:42.958880] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-09-14T16:41:43.141619] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-14T16:41:43.758888] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-09-14T16:41:44.028836] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-14T16:41:44.094151] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-14T16:41:44.558950] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-09-14T16:41:45.358983] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-09-14T16:41:45.485031] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T16:41:45.689768] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-14T16:41:46.158861] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-09-14T16:41:46.958957] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-09-14T16:41:47.169039] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T16:41:47.609441] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-14T16:41:47.758829] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-09-14T16:41:48.213522] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-14T16:41:48.558841] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-09-14T16:41:48.864313] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-14T16:41:49.358841] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-09-14T16:41:50.158831] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-09-14T16:41:50.302086] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-14T16:41:50.304517] [INFO ] [REMOTE ] AGD: Full fetch complete (18500 records). [2025-09-14T16:41:50.304609] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-09-14T16:41:50.674314] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-09-14T16:41:50.674544] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-09-14T16:41:50.675003] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-09-14T16:41:50.675099] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-09-14T16:41:50.676259] [DEBUG] [LOCAL ] AGD: Trimmed 18500 records to 13696 (keeping 150 days of data) [2025-09-14T16:41:50.777678] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-14T16:41:50.806572] [DEBUG] [LOCAL ] AGD: Primary data saved (13696 records). [2025-09-14T16:41:50.806808] [INFO ] [MAIN ] AGD: Full history saved. [2025-09-14T16:41:50.806932] [INFO ] [MAIN ] Update Progress: 50/2370 symbols completed. AGD took 17.4s. Estimated remaining: 3h 35m 51s. Rate: 10.7 symbols/min [2025-09-14T16:41:50.963882] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-09-14T16:41:50.981008] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:41:51.005858] [DEBUG] [LOCAL ] AGI: Loaded 23883 existing records from primary storage. [2025-09-14T16:41:51.006031] [INFO ] [MAIN ] AGI: Loaded 23883 existing records. [2025-09-14T16:41:51.198065] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:41:51.198342] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-09-14T16:41:51.198429] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-09-14T16:41:51.199130] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-09-14T16:41:51.200432] [DEBUG] [LOCAL ] AGI: Removed from QA tracker. [2025-09-14T16:41:51.200495] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-09-14T16:41:51.587714] [INFO ] [REMOTE ] AGI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:41:51.705371] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-14T16:41:51.758779] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-09-14T16:41:52.104557] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-14T16:41:52.110611] [INFO ] [REMOTE ] AFL: Full fetch complete (57757 records). [2025-09-14T16:41:52.110789] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-09-14T16:41:52.507735] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-09-14T16:41:52.507928] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-09-14T16:41:52.508577] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-09-14T16:41:52.508716] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-09-14T16:41:52.510271] [DEBUG] [LOCAL ] AFL: Trimmed 57757 records to 39995 (keeping 150 days of data) [2025-09-14T16:41:52.571009] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-09-14T16:41:52.654358] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T16:41:52.821637] [DEBUG] [LOCAL ] AFL: Primary data saved (39995 records). [2025-09-14T16:41:52.821969] [INFO ] [MAIN ] AFL: Full history saved. [2025-09-14T16:41:52.822081] [INFO ] [MAIN ] Update Progress: 51/2370 symbols completed. AFL took 29.8s. Estimated remaining: 3h 33m 3s. Rate: 10.9 symbols/min [2025-09-14T16:41:52.991988] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:41:53.014780] [DEBUG] [LOCAL ] AGL: Loaded 23346 existing records from primary storage. [2025-09-14T16:41:53.014951] [INFO ] [MAIN ] AGL: Loaded 23346 existing records. [2025-09-14T16:41:53.194130] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:41:53.194503] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-09-14T16:41:53.194574] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-09-14T16:41:53.195407] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-09-14T16:41:53.196190] [DEBUG] [LOCAL ] AGL: Removed from QA tracker. [2025-09-14T16:41:53.196258] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-09-14T16:41:53.371998] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-09-14T16:41:53.563936] [INFO ] [REMOTE ] AGL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:41:54.158817] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-09-14T16:41:54.380250] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T16:41:54.958863] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-09-14T16:41:55.108756] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-14T16:41:55.570266] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T16:41:55.758848] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-09-14T16:41:56.170452] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T16:41:56.174959] [INFO ] [REMOTE ] AGCO: Full fetch complete (46629 records). [2025-09-14T16:41:56.175074] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-09-14T16:41:56.558411] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-09-14T16:41:56.558601] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-09-14T16:41:56.559158] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-09-14T16:41:56.559213] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-09-14T16:41:56.559366] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-09-14T16:41:56.562590] [DEBUG] [LOCAL ] AGCO: Trimmed 46629 records to 31794 (keeping 150 days of data) [2025-09-14T16:41:56.832152] [DEBUG] [LOCAL ] AGCO: Primary data saved (31794 records). [2025-09-14T16:41:56.832396] [INFO ] [MAIN ] AGCO: Full history saved. [2025-09-14T16:41:56.832532] [INFO ] [MAIN ] Update Progress: 52/2370 symbols completed. AGCO took 28.7s. Estimated remaining: 3h 31m 51s. Rate: 10.9 symbols/min [2025-09-14T16:41:57.075577] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:41:57.140243] [DEBUG] [LOCAL ] AGM: Loaded 4970 existing records from primary storage. [2025-09-14T16:41:57.140469] [INFO ] [MAIN ] AGM: Loaded 4970 existing records. [2025-09-14T16:41:57.169496] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-14T16:41:57.364249] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-09-14T16:41:57.464837] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:41:57.465255] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-09-14T16:41:57.465335] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-09-14T16:41:57.466105] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-09-14T16:41:57.467131] [DEBUG] [LOCAL ] AGM: Removed from QA tracker. [2025-09-14T16:41:57.467227] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-09-14T16:41:57.900527] [INFO ] [REMOTE ] AGM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:41:58.158828] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-09-14T16:41:58.634220] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-14T16:41:58.640173] [INFO ] [REMOTE ] AG: Full fetch complete (58316 records). [2025-09-14T16:41:58.640353] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-09-14T16:41:58.959451] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-09-14T16:41:58.964833] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-14T16:41:59.047274] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-09-14T16:41:59.047380] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-09-14T16:41:59.048020] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-09-14T16:41:59.048085] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-09-14T16:41:59.049471] [DEBUG] [LOCAL ] AG: Trimmed 58316 records to 40385 (keeping 150 days of data) [2025-09-14T16:41:59.198865] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T16:41:59.341686] [DEBUG] [LOCAL ] AG: Primary data saved (40385 records). [2025-09-14T16:41:59.341851] [INFO ] [MAIN ] AG: Full history saved. [2025-09-14T16:41:59.341954] [INFO ] [MAIN ] Update Progress: 53/2370 symbols completed. AG took 34.0s. Estimated remaining: 3h 29m 35s. Rate: 11.1 symbols/min [2025-09-14T16:41:59.509345] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:41:59.522809] [DEBUG] [LOCAL ] AGO: Loaded 12293 existing records from primary storage. [2025-09-14T16:41:59.522971] [INFO ] [MAIN ] AGO: Loaded 12293 existing records. [2025-09-14T16:41:59.696920] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:41:59.697232] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-09-14T16:41:59.697294] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-09-14T16:41:59.697773] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-09-14T16:41:59.698252] [DEBUG] [LOCAL ] AGO: Removed from QA tracker. [2025-09-14T16:41:59.698318] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-09-14T16:41:59.764964] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-09-14T16:42:00.086780] [INFO ] [REMOTE ] AGO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:42:00.484060] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-14T16:42:00.558777] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-09-14T16:42:00.961603] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-14T16:42:01.358878] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-09-14T16:42:01.729860] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-14T16:42:01.930397] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-14T16:42:02.158821] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-09-14T16:42:02.958829] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-09-14T16:42:03.758837] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-09-14T16:42:03.993037] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-14T16:42:04.054114] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-14T16:42:04.558835] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-09-14T16:42:05.358782] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-09-14T16:42:05.667476] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-14T16:42:05.800466] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-14T16:42:05.929981] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-14T16:42:06.158815] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-09-14T16:42:06.958832] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-09-14T16:42:07.758832] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-09-14T16:42:08.098079] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-14T16:42:08.558798] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-09-14T16:42:08.688794] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T16:42:08.860970] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-14T16:42:09.358831] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-09-14T16:42:10.158826] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-09-14T16:42:10.339521] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-14T16:42:10.436717] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T16:42:10.958922] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-09-14T16:42:11.047067] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-14T16:42:11.758890] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-09-14T16:42:12.348405] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T16:42:12.558856] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-09-14T16:42:13.346997] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-14T16:42:13.358935] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-09-14T16:42:13.423628] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-14T16:42:14.158833] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-09-14T16:42:14.463492] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-14T16:42:14.958870] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-09-14T16:42:15.758910] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-09-14T16:42:15.951505] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T16:42:16.514584] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T16:42:16.516420] [INFO ] [REMOTE ] AGM: Full fetch complete (10249 records). [2025-09-14T16:42:16.516517] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-09-14T16:42:16.564085] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-09-14T16:42:16.900942] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-09-14T16:42:16.907020] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-09-14T16:42:16.915855] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-09-14T16:42:16.916632] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-09-14T16:42:16.917498] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-14T16:42:16.923271] [DEBUG] [LOCAL ] AGM: Trimmed 10249 records to 8023 (keeping 150 days of data) [2025-09-14T16:42:16.924361] [INFO ] [REMOTE ] AGI: Full fetch complete (58053 records). [2025-09-14T16:42:16.924776] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-09-14T16:42:17.201409] [DEBUG] [LOCAL ] AGM: Primary data saved (8023 records). [2025-09-14T16:42:17.238715] [INFO ] [MAIN ] AGM: Full history saved. [2025-09-14T16:42:17.260026] [INFO ] [MAIN ] Update Progress: 54/2370 symbols completed. AGM took 20.4s. Estimated remaining: 3h 38m 26s. Rate: 10.6 symbols/min [2025-09-14T16:42:17.362232] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-09-14T16:42:17.465497] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-09-14T16:42:17.481463] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-09-14T16:42:17.492561] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-09-14T16:42:17.519299] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-09-14T16:42:17.538938] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:42:17.541044] [DEBUG] [LOCAL ] AGI: Trimmed 58053 records to 40181 (keeping 150 days of data) [2025-09-14T16:42:17.647331] [DEBUG] [LOCAL ] AGRO: Loaded 13326 existing records from primary storage. [2025-09-14T16:42:17.648531] [INFO ] [MAIN ] AGRO: Loaded 13326 existing records. [2025-09-14T16:42:17.836892] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:42:17.840494] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-09-14T16:42:17.842869] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-09-14T16:42:17.845419] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-09-14T16:42:17.849868] [DEBUG] [LOCAL ] AGRO: Removed from QA tracker. [2025-09-14T16:42:17.851063] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-09-14T16:42:18.330308] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:42:18.331784] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-09-14T16:42:18.361200] [DEBUG] [LOCAL ] AGI: Primary data saved (40181 records). [2025-09-14T16:42:18.361369] [INFO ] [MAIN ] AGI: Full history saved. [2025-09-14T16:42:18.361479] [INFO ] [MAIN ] Update Progress: 55/2370 symbols completed. AGI took 27.6s. Estimated remaining: 3h 35m 8s. Rate: 10.8 symbols/min [2025-09-14T16:42:18.573545] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:42:18.576273] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-14T16:42:18.604183] [DEBUG] [LOCAL ] AGX: Loaded 14694 existing records from primary storage. [2025-09-14T16:42:18.604346] [INFO ] [MAIN ] AGX: Loaded 14694 existing records. [2025-09-14T16:42:18.782916] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:42:18.783369] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-09-14T16:42:18.783517] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-09-14T16:42:18.790094] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-09-14T16:42:18.801930] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T16:42:18.808496] [DEBUG] [LOCAL ] AGX: Removed from QA tracker. [2025-09-14T16:42:18.808908] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-09-14T16:42:18.965202] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-09-14T16:42:19.161468] [INFO ] [REMOTE ] AGX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:42:19.743543] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T16:42:19.758777] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-09-14T16:42:20.345403] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-14T16:42:20.558829] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-09-14T16:42:21.073748] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T16:42:21.076938] [INFO ] [REMOTE ] AGO: Full fetch complete (30302 records). [2025-09-14T16:42:21.077151] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-09-14T16:42:21.210221] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-14T16:42:21.365729] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-09-14T16:42:21.498548] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-09-14T16:42:21.498710] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-09-14T16:42:21.499215] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-09-14T16:42:21.499281] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-09-14T16:42:21.500670] [DEBUG] [LOCAL ] AGO: Trimmed 30302 records to 20744 (keeping 150 days of data) [2025-09-14T16:42:21.637133] [DEBUG] [LOCAL ] AGO: Primary data saved (20744 records). [2025-09-14T16:42:21.637340] [INFO ] [MAIN ] AGO: Full history saved. [2025-09-14T16:42:21.637469] [INFO ] [MAIN ] Update Progress: 56/2370 symbols completed. AGO took 22.3s. Estimated remaining: 3h 33m 27s. Rate: 10.8 symbols/min [2025-09-14T16:42:21.822236] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:42:21.841495] [DEBUG] [LOCAL ] AHH: Loaded 17265 existing records from primary storage. [2025-09-14T16:42:21.841802] [INFO ] [MAIN ] AHH: Loaded 17265 existing records. [2025-09-14T16:42:22.042725] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:42:22.043099] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-09-14T16:42:22.043199] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-14T16:42:22.043709] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-09-14T16:42:22.044219] [DEBUG] [LOCAL ] AHH: Removed from QA tracker. [2025-09-14T16:42:22.044280] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-09-14T16:42:22.159227] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-09-14T16:42:22.421076] [INFO ] [REMOTE ] AHH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:42:22.699164] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-14T16:42:22.958900] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-09-14T16:42:23.698636] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-14T16:42:23.704557] [INFO ] [REMOTE ] AGL: Full fetch complete (56909 records). [2025-09-14T16:42:23.704824] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-09-14T16:42:23.769296] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-09-14T16:42:24.111543] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-09-14T16:42:24.111714] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-09-14T16:42:24.112411] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-09-14T16:42:24.112484] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-09-14T16:42:24.114190] [DEBUG] [LOCAL ] AGL: Trimmed 56909 records to 39444 (keeping 150 days of data) [2025-09-14T16:42:24.356793] [DEBUG] [LOCAL ] AGL: Primary data saved (39444 records). [2025-09-14T16:42:24.357056] [INFO ] [MAIN ] AGL: Full history saved. [2025-09-14T16:42:24.357243] [INFO ] [MAIN ] Update Progress: 57/2370 symbols completed. AGL took 31.5s. Estimated remaining: 3h 31m 28s. Rate: 10.9 symbols/min [2025-09-14T16:42:24.542016] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:42:24.555068] [DEBUG] [LOCAL ] AHL: Loaded 10934 existing records from primary storage. [2025-09-14T16:42:24.555308] [INFO ] [MAIN ] AHL: Loaded 10934 existing records. [2025-09-14T16:42:24.589668] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-09-14T16:42:24.778376] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-14T16:42:24.785172] [WARN ] [MAIN ] AHL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:42:24.793594] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-14T16:42:24.793701] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-14T16:42:24.794124] [DEBUG] [LOCAL ] AHL: Deleted primary data file. [2025-09-14T16:42:24.794639] [DEBUG] [LOCAL ] AHL: Removed from QA tracker. [2025-09-14T16:42:24.794731] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-14T16:42:25.184793] [INFO ] [REMOTE ] AHL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:42:25.217943] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T16:42:25.358863] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-09-14T16:42:25.981708] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T16:42:26.158814] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-02. [2025-09-14T16:42:26.449604] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:42:26.450152] [WARN ] [REMOTE ] AHL: No data returned for month 2025-02 [2025-09-14T16:42:26.557252] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-14T16:42:26.958836] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-09-14T16:42:27.758833] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-09-14T16:42:28.414401] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T16:42:28.558873] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-09-14T16:42:29.366296] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-03. [2025-09-14T16:42:29.384836] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T16:42:30.032611] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:42:30.033021] [WARN ] [REMOTE ] AHL: No data returned for month 2025-03 [2025-09-14T16:42:30.138023] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T16:42:30.158781] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-09-14T16:42:30.958876] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-04. [2025-09-14T16:42:31.223450] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:42:31.223823] [WARN ] [REMOTE ] AHL: No data returned for month 2025-04 [2025-09-14T16:42:31.659140] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T16:42:31.758880] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-09-14T16:42:32.558852] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-09-14T16:42:33.365009] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-05. [2025-09-14T16:42:33.370034] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T16:42:33.952158] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-14T16:42:34.149009] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-14T16:42:34.158791] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-06. [2025-09-14T16:42:34.958857] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-09-14T16:42:35.244915] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T16:42:35.758882] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-09-14T16:42:36.559859] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-09-14T16:42:36.561509] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-14T16:42:37.043524] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-14T16:42:37.358875] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-07. [2025-09-14T16:42:38.005012] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-14T16:42:38.048305] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T16:42:38.158803] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-08. [2025-09-14T16:42:38.958832] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-09-14T16:42:39.431025] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-14T16:42:39.758833] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-09-14T16:42:40.558834] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-09-14T16:42:40.607792] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T16:42:41.120246] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T16:42:41.123967] [INFO ] [REMOTE ] AGX: Full fetch complete (36572 records). [2025-09-14T16:42:41.124068] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-09-14T16:42:41.371901] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-09. [2025-09-14T16:42:41.523555] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-09-14T16:42:41.523695] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-09-14T16:42:41.524200] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-09-14T16:42:41.524290] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-09-14T16:42:41.525270] [DEBUG] [LOCAL ] AGX: Trimmed 36572 records to 25055 (keeping 150 days of data) [2025-09-14T16:42:41.667605] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T16:42:41.710282] [DEBUG] [LOCAL ] AGX: Primary data saved (25055 records). [2025-09-14T16:42:41.710456] [INFO ] [MAIN ] AGX: Full history saved. [2025-09-14T16:42:41.710562] [INFO ] [MAIN ] Update Progress: 58/2370 symbols completed. AGX took 23.3s. Estimated remaining: 3h 39m 15s. Rate: 10.5 symbols/min [2025-09-14T16:42:41.882962] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:42:41.906063] [DEBUG] [LOCAL ] AHR: Loaded 22179 existing records from primary storage. [2025-09-14T16:42:41.906264] [INFO ] [MAIN ] AHR: Loaded 22179 existing records. [2025-09-14T16:42:42.088610] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:42:42.088934] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-09-14T16:42:42.089012] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-09-14T16:42:42.089580] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-09-14T16:42:42.090206] [DEBUG] [LOCAL ] AHR: Removed from QA tracker. [2025-09-14T16:42:42.090290] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-09-14T16:42:42.164009] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-09-14T16:42:42.455761] [INFO ] [REMOTE ] AHR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:42:42.467211] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-14T16:42:42.471317] [INFO ] [REMOTE ] AHL: Full fetch complete (15407 records). [2025-09-14T16:42:42.471438] [DEBUG] [VALIDATOR ] AHL: Validating primary data. [2025-09-14T16:42:42.659044] [WARN ] [VALIDATOR ] AHL: Validation failed - insufficient historical data. Have 88 unique days, need 150 days [2025-09-14T16:42:42.659374] [FATAL] [MAIN ] AHL: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:42:42.659452] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:42:42.659514] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-14T16:42:42.659605] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-14T16:42:42.659681] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-14T16:42:42.659750] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-14T16:42:42.659934] [INFO ] [MAIN ] Update Progress: 59/2370 symbols completed. AHL took 18.3s. Estimated remaining: 3h 36m 4s. Rate: 10.7 symbols/min [2025-09-14T16:42:42.829807] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:42:42.834596] [DEBUG] [LOCAL ] AHT: Loaded 3243 existing records from primary storage. [2025-09-14T16:42:42.834737] [INFO ] [MAIN ] AHT: Loaded 3243 existing records. [2025-09-14T16:42:42.974886] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-09-14T16:42:43.017075] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:42:43.017602] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-09-14T16:42:43.017700] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-09-14T16:42:43.018093] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-09-14T16:42:43.018602] [DEBUG] [LOCAL ] AHT: Removed from QA tracker. [2025-09-14T16:42:43.018696] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-09-14T16:42:43.380170] [INFO ] [REMOTE ] AHT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:42:43.647819] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-14T16:42:43.758831] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-09-14T16:42:44.558835] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-09-14T16:42:44.633914] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T16:42:44.661159] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T16:42:45.358832] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-09-14T16:42:45.721778] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-14T16:42:45.725552] [INFO ] [REMOTE ] AGRO: Full fetch complete (37403 records). [2025-09-14T16:42:45.725794] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-09-14T16:42:45.979414] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-14T16:42:46.130293] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-09-14T16:42:46.130429] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-09-14T16:42:46.130951] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-09-14T16:42:46.131014] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-09-14T16:42:46.131978] [DEBUG] [LOCAL ] AGRO: Trimmed 37403 records to 24450 (keeping 150 days of data) [2025-09-14T16:42:46.183914] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-09-14T16:42:46.281822] [DEBUG] [LOCAL ] AGRO: Primary data saved (24450 records). [2025-09-14T16:42:46.282010] [INFO ] [MAIN ] AGRO: Full history saved. [2025-09-14T16:42:46.282183] [INFO ] [MAIN ] Update Progress: 60/2370 symbols completed. AGRO took 29.0s. Estimated remaining: 3h 34m 42s. Rate: 10.8 symbols/min [2025-09-14T16:42:46.453361] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:42:46.476983] [DEBUG] [LOCAL ] AI: Loaded 24148 existing records from primary storage. [2025-09-14T16:42:46.477208] [INFO ] [MAIN ] AI: Loaded 24148 existing records. [2025-09-14T16:42:46.656705] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:42:46.657051] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-09-14T16:42:46.657133] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-09-14T16:42:46.657988] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-09-14T16:42:46.658460] [DEBUG] [LOCAL ] AI: Removed from QA tracker. [2025-09-14T16:42:46.658530] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-09-14T16:42:46.964022] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-09-14T16:42:47.021584] [INFO ] [REMOTE ] AI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:42:47.641175] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-14T16:42:47.753844] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-14T16:42:47.758763] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-09-14T16:42:48.270373] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-14T16:42:48.558835] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-09-14T16:42:49.358833] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-09-14T16:42:50.158829] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-09-14T16:42:50.201545] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T16:42:50.958878] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-09-14T16:42:51.579404] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T16:42:51.758882] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-09-14T16:42:51.805333] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-14T16:42:51.850139] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T16:42:52.558850] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-09-14T16:42:53.258709] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-14T16:42:53.358874] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-09-14T16:42:53.827088] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T16:42:53.831015] [INFO ] [REMOTE ] AHH: Full fetch complete (45220 records). [2025-09-14T16:42:53.831142] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-09-14T16:42:54.165522] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-09-14T16:42:54.224616] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-09-14T16:42:54.224764] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-09-14T16:42:54.225312] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-09-14T16:42:54.225386] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-09-14T16:42:54.226450] [DEBUG] [LOCAL ] AHH: Trimmed 45220 records to 30344 (keeping 150 days of data) [2025-09-14T16:42:54.421337] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T16:42:54.444740] [DEBUG] [LOCAL ] AHH: Primary data saved (30344 records). [2025-09-14T16:42:54.444927] [INFO ] [MAIN ] AHH: Full history saved. [2025-09-14T16:42:54.445033] [INFO ] [MAIN ] Update Progress: 61/2370 symbols completed. AHH took 32.8s. Estimated remaining: 3h 36m 14s. Rate: 10.7 symbols/min [2025-09-14T16:42:54.620375] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:42:54.645608] [DEBUG] [LOCAL ] AIG: Loaded 23943 existing records from primary storage. [2025-09-14T16:42:54.645814] [INFO ] [MAIN ] AIG: Loaded 23943 existing records. [2025-09-14T16:42:54.794441] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-14T16:42:54.835597] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:42:54.835881] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-09-14T16:42:54.835960] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-09-14T16:42:54.836603] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-09-14T16:42:54.837165] [DEBUG] [LOCAL ] AIG: Removed from QA tracker. [2025-09-14T16:42:54.837226] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-09-14T16:42:54.963990] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-09-14T16:42:55.197366] [INFO ] [REMOTE ] AIG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:42:55.758841] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-09-14T16:42:56.558853] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-09-14T16:42:57.358847] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-09-14T16:42:57.409167] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-14T16:42:57.531497] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T16:42:58.151153] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-14T16:42:58.158767] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-09-14T16:42:58.373750] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T16:42:58.652726] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-14T16:42:58.654299] [INFO ] [REMOTE ] AHT: Full fetch complete (6607 records). [2025-09-14T16:42:58.654457] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-09-14T16:42:58.964053] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-09-14T16:42:59.073712] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-09-14T16:42:59.073831] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-09-14T16:42:59.074080] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-09-14T16:42:59.074170] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-09-14T16:42:59.074679] [DEBUG] [LOCAL ] AHT: Trimmed 6607 records to 4581 (keeping 150 days of data) [2025-09-14T16:42:59.102451] [DEBUG] [LOCAL ] AHT: Primary data saved (4581 records). [2025-09-14T16:42:59.102619] [INFO ] [MAIN ] AHT: Full history saved. [2025-09-14T16:42:59.102785] [INFO ] [MAIN ] Update Progress: 62/2370 symbols completed. AHT took 16.4s. Estimated remaining: 3h 35m 33s. Rate: 10.7 symbols/min [2025-09-14T16:42:59.281600] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:42:59.290768] [DEBUG] [LOCAL ] AII: Loaded 5786 existing records from primary storage. [2025-09-14T16:42:59.291067] [INFO ] [MAIN ] AII: Loaded 5786 existing records. [2025-09-14T16:42:59.472830] [WARN ] [MAIN ] AII: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:42:59.473114] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-14T16:42:59.473175] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-14T16:42:59.473518] [DEBUG] [LOCAL ] AII: Deleted primary data file. [2025-09-14T16:42:59.474001] [DEBUG] [LOCAL ] AII: Removed from QA tracker. [2025-09-14T16:42:59.474073] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-14T16:42:59.764288] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-09-14T16:42:59.842798] [INFO ] [REMOTE ] AII: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:43:00.558883] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-02. [2025-09-14T16:43:00.695315] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-14T16:43:00.928332] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:43:00.928706] [WARN ] [REMOTE ] AII: No data returned for month 2025-02 [2025-09-14T16:43:01.358813] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-09-14T16:43:01.871279] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-14T16:43:02.158839] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-09-14T16:43:02.958846] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-09-14T16:43:03.279244] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-14T16:43:03.758831] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-03. [2025-09-14T16:43:04.008562] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:43:04.008919] [WARN ] [REMOTE ] AII: No data returned for month 2025-03 [2025-09-14T16:43:04.128585] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-14T16:43:04.558840] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-09-14T16:43:04.920101] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-14T16:43:05.358865] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-09-14T16:43:06.132136] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T16:43:06.158785] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-09-14T16:43:06.958929] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-09-14T16:43:07.758853] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-04. [2025-09-14T16:43:07.828072] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-14T16:43:08.025877] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:43:08.038629] [WARN ] [REMOTE ] AII: No data returned for month 2025-04 [2025-09-14T16:43:08.040058] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-14T16:43:08.089292] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-14T16:43:08.094734] [INFO ] [REMOTE ] AHR: Full fetch complete (53661 records). [2025-09-14T16:43:08.094913] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-09-14T16:43:08.492137] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-09-14T16:43:08.492287] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-09-14T16:43:08.492982] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-09-14T16:43:08.493098] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-09-14T16:43:08.494766] [DEBUG] [LOCAL ] AHR: Trimmed 53661 records to 37011 (keeping 150 days of data) [2025-09-14T16:43:08.582715] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-09-14T16:43:08.810839] [DEBUG] [LOCAL ] AHR: Primary data saved (37011 records). [2025-09-14T16:43:08.811120] [INFO ] [MAIN ] AHR: Full history saved. [2025-09-14T16:43:08.811360] [INFO ] [MAIN ] Update Progress: 63/2370 symbols completed. AHR took 27.1s. Estimated remaining: 3h 37m 57s. Rate: 10.6 symbols/min [2025-09-14T16:43:09.096769] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:43:09.113546] [DEBUG] [LOCAL ] AIN: Loaded 11037 existing records from primary storage. [2025-09-14T16:43:09.113801] [INFO ] [MAIN ] AIN: Loaded 11037 existing records. [2025-09-14T16:43:09.363983] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-09-14T16:43:09.413304] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:43:09.413884] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-09-14T16:43:09.413982] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-09-14T16:43:09.414503] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-09-14T16:43:09.415244] [DEBUG] [LOCAL ] AIN: Removed from QA tracker. [2025-09-14T16:43:09.415405] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-09-14T16:43:09.830604] [INFO ] [REMOTE ] AIN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:43:10.158842] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-09-14T16:43:10.958873] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-05. [2025-09-14T16:43:11.022243] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-09-14T16:43:11.150940] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T16:43:11.175721] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T16:43:11.758847] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-09-14T16:43:11.955292] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-14T16:43:12.558911] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-06. [2025-09-14T16:43:12.759080] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-14T16:43:13.358901] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-09-14T16:43:13.635167] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T16:43:14.158912] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-09-14T16:43:14.958873] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-07. [2025-09-14T16:43:15.211187] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-14T16:43:15.758860] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-09-14T16:43:15.891849] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T16:43:16.440005] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-14T16:43:16.558856] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-09-14T16:43:16.740603] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-14T16:43:17.358846] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-09-14T16:43:18.158856] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-08. [2025-09-14T16:43:18.610931] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T16:43:18.958854] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-09-14T16:43:19.002300] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-14T16:43:19.187128] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-09-14T16:43:19.605052] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T16:43:19.610549] [INFO ] [REMOTE ] AIG: Full fetch complete (58149 records). [2025-09-14T16:43:19.610710] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-09-14T16:43:19.763552] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-09-14T16:43:20.003199] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-09-14T16:43:20.003343] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-09-14T16:43:20.004070] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-09-14T16:43:20.004151] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-09-14T16:43:20.005803] [DEBUG] [LOCAL ] AIG: Trimmed 58149 records to 40230 (keeping 150 days of data) [2025-09-14T16:43:20.258244] [DEBUG] [LOCAL ] AIG: Primary data saved (40230 records). [2025-09-14T16:43:20.258411] [INFO ] [MAIN ] AIG: Full history saved. [2025-09-14T16:43:20.258553] [INFO ] [MAIN ] Update Progress: 64/2370 symbols completed. AIG took 25.8s. Estimated remaining: 3h 41m 20s. Rate: 10.4 symbols/min [2025-09-14T16:43:20.425127] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:43:20.432686] [DEBUG] [LOCAL ] AIO: Loaded 4409 existing records from primary storage. [2025-09-14T16:43:20.432822] [INFO ] [MAIN ] AIO: Loaded 4409 existing records. [2025-09-14T16:43:20.571397] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-09. [2025-09-14T16:43:20.609461] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-07-01, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:43:20.609796] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-09-14T16:43:20.609863] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-14T16:43:20.610198] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-09-14T16:43:20.610676] [DEBUG] [LOCAL ] AIO: Removed from QA tracker. [2025-09-14T16:43:20.610735] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-09-14T16:43:20.976673] [INFO ] [REMOTE ] AIO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:43:20.991401] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-14T16:43:21.358847] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-09-14T16:43:21.505607] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-14T16:43:21.507809] [INFO ] [REMOTE ] AII: Full fetch complete (9345 records). [2025-09-14T16:43:21.507911] [DEBUG] [VALIDATOR ] AII: Validating primary data. [2025-09-14T16:43:21.687372] [WARN ] [VALIDATOR ] AII: Validation failed - insufficient historical data. Have 88 unique days, need 150 days [2025-09-14T16:43:21.687688] [FATAL] [MAIN ] AII: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:43:21.687762] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:43:21.687834] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-14T16:43:21.687950] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-14T16:43:21.688030] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-14T16:43:21.688123] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-14T16:43:21.688241] [INFO ] [MAIN ] Update Progress: 65/2370 symbols completed. AII took 22.6s. Estimated remaining: 3h 38m 41s. Rate: 10.5 symbols/min [2025-09-14T16:43:21.866596] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:43:21.880456] [DEBUG] [LOCAL ] AIR: Loaded 12527 existing records from primary storage. [2025-09-14T16:43:21.880618] [INFO ] [MAIN ] AIR: Loaded 12527 existing records. [2025-09-14T16:43:22.056130] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:43:22.056442] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-09-14T16:43:22.056502] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-14T16:43:22.057028] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-09-14T16:43:22.057481] [DEBUG] [LOCAL ] AIR: Removed from QA tracker. [2025-09-14T16:43:22.057543] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-09-14T16:43:22.163934] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-09-14T16:43:22.411126] [INFO ] [REMOTE ] AIR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:43:22.464569] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T16:43:22.958841] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-09-14T16:43:23.758834] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-09-14T16:43:24.278140] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-14T16:43:24.497618] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-14T16:43:24.503302] [INFO ] [REMOTE ] AI: Full fetch complete (58427 records). [2025-09-14T16:43:24.503464] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-09-14T16:43:24.567229] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-09-14T16:43:24.891491] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-09-14T16:43:24.891633] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-09-14T16:43:24.892395] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-09-14T16:43:24.892479] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-09-14T16:43:24.900469] [DEBUG] [LOCAL ] AI: Trimmed 58427 records to 40507 (keeping 150 days of data) [2025-09-14T16:43:24.912960] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-14T16:43:25.171910] [DEBUG] [LOCAL ] AI: Primary data saved (40507 records). [2025-09-14T16:43:25.172072] [INFO ] [MAIN ] AI: Full history saved. [2025-09-14T16:43:25.172189] [INFO ] [MAIN ] Update Progress: 66/2370 symbols completed. AI took 38.9s. Estimated remaining: 3h 37m 18s. Rate: 10.6 symbols/min [2025-09-14T16:43:25.344768] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:43:25.354090] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-14T16:43:25.358772] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-09-14T16:43:25.369358] [DEBUG] [LOCAL ] AIT: Loaded 11568 existing records from primary storage. [2025-09-14T16:43:25.369530] [INFO ] [MAIN ] AIT: Loaded 11568 existing records. [2025-09-14T16:43:25.556158] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:43:25.556487] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-09-14T16:43:25.556560] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-14T16:43:25.557217] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-09-14T16:43:25.558022] [DEBUG] [LOCAL ] AIT: Removed from QA tracker. [2025-09-14T16:43:25.558086] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-09-14T16:43:25.910639] [INFO ] [REMOTE ] AIT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:43:26.158825] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-09-14T16:43:26.170595] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T16:43:26.958840] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-09-14T16:43:27.407678] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-14T16:43:27.758849] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-09-14T16:43:27.976852] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-14T16:43:28.558834] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-09-14T16:43:28.859852] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-14T16:43:28.862459] [INFO ] [REMOTE ] AIN: Full fetch complete (25965 records). [2025-09-14T16:43:28.862595] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-09-14T16:43:29.250668] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-09-14T16:43:29.250842] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-09-14T16:43:29.251424] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-09-14T16:43:29.251582] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-09-14T16:43:29.252846] [DEBUG] [LOCAL ] AIN: Trimmed 25965 records to 18249 (keeping 150 days of data) [2025-09-14T16:43:29.273410] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T16:43:29.366089] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-09-14T16:43:29.403034] [DEBUG] [LOCAL ] AIN: Primary data saved (18249 records). [2025-09-14T16:43:29.403299] [INFO ] [MAIN ] AIN: Full history saved. [2025-09-14T16:43:29.403432] [INFO ] [MAIN ] Update Progress: 67/2370 symbols completed. AIN took 20.6s. Estimated remaining: 3h 36m 23s. Rate: 10.6 symbols/min [2025-09-14T16:43:29.587700] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:43:29.606413] [DEBUG] [LOCAL ] AIV: Loaded 18534 existing records from primary storage. [2025-09-14T16:43:29.606626] [INFO ] [MAIN ] AIV: Loaded 18534 existing records. [2025-09-14T16:43:29.789925] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:43:29.790291] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-09-14T16:43:29.790360] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-09-14T16:43:29.790989] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-09-14T16:43:29.791496] [DEBUG] [LOCAL ] AIV: Removed from QA tracker. [2025-09-14T16:43:29.791560] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-09-14T16:43:30.165327] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-09-14T16:43:30.171596] [INFO ] [REMOTE ] AIV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:43:30.584210] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-14T16:43:30.958894] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-09-14T16:43:31.661765] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-14T16:43:31.758880] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-09-14T16:43:32.036453] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T16:43:32.558855] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-09-14T16:43:32.995177] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-14T16:43:33.358884] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-09-14T16:43:33.780307] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-14T16:43:34.158896] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-09-14T16:43:34.286839] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-14T16:43:34.958885] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-09-14T16:43:35.478976] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-14T16:43:35.567976] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-14T16:43:35.758872] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-09-14T16:43:36.558828] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-09-14T16:43:36.662761] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-14T16:43:37.358888] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-09-14T16:43:38.060615] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-14T16:43:38.089211] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-14T16:43:38.158805] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-09-14T16:43:38.798707] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-14T16:43:38.958847] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-09-14T16:43:39.758837] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-09-14T16:43:40.320056] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-14T16:43:40.558839] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-09-14T16:43:40.890873] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-14T16:43:41.358881] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-09-14T16:43:41.546269] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T16:43:42.099372] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T16:43:42.101100] [INFO ] [REMOTE ] AIO: Full fetch complete (14700 records). [2025-09-14T16:43:42.101191] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-09-14T16:43:42.165415] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-09-14T16:43:42.471533] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-09-14T16:43:42.471703] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-09-14T16:43:42.472140] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-09-14T16:43:42.472212] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-09-14T16:43:42.473134] [DEBUG] [LOCAL ] AIO: Trimmed 14700 records to 9333 (keeping 150 days of data) [2025-09-14T16:43:42.535918] [DEBUG] [LOCAL ] AIO: Primary data saved (9333 records). [2025-09-14T16:43:42.536169] [INFO ] [MAIN ] AIO: Full history saved. [2025-09-14T16:43:42.536302] [INFO ] [MAIN ] Update Progress: 68/2370 symbols completed. AIO took 22.3s. Estimated remaining: 3h 40m 31s. Rate: 10.4 symbols/min [2025-09-14T16:43:42.725423] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:43:42.741707] [DEBUG] [LOCAL ] AIZ: Loaded 12691 existing records from primary storage. [2025-09-14T16:43:42.741969] [INFO ] [MAIN ] AIZ: Loaded 12691 existing records. [2025-09-14T16:43:42.943021] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:43:42.943342] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-09-14T16:43:42.943406] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-09-14T16:43:42.943989] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-09-14T16:43:42.944477] [DEBUG] [LOCAL ] AIZ: Removed from QA tracker. [2025-09-14T16:43:42.944538] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-09-14T16:43:42.965927] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-09-14T16:43:43.302222] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:43:43.308562] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-14T16:43:43.310860] [INFO ] [REMOTE ] AIT: Full fetch complete (30633 records). [2025-09-14T16:43:43.310950] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-09-14T16:43:43.675833] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-09-14T16:43:43.676183] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-09-14T16:43:43.676626] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-09-14T16:43:43.676738] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-09-14T16:43:43.678063] [DEBUG] [LOCAL ] AIT: Trimmed 30633 records to 20843 (keeping 150 days of data) [2025-09-14T16:43:43.697744] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T16:43:43.762560] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-09-14T16:43:43.842024] [DEBUG] [LOCAL ] AIT: Primary data saved (20843 records). [2025-09-14T16:43:43.842217] [INFO ] [MAIN ] AIT: Full history saved. [2025-09-14T16:43:43.842330] [INFO ] [MAIN ] Update Progress: 69/2370 symbols completed. AIT took 18.7s. Estimated remaining: 3h 37m 57s. Rate: 10.6 symbols/min [2025-09-14T16:43:44.014079] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:43:44.018056] [DEBUG] [LOCAL ] AIZN: Loaded 1744 existing records from primary storage. [2025-09-14T16:43:44.018198] [INFO ] [MAIN ] AIZN: Loaded 1744 existing records. [2025-09-14T16:43:44.200857] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:43:44.201357] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-09-14T16:43:44.201419] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-09-14T16:43:44.201769] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-09-14T16:43:44.202298] [DEBUG] [LOCAL ] AIZN: Removed from QA tracker. [2025-09-14T16:43:44.202358] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-09-14T16:43:44.548117] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:43:44.558789] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-09-14T16:43:45.140559] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-14T16:43:45.206919] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-14T16:43:45.358858] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-09-14T16:43:46.158863] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-09-14T16:43:46.658039] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-14T16:43:46.958882] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-09-14T16:43:47.216633] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-14T16:43:47.693017] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-14T16:43:47.758798] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-09-14T16:43:48.230814] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-14T16:43:48.558882] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-09-14T16:43:49.358894] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-09-14T16:43:50.085153] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T16:43:50.158799] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-09-14T16:43:50.436381] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T16:43:50.751258] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-14T16:43:50.958838] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-09-14T16:43:51.582444] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T16:43:51.758852] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-09-14T16:43:52.558836] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-09-14T16:43:52.974342] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-14T16:43:53.358842] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-09-14T16:43:54.129097] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-14T16:43:54.158788] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-09-14T16:43:54.801293] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-14T16:43:54.958911] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-09-14T16:43:55.758840] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-09-14T16:43:55.802859] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T16:43:55.835483] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-14T16:43:56.558886] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-09-14T16:43:56.838851] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-14T16:43:57.358829] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-09-14T16:43:57.757940] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-14T16:43:57.841089] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-14T16:43:57.845885] [INFO ] [REMOTE ] AIV: Full fetch complete (43443 records). [2025-09-14T16:43:57.846036] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-09-14T16:43:58.164255] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-09-14T16:43:58.249236] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-09-14T16:43:58.249362] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-09-14T16:43:58.250434] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-09-14T16:43:58.250500] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-09-14T16:43:58.251968] [DEBUG] [LOCAL ] AIV: Trimmed 43443 records to 30028 (keeping 150 days of data) [2025-09-14T16:43:58.430249] [DEBUG] [LOCAL ] AIV: Primary data saved (30028 records). [2025-09-14T16:43:58.430467] [INFO ] [MAIN ] AIV: Full history saved. [2025-09-14T16:43:58.430605] [INFO ] [MAIN ] Update Progress: 70/2370 symbols completed. AIV took 29.0s. Estimated remaining: 3h 42m 44s. Rate: 10.3 symbols/min [2025-09-14T16:43:58.616964] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:43:58.640366] [DEBUG] [LOCAL ] AJG: Loaded 20742 existing records from primary storage. [2025-09-14T16:43:58.640607] [INFO ] [MAIN ] AJG: Loaded 20742 existing records. [2025-09-14T16:43:58.825068] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T16:43:58.852888] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:43:58.857035] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-09-14T16:43:58.857132] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-14T16:43:58.857274] [INFO ] [REMOTE ] AIR: Full fetch complete (28570 records). [2025-09-14T16:43:58.857603] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-09-14T16:43:58.886680] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-09-14T16:43:58.905997] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-09-14T16:43:58.978949] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-09-14T16:43:59.691184] [INFO ] [REMOTE ] AJG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:43:59.691502] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-09-14T16:43:59.691833] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-09-14T16:43:59.693613] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-09-14T16:43:59.693835] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-09-14T16:43:59.695371] [DEBUG] [LOCAL ] AIR: Trimmed 28570 records to 19592 (keeping 150 days of data) [2025-09-14T16:43:59.760867] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-09-14T16:43:59.821906] [DEBUG] [LOCAL ] AIR: Primary data saved (19592 records). [2025-09-14T16:43:59.822125] [INFO ] [MAIN ] AIR: Full history saved. [2025-09-14T16:43:59.822238] [INFO ] [MAIN ] Update Progress: 71/2370 symbols completed. AIR took 38.1s. Estimated remaining: 3h 40m 15s. Rate: 10.4 symbols/min [2025-09-14T16:44:00.001366] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:44:00.004801] [DEBUG] [LOCAL ] AKA: Loaded 370 existing records from primary storage. [2025-09-14T16:44:00.004890] [INFO ] [MAIN ] AKA: Loaded 370 existing records. [2025-09-14T16:44:00.181447] [WARN ] [MAIN ] AKA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:44:00.181941] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-14T16:44:00.182012] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-14T16:44:00.182577] [DEBUG] [LOCAL ] AKA: Deleted primary data file. [2025-09-14T16:44:00.183327] [DEBUG] [LOCAL ] AKA: Removed from QA tracker. [2025-09-14T16:44:00.183390] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-14T16:44:00.364942] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T16:44:00.562384] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-09-14T16:44:00.574800] [INFO ] [REMOTE ] AKA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:44:01.082917] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T16:44:01.084068] [INFO ] [REMOTE ] AIZN: Full fetch complete (4188 records). [2025-09-14T16:44:01.084173] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-09-14T16:44:01.361862] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-09-14T16:44:01.533816] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-09-14T16:44:01.534065] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-09-14T16:44:01.534348] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-09-14T16:44:01.534491] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-09-14T16:44:01.535438] [DEBUG] [LOCAL ] AIZN: Trimmed 4188 records to 2657 (keeping 150 days of data) [2025-09-14T16:44:01.554296] [DEBUG] [LOCAL ] AIZN: Primary data saved (2657 records). [2025-09-14T16:44:01.554482] [INFO ] [MAIN ] AIZN: Full history saved. [2025-09-14T16:44:01.554596] [INFO ] [MAIN ] Update Progress: 72/2370 symbols completed. AIZN took 17.7s. Estimated remaining: 3h 38m 2s. Rate: 10.5 symbols/min [2025-09-14T16:44:01.804979] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:44:01.833928] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-14T16:44:01.883190] [DEBUG] [LOCAL ] AKR: Loaded 21150 existing records from primary storage. [2025-09-14T16:44:01.883490] [INFO ] [MAIN ] AKR: Loaded 21150 existing records. [2025-09-14T16:44:02.164943] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-09-14T16:44:02.176688] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:44:02.177085] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-09-14T16:44:02.177185] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-14T16:44:02.178087] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-09-14T16:44:02.178196] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-09-14T16:44:02.699484] [INFO ] [REMOTE ] AKR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:44:02.800306] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T16:44:02.958876] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-09-14T16:44:03.758886] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-09-14T16:44:04.092742] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T16:44:04.525484] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T16:44:04.558830] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-09-14T16:44:04.839765] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-14T16:44:05.358822] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-09-14T16:44:06.158831] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-14T16:44:06.230495] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T16:44:06.669159] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-14T16:44:06.958833] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-14T16:44:07.026565] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T16:44:07.478799] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-14T16:44:07.758825] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-09-14T16:44:08.558873] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-09-14T16:44:09.358847] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-14T16:44:09.571199] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T16:44:09.916020] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-14T16:44:10.158851] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-09-14T16:44:10.375466] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T16:44:10.958890] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-09-14T16:44:11.758837] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-09-14T16:44:11.823914] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-14T16:44:12.323461] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T16:44:12.327188] [INFO ] [REMOTE ] AIZ: Full fetch complete (33323 records). [2025-09-14T16:44:12.327310] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-09-14T16:44:12.569183] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-09-14T16:44:12.731460] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-09-14T16:44:12.731611] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-09-14T16:44:12.732089] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-09-14T16:44:12.732155] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-09-14T16:44:12.733239] [DEBUG] [LOCAL ] AIZ: Trimmed 33323 records to 22672 (keeping 150 days of data) [2025-09-14T16:44:12.875411] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T16:44:12.920759] [DEBUG] [LOCAL ] AIZ: Primary data saved (22672 records). [2025-09-14T16:44:12.920930] [INFO ] [MAIN ] AIZ: Full history saved. [2025-09-14T16:44:12.921057] [INFO ] [MAIN ] Update Progress: 73/2370 symbols completed. AIZ took 30.4s. Estimated remaining: 3h 40m 54s. Rate: 10.4 symbols/min [2025-09-14T16:44:13.088055] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:44:13.106935] [DEBUG] [LOCAL ] AL: Loaded 19109 existing records from primary storage. [2025-09-14T16:44:13.107122] [INFO ] [MAIN ] AL: Loaded 19109 existing records. [2025-09-14T16:44:13.286738] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:44:13.287120] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-09-14T16:44:13.287213] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-09-14T16:44:13.288049] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-09-14T16:44:13.288131] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-09-14T16:44:13.364018] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-09-14T16:44:13.639352] [INFO ] [REMOTE ] AL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:44:14.039539] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-14T16:44:14.158820] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-09-14T16:44:14.958814] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-14T16:44:15.326534] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-14T16:44:15.508836] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T16:44:15.599150] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-14T16:44:15.758860] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-14T16:44:16.107428] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-14T16:44:16.558850] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-09-14T16:44:17.358839] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-09-14T16:44:17.724769] [DEBUG] [REMOTE ] AKR: Error fetching primary data for 2025-08: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-14T16:44:17.725032] [WARN ] [REMOTE ] AKR: No data returned for month 2025-08 [2025-09-14T16:44:18.158900] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-09-14T16:44:18.243446] [DEBUG] [REMOTE ] AL: Error fetching primary data for 2025-02: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer')) [2025-09-14T16:44:18.243667] [WARN ] [REMOTE ] AL: No data returned for month 2025-02 [2025-09-14T16:44:18.683292] [DEBUG] [REMOTE ] AJG: Error fetching primary data for 2025-08: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-14T16:44:18.683518] [WARN ] [REMOTE ] AJG: No data returned for month 2025-08 [2025-09-14T16:44:18.958839] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-09-14T16:44:19.758881] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-09-14T16:44:20.291865] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T16:44:20.420149] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T16:44:20.425086] [INFO ] [REMOTE ] AJG: Full fetch complete (44366 records). [2025-09-14T16:44:20.425204] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-09-14T16:44:20.570216] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-09-14T16:44:20.618702] [WARN ] [VALIDATOR ] AJG: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-14T16:44:20.619193] [FATAL] [MAIN ] AJG: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:44:20.619245] [WARN ] [MAIN ] AJG: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:44:20.619293] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-14T16:44:20.619362] [DEBUG] [LOCAL ] AJG: No primary data file found to delete. [2025-09-14T16:44:20.619408] [INFO ] [LOCAL ] AJG: Starting deletion of derivative data. [2025-09-14T16:44:20.619452] [DEBUG] [LOCAL ] AJG: No derivative data file found to delete. [2025-09-14T16:44:20.619557] [INFO ] [MAIN ] Update Progress: 74/2370 symbols completed. AJG took 22.2s. Estimated remaining: 3h 41m 48s. Rate: 10.4 symbols/min [2025-09-14T16:44:20.794457] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:44:20.819086] [DEBUG] [LOCAL ] ALB: Loaded 23907 existing records from primary storage. [2025-09-14T16:44:20.819265] [INFO ] [MAIN ] ALB: Loaded 23907 existing records. [2025-09-14T16:44:20.994616] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:44:20.995149] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-09-14T16:44:20.995237] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-09-14T16:44:21.001131] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-09-14T16:44:21.007241] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-09-14T16:44:21.040085] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T16:44:21.114921] [INFO ] [REMOTE ] AKR: Full fetch complete (42243 records). [2025-09-14T16:44:21.135978] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-09-14T16:44:21.365816] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-09-14T16:44:21.577940] [WARN ] [VALIDATOR ] AKR: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-14T16:44:21.582284] [INFO ] [REMOTE ] ALB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:44:21.582818] [FATAL] [MAIN ] AKR: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:44:21.583155] [WARN ] [MAIN ] AKR: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:44:21.583228] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-14T16:44:21.583320] [DEBUG] [LOCAL ] AKR: No primary data file found to delete. [2025-09-14T16:44:21.583377] [INFO ] [LOCAL ] AKR: Starting deletion of derivative data. [2025-09-14T16:44:21.583443] [DEBUG] [LOCAL ] AKR: No derivative data file found to delete. [2025-09-14T16:44:21.583538] [INFO ] [MAIN ] Update Progress: 75/2370 symbols completed. AKR took 20.0s. Estimated remaining: 3h 39m 15s. Rate: 10.5 symbols/min [2025-09-14T16:44:21.755726] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:44:21.779129] [DEBUG] [LOCAL ] ALC: Loaded 22893 existing records from primary storage. [2025-09-14T16:44:21.779311] [INFO ] [MAIN ] ALC: Loaded 22893 existing records. [2025-09-14T16:44:21.954290] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:44:21.954582] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-09-14T16:44:21.954682] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-14T16:44:21.955307] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-09-14T16:44:21.955372] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-09-14T16:44:22.163878] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-09-14T16:44:22.318283] [INFO ] [REMOTE ] ALC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:44:22.879873] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T16:44:22.958780] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-14T16:44:23.366074] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-14T16:44:23.758807] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-09-14T16:44:24.237216] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-14T16:44:24.558830] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-09-14T16:44:25.358888] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-09-14T16:44:25.535331] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T16:44:26.134827] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-14T16:44:26.158780] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-09-14T16:44:26.720812] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-14T16:44:26.958864] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-09-14T16:44:27.758833] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-09-14T16:44:27.949868] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T16:44:28.449572] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-14T16:44:28.558813] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-09-14T16:44:29.358837] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-14T16:44:29.517784] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T16:44:29.744822] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-14T16:44:30.152692] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T16:44:30.161252] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-09-14T16:44:30.958877] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-09-14T16:44:31.758891] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-09-14T16:44:32.305068] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-14T16:44:32.558835] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-09-14T16:44:32.868598] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-14T16:44:33.302373] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-14T16:44:33.358806] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-09-14T16:44:33.742697] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-14T16:44:33.748487] [INFO ] [REMOTE ] AL: Full fetch complete (42828 records). [2025-09-14T16:44:33.748658] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-09-14T16:44:33.939756] [WARN ] [VALIDATOR ] AL: Validation failed - insufficient historical data. Have 135 unique days, need 150 days [2025-09-14T16:44:33.940251] [FATAL] [MAIN ] AL: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:44:33.940306] [WARN ] [MAIN ] AL: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:44:33.940362] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-09-14T16:44:33.940434] [DEBUG] [LOCAL ] AL: No primary data file found to delete. [2025-09-14T16:44:33.940482] [INFO ] [LOCAL ] AL: Starting deletion of derivative data. [2025-09-14T16:44:33.940538] [DEBUG] [LOCAL ] AL: No derivative data file found to delete. [2025-09-14T16:44:33.940625] [INFO ] [MAIN ] Update Progress: 76/2370 symbols completed. AL took 21.0s. Estimated remaining: 3h 42m 29s. Rate: 10.3 symbols/min [2025-09-14T16:44:34.115190] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:44:34.131095] [DEBUG] [LOCAL ] ALE: Loaded 14802 existing records from primary storage. [2025-09-14T16:44:34.131246] [INFO ] [MAIN ] ALE: Loaded 14802 existing records. [2025-09-14T16:44:34.163987] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-14T16:44:34.315018] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:44:34.315457] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-09-14T16:44:34.315587] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-14T16:44:34.316116] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-09-14T16:44:34.316179] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-09-14T16:44:34.551485] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T16:44:34.572543] [INFO ] [REMOTE ] AKA: Full fetch complete (1783 records). [2025-09-14T16:44:34.596990] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-14T16:44:34.803186] [INFO ] [REMOTE ] ALE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:44:34.809490] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-14T16:44:34.898860] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-14T16:44:34.899292] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:44:34.899347] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:44:34.899403] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-14T16:44:34.899490] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-14T16:44:34.899539] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-14T16:44:34.899679] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-14T16:44:34.899770] [INFO ] [MAIN ] Update Progress: 77/2370 symbols completed. AKA took 35.1s. Estimated remaining: 3h 39m 58s. Rate: 10.4 symbols/min [2025-09-14T16:44:34.958778] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-09-14T16:44:35.758847] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-09-14T16:44:36.135510] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T16:44:36.558896] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-09-14T16:44:37.358789] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-09-14T16:44:37.753283] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-14T16:44:38.088398] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-14T16:44:38.158783] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-09-14T16:44:38.856857] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T16:44:38.958874] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-09-14T16:44:39.507016] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-14T16:44:39.758855] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-09-14T16:44:40.403300] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-14T16:44:40.558811] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-09-14T16:44:41.358927] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-09-14T16:44:42.130986] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-14T16:44:42.158810] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-09-14T16:44:42.194900] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T16:44:42.539918] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-14T16:44:42.630355] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T16:44:42.636172] [INFO ] [REMOTE ] ALB: Full fetch complete (57870 records). [2025-09-14T16:44:42.636362] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-09-14T16:44:42.964040] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-09-14T16:44:43.041800] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-09-14T16:44:43.041936] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-09-14T16:44:43.042753] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-09-14T16:44:43.042835] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-09-14T16:44:43.044681] [DEBUG] [LOCAL ] ALB: Trimmed 57870 records to 40199 (keeping 150 days of data) [2025-09-14T16:44:43.308705] [DEBUG] [LOCAL ] ALB: Primary data saved (40199 records). [2025-09-14T16:44:43.308916] [INFO ] [MAIN ] ALB: Full history saved. [2025-09-14T16:44:43.309030] [INFO ] [MAIN ] Update Progress: 78/2370 symbols completed. ALB took 22.7s. Estimated remaining: 3h 41m 11s. Rate: 10.4 symbols/min [2025-09-14T16:44:43.758911] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-09-14T16:44:44.978479] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T16:44:44.984694] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-09-14T16:44:45.027290] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-14T16:44:45.358930] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-09-14T16:44:46.292772] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T16:44:46.301000] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-09-14T16:44:46.788626] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-14T16:44:46.794384] [INFO ] [REMOTE ] ALC: Full fetch complete (55353 records). [2025-09-14T16:44:46.794563] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-09-14T16:44:47.188023] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-09-14T16:44:47.188155] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-09-14T16:44:47.188799] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-09-14T16:44:47.188871] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-09-14T16:44:47.190257] [DEBUG] [LOCAL ] ALC: Trimmed 55353 records to 38195 (keeping 150 days of data) [2025-09-14T16:44:47.431811] [DEBUG] [LOCAL ] ALC: Primary data saved (38195 records). [2025-09-14T16:44:47.431998] [INFO ] [MAIN ] ALC: Full history saved. [2025-09-14T16:44:47.432192] [INFO ] [MAIN ] Update Progress: 79/2370 symbols completed. ALC took 25.8s. Estimated remaining: 3h 40m 17s. Rate: 10.4 symbols/min [2025-09-14T16:44:47.736470] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T16:44:47.744771] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-09-14T16:44:48.361363] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T16:44:48.365208] [INFO ] [REMOTE ] ALE: Full fetch complete (31751 records). [2025-09-14T16:44:48.365348] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-09-14T16:44:48.761541] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-09-14T16:44:48.761726] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-09-14T16:44:48.762184] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-09-14T16:44:48.762246] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-09-14T16:44:48.763598] [DEBUG] [LOCAL ] ALE: Trimmed 31751 records to 22557 (keeping 150 days of data) [2025-09-14T16:44:48.912333] [DEBUG] [LOCAL ] ALE: Primary data saved (22557 records). [2025-09-14T16:44:48.912582] [INFO ] [MAIN ] ALE: Full history saved. [2025-09-14T16:44:48.912747] [INFO ] [MAIN ] Update Progress: 80/2370 symbols completed. ALE took 15.0s. Estimated remaining: 3h 38m 8s. Rate: 10.5 symbols/min [2025-09-14T16:44:49.639197] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:44:49.635006] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:44:49.671820] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:44:49.695708] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:44:49.711818] [DEBUG] [LOCAL ] ALEX: Loaded 12990 existing records from primary storage. [2025-09-14T16:44:49.712252] [INFO ] [MAIN ] ALEX: Loaded 12990 existing records. [2025-09-14T16:44:49.722096] [DEBUG] [LOCAL ] ALG: Loaded 4373 existing records from primary storage. [2025-09-14T16:44:49.769286] [INFO ] [MAIN ] ALG: Loaded 4373 existing records. [2025-09-14T16:44:49.925238] [DEBUG] [LOCAL ] ALIT: Loaded 23581 existing records from primary storage. [2025-09-14T16:44:50.008112] [INFO ] [MAIN ] ALIT: Loaded 23581 existing records. [2025-09-14T16:44:50.060853] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:44:50.023681] [DEBUG] [LOCAL ] ALK: Loaded 23595 existing records from primary storage. [2025-09-14T16:44:50.110432] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-09-14T16:44:50.110268] [INFO ] [MAIN ] ALK: Loaded 23595 existing records. [2025-09-14T16:44:50.154110] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-14T16:44:50.324846] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:44:50.315102] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-09-14T16:44:50.367887] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-09-14T16:44:50.371697] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-09-14T16:44:50.438572] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-09-14T16:44:50.463089] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:44:50.468408] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-09-14T16:44:50.503250] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-09-14T16:44:50.659750] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:44:50.625528] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-09-14T16:44:50.704350] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-09-14T16:44:50.735499] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-09-14T16:44:50.795241] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-14T16:44:50.795088] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-09-14T16:44:50.917199] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-09-14T16:44:50.958109] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-09-14T16:44:51.051512] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-09-14T16:44:51.445725] [INFO ] [REMOTE ] ALG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:44:51.413344] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:44:51.446440] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-09-14T16:44:51.446958] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-09-14T16:44:51.950366] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:44:51.967815] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-09-14T16:44:51.971349] [INFO ] [REMOTE ] ALK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:44:51.972768] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-09-14T16:44:52.395453] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-14T16:44:52.401036] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-09-14T16:44:52.460189] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-14T16:44:52.463493] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-09-14T16:44:53.212551] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-14T16:44:53.216179] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-09-14T16:44:53.660255] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T16:44:53.670749] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-09-14T16:44:53.739625] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T16:44:53.828222] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T16:44:53.845329] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-14T16:44:54.158879] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-09-14T16:44:54.958934] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-09-14T16:44:55.174671] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T16:44:55.505457] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-14T16:44:55.659666] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T16:44:55.758855] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-09-14T16:44:56.558839] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-09-14T16:44:57.358852] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-09-14T16:44:57.635357] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T16:44:58.158836] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-09-14T16:44:58.499576] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T16:44:58.869709] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T16:44:58.958818] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-09-14T16:44:59.704377] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T16:44:59.758782] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-09-14T16:44:59.884771] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-14T16:45:00.558841] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-09-14T16:45:01.219012] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-14T16:45:01.358829] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-09-14T16:45:02.134537] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-14T16:45:02.158841] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-09-14T16:45:02.913454] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T16:45:02.958836] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-09-14T16:45:03.081881] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-14T16:45:03.758859] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-09-14T16:45:04.558840] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-09-14T16:45:04.934372] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-14T16:45:05.104057] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T16:45:05.187681] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-14T16:45:05.358846] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-09-14T16:45:06.158834] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-09-14T16:45:06.958815] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-09-14T16:45:07.092095] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T16:45:07.758849] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-09-14T16:45:08.010133] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T16:45:08.068320] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T16:45:08.558868] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-09-14T16:45:08.782921] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-09-14T16:45:08.784954] [INFO ] [REMOTE ] ALG: Full fetch complete (11833 records). [2025-09-14T16:45:08.785101] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-09-14T16:45:09.173971] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-09-14T16:45:09.174087] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-09-14T16:45:09.174372] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-09-14T16:45:09.174434] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-09-14T16:45:09.174975] [DEBUG] [LOCAL ] ALG: Trimmed 11833 records to 7527 (keeping 150 days of data) [2025-09-14T16:45:09.226677] [DEBUG] [LOCAL ] ALG: Primary data saved (7527 records). [2025-09-14T16:45:09.226844] [INFO ] [MAIN ] ALG: Full history saved. [2025-09-14T16:45:09.226978] [INFO ] [MAIN ] Update Progress: 81/2370 symbols completed. ALG took 20.3s. Estimated remaining: 3h 44m 55s. Rate: 10.2 symbols/min [2025-09-14T16:45:09.366836] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-09-14T16:45:09.399378] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:45:09.415959] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-14T16:45:09.422868] [INFO ] [REMOTE ] ALIT: Full fetch complete (57375 records). [2025-09-14T16:45:09.423123] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-09-14T16:45:09.576920] [DEBUG] [LOCAL ] ALL: Loaded 22425 existing records from primary storage. [2025-09-14T16:45:09.610190] [INFO ] [MAIN ] ALL: Loaded 22425 existing records. [2025-09-14T16:45:10.042973] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:45:10.043180] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-09-14T16:45:10.043493] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-09-14T16:45:10.043384] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-09-14T16:45:10.043603] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-09-14T16:45:10.044531] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-09-14T16:45:10.044747] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-09-14T16:45:10.045524] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-09-14T16:45:10.045794] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-09-14T16:45:10.120857] [DEBUG] [LOCAL ] ALIT: Trimmed 57375 records to 39630 (keeping 150 days of data) [2025-09-14T16:45:10.216728] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-09-14T16:45:10.544735] [INFO ] [REMOTE ] ALL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:45:10.566134] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-14T16:45:10.715596] [DEBUG] [LOCAL ] ALIT: Primary data saved (39630 records). [2025-09-14T16:45:10.715828] [INFO ] [MAIN ] ALIT: Full history saved. [2025-09-14T16:45:10.715950] [INFO ] [MAIN ] Update Progress: 82/2370 symbols completed. ALIT took 21.8s. Estimated remaining: 3h 42m 46s. Rate: 10.3 symbols/min [2025-09-14T16:45:10.888142] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:45:10.913110] [DEBUG] [LOCAL ] ALLE: Loaded 19831 existing records from primary storage. [2025-09-14T16:45:10.913307] [INFO ] [MAIN ] ALLE: Loaded 19831 existing records. [2025-09-14T16:45:10.970760] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-09-14T16:45:11.102521] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:45:11.102817] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-09-14T16:45:11.102882] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-09-14T16:45:11.103484] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-09-14T16:45:11.103550] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-09-14T16:45:11.479879] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:45:11.758808] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-09-14T16:45:12.241927] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-14T16:45:12.368694] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T16:45:12.372605] [INFO ] [REMOTE ] ALEX: Full fetch complete (33412 records). [2025-09-14T16:45:12.372832] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-09-14T16:45:12.565944] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-09-14T16:45:12.778515] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-09-14T16:45:12.802633] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-09-14T16:45:12.803275] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-09-14T16:45:12.803404] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-09-14T16:45:12.805286] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-14T16:45:12.816058] [DEBUG] [LOCAL ] ALEX: Trimmed 33412 records to 22143 (keeping 150 days of data) [2025-09-14T16:45:12.964632] [DEBUG] [LOCAL ] ALEX: Primary data saved (22143 records). [2025-09-14T16:45:12.964925] [INFO ] [MAIN ] ALEX: Full history saved. [2025-09-14T16:45:12.965092] [INFO ] [MAIN ] Update Progress: 83/2370 symbols completed. ALEX took 24.1s. Estimated remaining: 3h 41m 1s. Rate: 10.3 symbols/min [2025-09-14T16:45:13.148507] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:45:13.176669] [DEBUG] [LOCAL ] ALLY: Loaded 23761 existing records from primary storage. [2025-09-14T16:45:13.176938] [INFO ] [MAIN ] ALLY: Loaded 23761 existing records. [2025-09-14T16:45:13.355218] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:45:13.355489] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-09-14T16:45:13.355556] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-09-14T16:45:13.356584] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-09-14T16:45:13.356928] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-09-14T16:45:13.369710] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-09-14T16:45:13.730387] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:45:14.158846] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-09-14T16:45:14.777416] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-14T16:45:14.958849] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-09-14T16:45:15.561865] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-14T16:45:15.606365] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T16:45:15.612335] [INFO ] [REMOTE ] ALK: Full fetch complete (57645 records). [2025-09-14T16:45:15.612500] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-09-14T16:45:15.763931] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-09-14T16:45:16.005315] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-09-14T16:45:16.005444] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-09-14T16:45:16.006126] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-09-14T16:45:16.006191] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-09-14T16:45:16.007982] [DEBUG] [LOCAL ] ALK: Trimmed 57645 records to 39879 (keeping 150 days of data) [2025-09-14T16:45:16.250710] [DEBUG] [LOCAL ] ALK: Primary data saved (39879 records). [2025-09-14T16:45:16.250893] [INFO ] [MAIN ] ALK: Full history saved. [2025-09-14T16:45:16.251009] [INFO ] [MAIN ] Update Progress: 84/2370 symbols completed. ALK took 27.3s. Estimated remaining: 3h 39m 47s. Rate: 10.4 symbols/min [2025-09-14T16:45:16.424998] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:45:16.454263] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-14T16:45:16.479859] [DEBUG] [LOCAL ] ALSN: Loaded 19789 existing records from primary storage. [2025-09-14T16:45:16.480063] [INFO ] [MAIN ] ALSN: Loaded 19789 existing records. [2025-09-14T16:45:16.563959] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-09-14T16:45:16.662976] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:45:16.663271] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-09-14T16:45:16.663333] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-09-14T16:45:16.663945] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-09-14T16:45:16.664008] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-09-14T16:45:17.022416] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:45:17.358838] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-09-14T16:45:17.661156] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-14T16:45:18.158808] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-09-14T16:45:18.679082] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-14T16:45:18.967763] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-09-14T16:45:18.973790] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T16:45:19.549453] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T16:45:19.758865] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-09-14T16:45:20.558873] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-09-14T16:45:20.719393] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T16:45:21.358865] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-09-14T16:45:21.608302] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T16:45:22.100796] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-14T16:45:22.158854] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-09-14T16:45:22.965018] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-09-14T16:45:22.971553] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-14T16:45:23.758870] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-09-14T16:45:24.132536] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-14T16:45:24.558843] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-09-14T16:45:24.764744] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T16:45:25.358827] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-09-14T16:45:25.546200] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T16:45:26.035253] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T16:45:26.158819] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-09-14T16:45:26.767581] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-14T16:45:26.958887] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-09-14T16:45:27.758825] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-09-14T16:45:27.819270] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-14T16:45:28.201293] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-14T16:45:28.558905] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-09-14T16:45:29.195503] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-14T16:45:29.358847] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-09-14T16:45:30.158812] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-09-14T16:45:30.599697] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-14T16:45:30.958883] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-09-14T16:45:31.292713] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-14T16:45:31.504541] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T16:45:31.758859] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-09-14T16:45:32.372779] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T16:45:32.558876] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-09-14T16:45:33.132631] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T16:45:33.358840] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-09-14T16:45:34.158842] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-09-14T16:45:34.239262] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T16:45:34.798290] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T16:45:34.804252] [INFO ] [REMOTE ] ALL: Full fetch complete (54509 records). [2025-09-14T16:45:34.804407] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-09-14T16:45:34.961035] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-09-14T16:45:35.213450] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-09-14T16:45:35.213697] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-09-14T16:45:35.214372] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-09-14T16:45:35.214443] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-09-14T16:45:35.240148] [DEBUG] [LOCAL ] ALL: Trimmed 54509 records to 37481 (keeping 150 days of data) [2025-09-14T16:45:35.241052] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T16:45:35.381359] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-14T16:45:35.389565] [INFO ] [REMOTE ] ALLY: Full fetch complete (57839 records). [2025-09-14T16:45:35.390764] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-09-14T16:45:35.761502] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-09-14T16:45:35.807021] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-09-14T16:45:35.807824] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-09-14T16:45:35.809259] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-09-14T16:45:35.809399] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-09-14T16:45:35.813750] [DEBUG] [LOCAL ] ALLY: Trimmed 57839 records to 40000 (keeping 150 days of data) [2025-09-14T16:45:36.052218] [DEBUG] [LOCAL ] ALL: Primary data saved (37481 records). [2025-09-14T16:45:36.053322] [INFO ] [MAIN ] ALL: Full history saved. [2025-09-14T16:45:36.053678] [INFO ] [MAIN ] Update Progress: 85/2370 symbols completed. ALL took 26.8s. Estimated remaining: 3h 45m 58s. Rate: 10.1 symbols/min [2025-09-14T16:45:36.316803] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:45:36.340394] [DEBUG] [LOCAL ] ALTG: Loaded 11273 existing records from primary storage. [2025-09-14T16:45:36.341525] [INFO ] [MAIN ] ALTG: Loaded 11273 existing records. [2025-09-14T16:45:36.555035] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:45:36.557073] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-09-14T16:45:36.558048] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-09-14T16:45:36.559691] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-09-14T16:45:36.561035] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-09-14T16:45:36.559526] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-09-14T16:45:36.676007] [DEBUG] [LOCAL ] ALLY: Primary data saved (40000 records). [2025-09-14T16:45:36.678492] [INFO ] [MAIN ] ALLY: Full history saved. [2025-09-14T16:45:36.689448] [INFO ] [MAIN ] Update Progress: 86/2370 symbols completed. ALLY took 23.7s. Estimated remaining: 3h 43m 32s. Rate: 10.2 symbols/min [2025-09-14T16:45:37.151169] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:45:37.153481] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:45:37.162234] [DEBUG] [LOCAL ] ALUR: Loaded 3785 existing records from primary storage. [2025-09-14T16:45:37.162364] [INFO ] [MAIN ] ALUR: Loaded 3785 existing records. [2025-09-14T16:45:37.338276] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:45:37.338552] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-09-14T16:45:37.338614] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-14T16:45:37.338961] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-09-14T16:45:37.339023] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-09-14T16:45:37.369395] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-09-14T16:45:37.710579] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:45:37.745340] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-14T16:45:38.158801] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-09-14T16:45:38.389875] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T16:45:38.438747] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-09-14T16:45:38.443181] [INFO ] [REMOTE ] ALLE: Full fetch complete (49510 records). [2025-09-14T16:45:38.443330] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-09-14T16:45:38.767860] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-14T16:45:38.842264] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-09-14T16:45:38.842370] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-09-14T16:45:38.842884] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-09-14T16:45:38.842943] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-09-14T16:45:38.844048] [DEBUG] [LOCAL ] ALLE: Trimmed 49510 records to 33449 (keeping 150 days of data) [2025-09-14T16:45:38.963342] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-09-14T16:45:39.056069] [DEBUG] [LOCAL ] ALLE: Primary data saved (33449 records). [2025-09-14T16:45:39.056255] [INFO ] [MAIN ] ALLE: Full history saved. [2025-09-14T16:45:39.056363] [INFO ] [MAIN ] Update Progress: 87/2370 symbols completed. ALLE took 28.3s. Estimated remaining: 3h 41m 54s. Rate: 10.3 symbols/min [2025-09-14T16:45:39.226128] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:45:39.247428] [DEBUG] [LOCAL ] ALV: Loaded 19075 existing records from primary storage. [2025-09-14T16:45:39.247602] [INFO ] [MAIN ] ALV: Loaded 19075 existing records. [2025-09-14T16:45:39.425350] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:45:39.425617] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-09-14T16:45:39.425694] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-09-14T16:45:39.426374] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-09-14T16:45:39.426436] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-09-14T16:45:39.761059] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-09-14T16:45:39.782704] [INFO ] [REMOTE ] ALV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:45:40.057447] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-14T16:45:40.558845] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-09-14T16:45:41.071675] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-14T16:45:41.077440] [INFO ] [REMOTE ] ALSN: Full fetch complete (47498 records). [2025-09-14T16:45:41.077598] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-09-14T16:45:41.363929] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-09-14T16:45:41.481433] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-09-14T16:45:41.481574] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-09-14T16:45:41.482113] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-09-14T16:45:41.482175] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-09-14T16:45:41.483532] [DEBUG] [LOCAL ] ALSN: Trimmed 47498 records to 32125 (keeping 150 days of data) [2025-09-14T16:45:41.684866] [DEBUG] [LOCAL ] ALSN: Primary data saved (32125 records). [2025-09-14T16:45:41.685053] [INFO ] [MAIN ] ALSN: Full history saved. [2025-09-14T16:45:41.685160] [INFO ] [MAIN ] Update Progress: 88/2370 symbols completed. ALSN took 25.4s. Estimated remaining: 3h 40m 25s. Rate: 10.4 symbols/min [2025-09-14T16:45:41.868065] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:45:41.899233] [DEBUG] [LOCAL ] ALX: Loaded 3868 existing records from primary storage. [2025-09-14T16:45:41.901597] [INFO ] [MAIN ] ALX: Loaded 3868 existing records. [2025-09-14T16:45:41.901487] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T16:45:42.100736] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:45:42.100993] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-09-14T16:45:42.101053] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-09-14T16:45:42.101336] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-09-14T16:45:42.101395] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-09-14T16:45:42.164909] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-09-14T16:45:42.518402] [INFO ] [REMOTE ] ALX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:45:42.574872] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T16:45:42.958891] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-09-14T16:45:43.188920] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T16:45:43.497737] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-14T16:45:43.758853] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-09-14T16:45:44.558834] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-09-14T16:45:45.126217] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-14T16:45:45.358818] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-09-14T16:45:45.830669] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T16:45:46.158862] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-09-14T16:45:46.376563] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T16:45:46.701059] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-14T16:45:46.958855] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-09-14T16:45:47.758982] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-09-14T16:45:48.031715] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T16:45:48.559030] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-09-14T16:45:49.102863] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-14T16:45:49.358924] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-09-14T16:45:49.519335] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-14T16:45:49.934953] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-14T16:45:50.158840] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-09-14T16:45:50.958822] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-09-14T16:45:51.387227] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-14T16:45:51.425068] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-14T16:45:51.758844] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-09-14T16:45:52.558869] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-09-14T16:45:53.253342] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-14T16:45:53.358819] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-09-14T16:45:53.664176] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-14T16:45:54.158850] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-09-14T16:45:54.395853] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-14T16:45:54.958869] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-09-14T16:45:55.662856] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T16:45:55.744064] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-14T16:45:55.747506] [INFO ] [REMOTE ] ALTG: Full fetch complete (26054 records). [2025-09-14T16:45:55.747636] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-09-14T16:45:55.764059] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-09-14T16:45:56.116951] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-09-14T16:45:56.117087] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-09-14T16:45:56.117454] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-09-14T16:45:56.117513] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-09-14T16:45:56.118520] [DEBUG] [LOCAL ] ALTG: Trimmed 26054 records to 17492 (keeping 150 days of data) [2025-09-14T16:45:56.223191] [DEBUG] [LOCAL ] ALTG: Primary data saved (17492 records). [2025-09-14T16:45:56.223409] [INFO ] [MAIN ] ALTG: Full history saved. [2025-09-14T16:45:56.223549] [INFO ] [MAIN ] Update Progress: 89/2370 symbols completed. ALTG took 20.2s. Estimated remaining: 3h 44m 3s. Rate: 10.2 symbols/min [2025-09-14T16:45:56.401210] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:45:56.425691] [DEBUG] [LOCAL ] AM: Loaded 23179 existing records from primary storage. [2025-09-14T16:45:56.425872] [INFO ] [MAIN ] AM: Loaded 23179 existing records. [2025-09-14T16:45:56.570907] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-09-14T16:45:56.610497] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:45:56.610789] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-09-14T16:45:56.610883] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-09-14T16:45:56.611597] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-09-14T16:45:56.611690] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-09-14T16:45:56.920851] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-14T16:45:56.996202] [INFO ] [REMOTE ] AM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:45:57.358844] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-09-14T16:45:58.087207] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-14T16:45:58.158837] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-09-14T16:45:58.343409] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T16:45:58.958838] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-09-14T16:45:59.758807] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-09-14T16:45:59.849883] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T16:46:00.511564] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-14T16:46:00.558802] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-09-14T16:46:00.607451] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-14T16:46:01.358831] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-09-14T16:46:01.395040] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-14T16:46:02.158837] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-09-14T16:46:02.230111] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-14T16:46:02.958834] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-09-14T16:46:03.758837] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-09-14T16:46:03.780821] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T16:46:04.050245] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-14T16:46:04.072450] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T16:46:04.076827] [INFO ] [REMOTE ] ALV: Full fetch complete (46917 records). [2025-09-14T16:46:04.076951] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-09-14T16:46:04.451234] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-09-14T16:46:04.451406] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-09-14T16:46:04.452182] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-09-14T16:46:04.452258] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-09-14T16:46:04.454019] [DEBUG] [LOCAL ] ALV: Trimmed 46917 records to 31582 (keeping 150 days of data) [2025-09-14T16:46:04.559319] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-09-14T16:46:04.673296] [DEBUG] [LOCAL ] ALV: Primary data saved (31582 records). [2025-09-14T16:46:04.673521] [INFO ] [MAIN ] ALV: Full history saved. [2025-09-14T16:46:04.673738] [INFO ] [MAIN ] Update Progress: 90/2370 symbols completed. ALV took 25.6s. Estimated remaining: 3h 45m 2s. Rate: 10.1 symbols/min [2025-09-14T16:46:04.849129] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:46:04.867174] [DEBUG] [LOCAL ] AMBC: Loaded 15715 existing records from primary storage. [2025-09-14T16:46:04.867370] [INFO ] [MAIN ] AMBC: Loaded 15715 existing records. [2025-09-14T16:46:05.042594] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:46:05.042854] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-09-14T16:46:05.042993] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-09-14T16:46:05.043861] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-09-14T16:46:05.043937] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-09-14T16:46:05.261212] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T16:46:05.311144] [INFO ] [REMOTE ] ALUR: Full fetch complete (13305 records). [2025-09-14T16:46:05.331685] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-09-14T16:46:05.364083] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-09-14T16:46:05.499902] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:46:05.774477] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-09-14T16:46:05.774587] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-09-14T16:46:05.774874] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-09-14T16:46:05.774930] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-09-14T16:46:05.775459] [DEBUG] [LOCAL ] ALUR: Trimmed 13305 records to 7481 (keeping 150 days of data) [2025-09-14T16:46:05.819473] [DEBUG] [LOCAL ] ALUR: Primary data saved (7481 records). [2025-09-14T16:46:05.819634] [INFO ] [MAIN ] ALUR: Full history saved. [2025-09-14T16:46:05.819758] [INFO ] [MAIN ] Update Progress: 91/2370 symbols completed. ALUR took 29.1s. Estimated remaining: 3h 42m 57s. Rate: 10.2 symbols/min [2025-09-14T16:46:05.993997] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:46:05.997446] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T16:46:05.999218] [INFO ] [REMOTE ] ALX: Full fetch complete (5844 records). [2025-09-14T16:46:05.999314] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-09-14T16:46:06.163968] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-09-14T16:46:06.226245] [DEBUG] [LOCAL ] AMBP: Loaded 19703 existing records from primary storage. [2025-09-14T16:46:06.259968] [INFO ] [MAIN ] AMBP: Loaded 19703 existing records. [2025-09-14T16:46:06.479951] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-09-14T16:46:06.485576] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-09-14T16:46:06.501209] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-09-14T16:46:06.535778] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-09-14T16:46:06.557709] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:46:06.558133] [DEBUG] [LOCAL ] ALX: Trimmed 5844 records to 5134 (keeping 150 days of data) [2025-09-14T16:46:06.558298] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-09-14T16:46:06.558694] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-09-14T16:46:06.559278] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-09-14T16:46:06.559352] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-09-14T16:46:06.935362] [DEBUG] [LOCAL ] ALX: Primary data saved (5134 records). [2025-09-14T16:46:06.938923] [INFO ] [MAIN ] ALX: Full history saved. [2025-09-14T16:46:06.957393] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:46:06.957556] [INFO ] [MAIN ] Update Progress: 92/2370 symbols completed. ALX took 25.3s. Estimated remaining: 3h 40m 54s. Rate: 10.3 symbols/min [2025-09-14T16:46:06.978124] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-09-14T16:46:07.134063] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:46:07.143530] [DEBUG] [LOCAL ] AMBQ: Loaded 6757 existing records from primary storage. [2025-09-14T16:46:07.143748] [INFO ] [MAIN ] AMBQ: Loaded 6757 existing records. [2025-09-14T16:46:07.319343] [WARN ] [MAIN ] AMBQ: Insufficient historical data. Have data from 2025-07-30, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:46:07.319612] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-14T16:46:07.319689] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-14T16:46:07.320023] [DEBUG] [LOCAL ] AMBQ: Deleted primary data file. [2025-09-14T16:46:07.320087] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-14T16:46:07.672182] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:46:07.688968] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T16:46:07.758798] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-02. [2025-09-14T16:46:08.011719] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:46:08.012064] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-02 [2025-09-14T16:46:08.559222] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-09-14T16:46:08.559155] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T16:46:09.358898] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-03. [2025-09-14T16:46:09.609717] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:46:09.610070] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-03 [2025-09-14T16:46:10.158871] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-09-14T16:46:10.217974] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-14T16:46:10.958842] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-09-14T16:46:11.758901] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-04. [2025-09-14T16:46:12.028576] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:46:12.029039] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-04 [2025-09-14T16:46:12.060534] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-14T16:46:12.351065] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-14T16:46:12.558864] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-05. [2025-09-14T16:46:12.841845] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:46:12.842346] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-05 [2025-09-14T16:46:13.358847] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-09-14T16:46:14.158866] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-09-14T16:46:14.865734] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T16:46:14.958856] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-09-14T16:46:15.702848] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T16:46:15.758773] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-09-14T16:46:16.058529] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-14T16:46:16.558832] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-06. [2025-09-14T16:46:16.819322] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:46:16.819704] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-06 [2025-09-14T16:46:17.267806] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T16:46:17.358897] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-09-14T16:46:18.158843] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-09-14T16:46:18.810083] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-14T16:46:18.958835] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-09-14T16:46:19.758871] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-09-14T16:46:19.970177] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-14T16:46:20.350037] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-14T16:46:20.558871] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-09-14T16:46:21.190594] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-14T16:46:21.358842] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-09-14T16:46:21.834196] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-14T16:46:22.158864] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-07. [2025-09-14T16:46:22.745611] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T16:46:22.828245] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-14T16:46:22.958817] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-09-14T16:46:23.211910] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-09-14T16:46:23.215440] [INFO ] [REMOTE ] AMBC: Full fetch complete (40605 records). [2025-09-14T16:46:23.215571] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-09-14T16:46:23.581317] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-09-14T16:46:23.581422] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-09-14T16:46:23.581892] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-09-14T16:46:23.581947] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-09-14T16:46:23.582863] [DEBUG] [LOCAL ] AMBC: Trimmed 40605 records to 27132 (keeping 150 days of data) [2025-09-14T16:46:23.738741] [DEBUG] [LOCAL ] AMBC: Primary data saved (27132 records). [2025-09-14T16:46:23.738935] [INFO ] [MAIN ] AMBC: Full history saved. [2025-09-14T16:46:23.739071] [INFO ] [MAIN ] Update Progress: 93/2370 symbols completed. AMBC took 19.1s. Estimated remaining: 3h 45m 16s. Rate: 10.1 symbols/min [2025-09-14T16:46:23.768685] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-09-14T16:46:23.912170] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:46:23.935895] [DEBUG] [LOCAL ] AMC: Loaded 24163 existing records from primary storage. [2025-09-14T16:46:23.936080] [INFO ] [MAIN ] AMC: Loaded 24163 existing records. [2025-09-14T16:46:24.112124] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:46:24.112398] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-09-14T16:46:24.112487] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-09-14T16:46:24.113143] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-09-14T16:46:24.113219] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-09-14T16:46:24.468047] [INFO ] [REMOTE ] AMC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:46:24.558811] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-09-14T16:46:25.358832] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-08. [2025-09-14T16:46:25.520822] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T16:46:26.158907] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-09-14T16:46:26.789617] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-14T16:46:26.859107] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T16:46:26.866025] [INFO ] [REMOTE ] AM: Full fetch complete (56821 records). [2025-09-14T16:46:26.896453] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-09-14T16:46:26.933597] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-14T16:46:26.964662] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-09. [2025-09-14T16:46:27.317690] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-09-14T16:46:27.317800] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-09-14T16:46:27.318374] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-09-14T16:46:27.318439] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-09-14T16:46:27.319715] [DEBUG] [LOCAL ] AM: Trimmed 56821 records to 39021 (keeping 150 days of data) [2025-09-14T16:46:27.559152] [DEBUG] [LOCAL ] AM: Primary data saved (39021 records). [2025-09-14T16:46:27.559337] [INFO ] [MAIN ] AM: Full history saved. [2025-09-14T16:46:27.559439] [INFO ] [MAIN ] Update Progress: 94/2370 symbols completed. AM took 31.3s. Estimated remaining: 3h 44m 19s. Rate: 10.1 symbols/min [2025-09-14T16:46:27.732444] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:46:27.755420] [DEBUG] [LOCAL ] AMCR: Loaded 24035 existing records from primary storage. [2025-09-14T16:46:27.755601] [INFO ] [MAIN ] AMCR: Loaded 24035 existing records. [2025-09-14T16:46:27.766761] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-09-14T16:46:27.940991] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:46:27.941300] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-09-14T16:46:27.941377] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-09-14T16:46:27.942151] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-09-14T16:46:27.942217] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-09-14T16:46:28.283782] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-14T16:46:28.303967] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:46:28.307458] [INFO ] [REMOTE ] AMBQ: Full fetch complete (6736 records). [2025-09-14T16:46:28.307575] [DEBUG] [VALIDATOR ] AMBQ: Validating primary data. [2025-09-14T16:46:28.489417] [WARN ] [VALIDATOR ] AMBQ: Validation failed - insufficient historical data. Have 32 unique days, need 150 days [2025-09-14T16:46:28.489690] [FATAL] [MAIN ] AMBQ: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:46:28.489746] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:46:28.489802] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-14T16:46:28.489871] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-14T16:46:28.489920] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-14T16:46:28.489970] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-14T16:46:28.490093] [INFO ] [MAIN ] Update Progress: 95/2370 symbols completed. AMBQ took 21.5s. Estimated remaining: 3h 42m 14s. Rate: 10.2 symbols/min [2025-09-14T16:46:28.563906] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-09-14T16:46:28.670717] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:46:28.697257] [DEBUG] [LOCAL ] AME: Loaded 21800 existing records from primary storage. [2025-09-14T16:46:28.697505] [INFO ] [MAIN ] AME: Loaded 21800 existing records. [2025-09-14T16:46:28.886336] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:46:28.886696] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-09-14T16:46:28.886766] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-09-14T16:46:28.887536] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-09-14T16:46:28.887618] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-09-14T16:46:29.253000] [INFO ] [REMOTE ] AME: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:46:29.358854] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-09-14T16:46:30.154093] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T16:46:30.162804] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-09-14T16:46:30.196663] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-09-14T16:46:30.958868] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-09-14T16:46:31.173137] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T16:46:31.598541] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T16:46:31.758841] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-09-14T16:46:32.558847] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-09-14T16:46:33.176153] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-14T16:46:33.358848] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-09-14T16:46:33.711043] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T16:46:34.158855] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-09-14T16:46:34.374518] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T16:46:34.958832] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-09-14T16:46:35.712920] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T16:46:35.758810] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-09-14T16:46:35.848279] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-14T16:46:36.354749] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-14T16:46:36.558830] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-09-14T16:46:37.303858] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-14T16:46:37.358785] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-09-14T16:46:38.158839] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-09-14T16:46:38.242110] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-14T16:46:38.622474] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-14T16:46:38.627569] [INFO ] [REMOTE ] AMBP: Full fetch complete (49456 records). [2025-09-14T16:46:38.627728] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-09-14T16:46:38.964093] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-09-14T16:46:39.036561] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-09-14T16:46:39.036770] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-09-14T16:46:39.037330] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-09-14T16:46:39.037388] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-09-14T16:46:39.038503] [DEBUG] [LOCAL ] AMBP: Trimmed 49456 records to 34048 (keeping 150 days of data) [2025-09-14T16:46:39.244857] [DEBUG] [LOCAL ] AMBP: Primary data saved (34048 records). [2025-09-14T16:46:39.245065] [INFO ] [MAIN ] AMBP: Full history saved. [2025-09-14T16:46:39.245181] [INFO ] [MAIN ] Update Progress: 96/2370 symbols completed. AMBP took 33.4s. Estimated remaining: 3h 44m 4s. Rate: 10.1 symbols/min [2025-09-14T16:46:39.416437] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:46:39.426043] [DEBUG] [LOCAL ] AMG: Loaded 8334 existing records from primary storage. [2025-09-14T16:46:39.426163] [INFO ] [MAIN ] AMG: Loaded 8334 existing records. [2025-09-14T16:46:39.600952] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:46:39.601236] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-09-14T16:46:39.601298] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-09-14T16:46:39.601688] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-09-14T16:46:39.601754] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-09-14T16:46:39.765465] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-09-14T16:46:39.971660] [INFO ] [REMOTE ] AMG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:46:40.002085] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T16:46:40.558867] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-09-14T16:46:40.712013] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T16:46:41.358833] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-09-14T16:46:41.686797] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T16:46:42.158857] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-09-14T16:46:42.393428] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-14T16:46:42.868461] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-14T16:46:42.958835] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-09-14T16:46:43.308490] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-14T16:46:43.758837] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-09-14T16:46:44.148045] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T16:46:44.558869] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-09-14T16:46:44.803746] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-14T16:46:45.358838] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-09-14T16:46:46.158836] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-09-14T16:46:46.588682] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T16:46:46.876724] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-14T16:46:46.958875] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-09-14T16:46:47.758859] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-09-14T16:46:48.060294] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T16:46:48.558851] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-09-14T16:46:48.751001] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T16:46:49.358845] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-09-14T16:46:49.382268] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T16:46:50.158819] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-09-14T16:46:50.201736] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-14T16:46:50.814011] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T16:46:50.821948] [INFO ] [REMOTE ] AMCR: Full fetch complete (58347 records). [2025-09-14T16:46:50.822083] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-09-14T16:46:50.964106] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-09-14T16:46:51.223662] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-09-14T16:46:51.223972] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-09-14T16:46:51.224901] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-09-14T16:46:51.225109] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-09-14T16:46:51.242948] [DEBUG] [LOCAL ] AMCR: Trimmed 58347 records to 40412 (keeping 150 days of data) [2025-09-14T16:46:51.255966] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T16:46:51.547859] [DEBUG] [LOCAL ] AMCR: Primary data saved (40412 records). [2025-09-14T16:46:51.548101] [INFO ] [MAIN ] AMCR: Full history saved. [2025-09-14T16:46:51.548287] [INFO ] [MAIN ] Update Progress: 97/2370 symbols completed. AMCR took 24.0s. Estimated remaining: 3h 46m 28s. Rate: 10.0 symbols/min [2025-09-14T16:46:51.741501] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:46:51.759949] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-09-14T16:46:51.773093] [DEBUG] [LOCAL ] AMH: Loaded 23144 existing records from primary storage. [2025-09-14T16:46:51.773342] [INFO ] [MAIN ] AMH: Loaded 23144 existing records. [2025-09-14T16:46:52.026267] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:46:52.026701] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-09-14T16:46:52.026774] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-09-14T16:46:52.027548] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-09-14T16:46:52.027618] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-09-14T16:46:52.407305] [INFO ] [REMOTE ] AMH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:46:52.423219] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T16:46:52.431277] [INFO ] [REMOTE ] AME: Full fetch complete (52757 records). [2025-09-14T16:46:52.431530] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-09-14T16:46:52.571957] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-09-14T16:46:52.824017] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-09-14T16:46:52.824129] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-09-14T16:46:52.824764] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-09-14T16:46:52.824827] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-09-14T16:46:52.827084] [DEBUG] [LOCAL ] AME: Trimmed 52757 records to 36349 (keeping 150 days of data) [2025-09-14T16:46:52.977420] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-14T16:46:52.987228] [INFO ] [REMOTE ] AMC: Full fetch complete (58432 records). [2025-09-14T16:46:53.032638] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-09-14T16:46:53.359592] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-09-14T16:46:53.490565] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-09-14T16:46:53.492510] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-09-14T16:46:53.493735] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-09-14T16:46:53.495407] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-09-14T16:46:53.498345] [DEBUG] [LOCAL ] AME: Primary data saved (36349 records). [2025-09-14T16:46:53.499034] [INFO ] [MAIN ] AME: Full history saved. [2025-09-14T16:46:53.499838] [INFO ] [MAIN ] Update Progress: 98/2370 symbols completed. AME took 25.0s. Estimated remaining: 3h 44m 48s. Rate: 10.1 symbols/min [2025-09-14T16:46:53.564728] [DEBUG] [LOCAL ] AMC: Trimmed 58432 records to 40510 (keeping 150 days of data) [2025-09-14T16:46:53.673912] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-14T16:46:53.786032] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:46:53.813804] [DEBUG] [LOCAL ] AMN: Loaded 19177 existing records from primary storage. [2025-09-14T16:46:53.815059] [INFO ] [MAIN ] AMN: Loaded 19177 existing records. [2025-09-14T16:46:54.007585] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:46:54.009759] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-09-14T16:46:54.010151] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-09-14T16:46:54.011297] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-09-14T16:46:54.012206] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-09-14T16:46:54.163570] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-09-14T16:46:54.477419] [INFO ] [REMOTE ] AMN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:46:54.506205] [DEBUG] [LOCAL ] AMC: Primary data saved (40510 records). [2025-09-14T16:46:54.506397] [INFO ] [MAIN ] AMC: Full history saved. [2025-09-14T16:46:54.506550] [INFO ] [MAIN ] Update Progress: 99/2370 symbols completed. AMC took 30.8s. Estimated remaining: 3h 42m 49s. Rate: 10.2 symbols/min [2025-09-14T16:46:54.691115] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:46:54.707469] [DEBUG] [LOCAL ] AMP: Loaded 13860 existing records from primary storage. [2025-09-14T16:46:54.707657] [INFO ] [MAIN ] AMP: Loaded 13860 existing records. [2025-09-14T16:46:54.882382] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:46:54.882709] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-09-14T16:46:54.882862] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-09-14T16:46:54.883411] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-09-14T16:46:54.883570] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-09-14T16:46:54.966051] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-09-14T16:46:55.202184] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-14T16:46:55.285054] [INFO ] [REMOTE ] AMP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:46:55.503961] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T16:46:55.758835] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-09-14T16:46:56.295749] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T16:46:56.558902] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-09-14T16:46:57.354042] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-14T16:46:57.364309] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-09-14T16:46:57.562282] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-14T16:46:58.092853] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-14T16:46:58.158854] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-09-14T16:46:58.958846] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-09-14T16:46:59.255422] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-14T16:46:59.258758] [INFO ] [REMOTE ] AMG: Full fetch complete (22461 records). [2025-09-14T16:46:59.258870] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-09-14T16:46:59.638293] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-09-14T16:46:59.638513] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-09-14T16:46:59.638987] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-09-14T16:46:59.639186] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-09-14T16:46:59.640254] [DEBUG] [LOCAL ] AMG: Trimmed 22461 records to 14731 (keeping 150 days of data) [2025-09-14T16:46:59.759345] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-09-14T16:46:59.768870] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-14T16:46:59.803659] [DEBUG] [LOCAL ] AMG: Primary data saved (14731 records). [2025-09-14T16:46:59.804063] [INFO ] [MAIN ] AMG: Full history saved. [2025-09-14T16:46:59.804217] [INFO ] [MAIN ] Update Progress: 100/2370 symbols completed. AMG took 20.6s. Estimated remaining: 3h 42m 30s. Rate: 10.2 symbols/min [2025-09-14T16:47:00.004793] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:47:00.042201] [DEBUG] [LOCAL ] AMPX: Loaded 23933 existing records from primary storage. [2025-09-14T16:47:00.042476] [INFO ] [MAIN ] AMPX: Loaded 23933 existing records. [2025-09-14T16:47:00.322585] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:47:00.323079] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-09-14T16:47:00.323173] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-09-14T16:47:00.324155] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-09-14T16:47:00.324255] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-09-14T16:47:00.564238] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-09-14T16:47:00.853218] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:47:01.358865] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-09-14T16:47:01.472128] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T16:47:02.107027] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-14T16:47:02.158821] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-09-14T16:47:02.958843] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-09-14T16:47:03.055658] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T16:47:03.583452] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-14T16:47:03.758835] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-09-14T16:47:04.199164] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-14T16:47:04.558890] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-09-14T16:47:05.358848] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-09-14T16:47:05.407739] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-14T16:47:05.984312] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-14T16:47:06.158829] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-09-14T16:47:06.950458] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T16:47:06.959608] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-09-14T16:47:07.312415] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T16:47:07.758830] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-09-14T16:47:08.309712] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-14T16:47:08.558862] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-09-14T16:47:09.358864] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-09-14T16:47:09.507552] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T16:47:09.542936] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-14T16:47:10.158888] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-09-14T16:47:10.942550] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-14T16:47:10.958783] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-09-14T16:47:11.308016] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T16:47:11.578383] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T16:47:11.582873] [INFO ] [REMOTE ] AMN: Full fetch complete (46201 records). [2025-09-14T16:47:11.583016] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-09-14T16:47:11.758824] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-09-14T16:47:11.964719] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-09-14T16:47:11.964838] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-09-14T16:47:11.965416] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-09-14T16:47:11.965495] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-09-14T16:47:11.966598] [DEBUG] [LOCAL ] AMN: Trimmed 46201 records to 31538 (keeping 150 days of data) [2025-09-14T16:47:12.148996] [DEBUG] [LOCAL ] AMN: Primary data saved (31538 records). [2025-09-14T16:47:12.149180] [INFO ] [MAIN ] AMN: Full history saved. [2025-09-14T16:47:12.149295] [INFO ] [MAIN ] Update Progress: 101/2370 symbols completed. AMN took 18.6s. Estimated remaining: 3h 44m 50s. Rate: 10.1 symbols/min [2025-09-14T16:47:12.321662] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:47:12.339374] [DEBUG] [LOCAL ] AMPY: Loaded 16195 existing records from primary storage. [2025-09-14T16:47:12.339543] [INFO ] [MAIN ] AMPY: Loaded 16195 existing records. [2025-09-14T16:47:12.519078] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:47:12.519412] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-09-14T16:47:12.519487] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-14T16:47:12.520027] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-09-14T16:47:12.520108] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-09-14T16:47:12.563949] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-09-14T16:47:12.883003] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:47:13.358808] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-09-14T16:47:13.729705] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-14T16:47:14.063736] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-14T16:47:14.158837] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-09-14T16:47:14.958877] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-09-14T16:47:15.208157] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-14T16:47:15.420582] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-14T16:47:15.424233] [INFO ] [REMOTE ] AMP: Full fetch complete (35689 records). [2025-09-14T16:47:15.424381] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-09-14T16:47:15.761248] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-09-14T16:47:15.800171] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-09-14T16:47:15.800337] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-09-14T16:47:15.800855] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-09-14T16:47:15.801007] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-09-14T16:47:15.802238] [DEBUG] [LOCAL ] AMP: Trimmed 35689 records to 23565 (keeping 150 days of data) [2025-09-14T16:47:15.926132] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T16:47:15.995711] [DEBUG] [LOCAL ] AMP: Primary data saved (23565 records). [2025-09-14T16:47:15.995904] [INFO ] [MAIN ] AMP: Full history saved. [2025-09-14T16:47:15.996052] [INFO ] [MAIN ] Update Progress: 102/2370 symbols completed. AMP took 21.5s. Estimated remaining: 3h 43m 57s. Rate: 10.1 symbols/min [2025-09-14T16:47:16.168291] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:47:16.185168] [DEBUG] [LOCAL ] AMR: Loaded 13475 existing records from primary storage. [2025-09-14T16:47:16.185352] [INFO ] [MAIN ] AMR: Loaded 13475 existing records. [2025-09-14T16:47:16.363818] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:47:16.364085] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-09-14T16:47:16.364148] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-09-14T16:47:16.364671] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-09-14T16:47:16.364751] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-09-14T16:47:16.567861] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-09-14T16:47:16.731684] [INFO ] [REMOTE ] AMR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:47:16.749114] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-14T16:47:17.358833] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-09-14T16:47:18.025336] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T16:47:18.031404] [INFO ] [REMOTE ] AMH: Full fetch complete (56136 records). [2025-09-14T16:47:18.031541] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-09-14T16:47:18.174793] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-09-14T16:47:18.416061] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-09-14T16:47:18.416171] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-09-14T16:47:18.416749] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-09-14T16:47:18.416812] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-09-14T16:47:18.418004] [DEBUG] [LOCAL ] AMH: Trimmed 56136 records to 38783 (keeping 150 days of data) [2025-09-14T16:47:18.663474] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-14T16:47:18.698320] [DEBUG] [LOCAL ] AMH: Primary data saved (38783 records). [2025-09-14T16:47:18.698545] [INFO ] [MAIN ] AMH: Full history saved. [2025-09-14T16:47:18.698696] [INFO ] [MAIN ] Update Progress: 103/2370 symbols completed. AMH took 27.2s. Estimated remaining: 3h 42m 40s. Rate: 10.2 symbols/min [2025-09-14T16:47:18.884326] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:47:18.901275] [DEBUG] [LOCAL ] AMRC: Loaded 17065 existing records from primary storage. [2025-09-14T16:47:18.901442] [INFO ] [MAIN ] AMRC: Loaded 17065 existing records. [2025-09-14T16:47:18.963953] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-09-14T16:47:19.078553] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:47:19.078835] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-09-14T16:47:19.078898] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-09-14T16:47:19.079364] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-09-14T16:47:19.079423] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-09-14T16:47:19.443801] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:47:19.460020] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-14T16:47:19.758847] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-09-14T16:47:20.145759] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-14T16:47:20.558831] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-09-14T16:47:20.818491] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-14T16:47:21.358834] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-09-14T16:47:21.437633] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T16:47:22.158839] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-09-14T16:47:22.958882] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-09-14T16:47:23.142576] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T16:47:23.758870] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-09-14T16:47:23.840485] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T16:47:24.515573] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T16:47:24.558786] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-09-14T16:47:25.138218] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-14T16:47:25.358921] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-09-14T16:47:26.084016] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-14T16:47:26.158812] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-09-14T16:47:26.467403] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-14T16:47:26.958885] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-09-14T16:47:27.758837] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-09-14T16:47:28.131331] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-14T16:47:28.166589] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-14T16:47:28.558876] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-09-14T16:47:28.970759] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-14T16:47:29.358832] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-09-14T16:47:29.932164] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T16:47:30.158826] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-09-14T16:47:30.860594] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-14T16:47:30.958791] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-09-14T16:47:31.317484] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T16:47:31.758853] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-09-14T16:47:32.053708] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-14T16:47:32.558852] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-09-14T16:47:33.358896] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-09-14T16:47:33.674347] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T16:47:33.818134] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-14T16:47:34.158877] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-09-14T16:47:34.605144] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-14T16:47:34.958876] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-09-14T16:47:35.058942] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-14T16:47:35.062840] [INFO ] [REMOTE ] AMPY: Full fetch complete (39644 records). [2025-09-14T16:47:35.063031] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-09-14T16:47:35.520269] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-09-14T16:47:35.520391] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-09-14T16:47:35.520912] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-09-14T16:47:35.520974] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-09-14T16:47:35.522109] [DEBUG] [LOCAL ] AMPY: Trimmed 39644 records to 28357 (keeping 150 days of data) [2025-09-14T16:47:35.686012] [DEBUG] [LOCAL ] AMPY: Primary data saved (28357 records). [2025-09-14T16:47:35.686194] [INFO ] [MAIN ] AMPY: Full history saved. [2025-09-14T16:47:35.686302] [INFO ] [MAIN ] Update Progress: 104/2370 symbols completed. AMPY took 23.5s. Estimated remaining: 3h 46m 36s. Rate: 10.0 symbols/min [2025-09-14T16:47:35.763997] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-09-14T16:47:35.874525] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:47:35.899600] [DEBUG] [LOCAL ] AMRZ: Loaded 21868 existing records from primary storage. [2025-09-14T16:47:35.899833] [INFO ] [MAIN ] AMRZ: Loaded 21868 existing records. [2025-09-14T16:47:36.078408] [WARN ] [MAIN ] AMRZ: Insufficient historical data. Have data from 2025-06-23, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:47:36.078701] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-14T16:47:36.078767] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-14T16:47:36.079584] [DEBUG] [LOCAL ] AMRZ: Deleted primary data file. [2025-09-14T16:47:36.079682] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-14T16:47:36.437849] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:47:36.527471] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-14T16:47:36.534546] [INFO ] [REMOTE ] AMPX: Full fetch complete (56230 records). [2025-09-14T16:47:36.534857] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-09-14T16:47:36.564016] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-09-14T16:47:36.963827] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-09-14T16:47:36.963973] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-09-14T16:47:36.964826] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-09-14T16:47:36.964899] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-09-14T16:47:36.966592] [DEBUG] [LOCAL ] AMPX: Trimmed 56230 records to 39319 (keeping 150 days of data) [2025-09-14T16:47:37.232167] [DEBUG] [LOCAL ] AMPX: Primary data saved (39319 records). [2025-09-14T16:47:37.232377] [INFO ] [MAIN ] AMPX: Full history saved. [2025-09-14T16:47:37.232563] [INFO ] [MAIN ] Update Progress: 105/2370 symbols completed. AMPX took 37.4s. Estimated remaining: 3h 44m 54s. Rate: 10.1 symbols/min [2025-09-14T16:47:37.384948] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-02. [2025-09-14T16:47:37.411389] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:47:37.435561] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-14T16:47:37.460247] [DEBUG] [LOCAL ] AMT: Loaded 23349 existing records from primary storage. [2025-09-14T16:47:37.460415] [INFO ] [MAIN ] AMT: Loaded 23349 existing records. [2025-09-14T16:47:37.636030] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:47:37.636324] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-09-14T16:47:37.636386] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-09-14T16:47:37.637040] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-09-14T16:47:37.637103] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-09-14T16:47:37.691796] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:47:37.728431] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-02 [2025-09-14T16:47:37.996813] [INFO ] [REMOTE ] AMT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:47:38.166370] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-03. [2025-09-14T16:47:38.169206] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T16:47:38.425678] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:47:38.426041] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-03 [2025-09-14T16:47:38.958842] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-09-14T16:47:39.758876] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-09-14T16:47:40.417890] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-14T16:47:40.558834] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-09-14T16:47:40.823371] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-14T16:47:41.358859] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-04. [2025-09-14T16:47:41.622685] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:47:41.623035] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-04 [2025-09-14T16:47:41.657541] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-14T16:47:41.661981] [INFO ] [REMOTE ] AMRC: Full fetch complete (41221 records). [2025-09-14T16:47:41.662129] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-09-14T16:47:42.050635] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-09-14T16:47:42.050804] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-09-14T16:47:42.051389] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-09-14T16:47:42.051472] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-09-14T16:47:42.053035] [DEBUG] [LOCAL ] AMRC: Trimmed 41221 records to 28206 (keeping 150 days of data) [2025-09-14T16:47:42.161011] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-09-14T16:47:42.228157] [DEBUG] [LOCAL ] AMRC: Primary data saved (28206 records). [2025-09-14T16:47:42.228330] [INFO ] [MAIN ] AMRC: Full history saved. [2025-09-14T16:47:42.228432] [INFO ] [MAIN ] Update Progress: 106/2370 symbols completed. AMRC took 23.5s. Estimated remaining: 3h 44m 27s. Rate: 10.1 symbols/min [2025-09-14T16:47:42.411054] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:47:42.422475] [DEBUG] [LOCAL ] AMTB: Loaded 9387 existing records from primary storage. [2025-09-14T16:47:42.422621] [INFO ] [MAIN ] AMTB: Loaded 9387 existing records. [2025-09-14T16:47:42.602695] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:47:42.603019] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-09-14T16:47:42.603081] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-09-14T16:47:42.603537] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-09-14T16:47:42.603598] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-09-14T16:47:42.767219] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T16:47:42.851550] [INFO ] [REMOTE ] AMR: Full fetch complete (31705 records). [2025-09-14T16:47:42.878416] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-09-14T16:47:42.964072] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-05. [2025-09-14T16:47:43.047393] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:47:43.342928] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-09-14T16:47:43.343043] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-09-14T16:47:43.343629] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-09-14T16:47:43.343704] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-09-14T16:47:43.344595] [DEBUG] [LOCAL ] AMR: Trimmed 31705 records to 21672 (keeping 150 days of data) [2025-09-14T16:47:43.398790] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:47:43.408245] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-05 [2025-09-14T16:47:43.480100] [DEBUG] [LOCAL ] AMR: Primary data saved (21672 records). [2025-09-14T16:47:43.480273] [INFO ] [MAIN ] AMR: Full history saved. [2025-09-14T16:47:43.480382] [INFO ] [MAIN ] Update Progress: 107/2370 symbols completed. AMR took 27.5s. Estimated remaining: 3h 42m 42s. Rate: 10.2 symbols/min [2025-09-14T16:47:43.655672] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:47:43.659792] [DEBUG] [LOCAL ] AMTD: Loaded 1777 existing records from primary storage. [2025-09-14T16:47:43.659890] [INFO ] [MAIN ] AMTD: Loaded 1777 existing records. [2025-09-14T16:47:43.763172] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-09-14T16:47:43.846950] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:47:43.847324] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-09-14T16:47:43.847395] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-09-14T16:47:43.847734] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-09-14T16:47:43.847803] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-09-14T16:47:44.228662] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:47:44.558834] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-09-14T16:47:45.177605] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-14T16:47:45.358880] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-06. [2025-09-14T16:47:45.599802] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-14T16:47:46.158890] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-09-14T16:47:46.315476] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-14T16:47:46.958893] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-07. [2025-09-14T16:47:47.758876] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-09-14T16:47:47.814831] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-14T16:47:48.272542] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-14T16:47:48.558873] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-09-14T16:47:48.892460] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-14T16:47:49.248252] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-14T16:47:49.358847] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-09-14T16:47:50.158886] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-09-14T16:47:50.649738] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-14T16:47:50.932095] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T16:47:50.958842] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-09-14T16:47:51.758866] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-09-14T16:47:52.166672] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-14T16:47:52.558883] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-09-14T16:47:52.882199] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-14T16:47:53.265145] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-14T16:47:53.358913] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-08. [2025-09-14T16:47:54.158852] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-09-14T16:47:54.840470] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-14T16:47:54.958795] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-09-14T16:47:55.056795] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T16:47:55.758823] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-09-14T16:47:56.199967] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-14T16:47:56.367422] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-14T16:47:56.558829] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-09-14T16:47:57.206485] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-14T16:47:57.358827] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-09-14T16:47:57.958334] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T16:47:57.959551] [INFO ] [REMOTE ] AMTD: Full fetch complete (3708 records). [2025-09-14T16:47:57.959665] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-09-14T16:47:58.168061] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-09. [2025-09-14T16:47:58.327656] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-09-14T16:47:58.327768] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-09-14T16:47:58.327904] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-09-14T16:47:58.327956] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-09-14T16:47:58.328469] [DEBUG] [LOCAL ] AMTD: Trimmed 3708 records to 2827 (keeping 150 days of data) [2025-09-14T16:47:58.344921] [DEBUG] [LOCAL ] AMTD: Primary data saved (2827 records). [2025-09-14T16:47:58.344998] [INFO ] [MAIN ] AMTD: Full history saved. [2025-09-14T16:47:58.345086] [INFO ] [MAIN ] Update Progress: 108/2370 symbols completed. AMTD took 14.9s. Estimated remaining: 3h 45m 44s. Rate: 10.0 symbols/min [2025-09-14T16:47:58.512822] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:47:58.534703] [DEBUG] [LOCAL ] AMTM: Loaded 22243 existing records from primary storage. [2025-09-14T16:47:58.534858] [INFO ] [MAIN ] AMTM: Loaded 22243 existing records. [2025-09-14T16:47:58.718155] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:47:58.718421] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-09-14T16:47:58.718485] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-14T16:47:58.719247] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-09-14T16:47:58.719313] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-09-14T16:47:58.967901] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-09-14T16:47:59.083384] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:47:59.758887] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-09-14T16:47:59.795390] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-14T16:47:59.800830] [INFO ] [REMOTE ] AMRZ: Full fetch complete (21868 records). [2025-09-14T16:47:59.800998] [DEBUG] [VALIDATOR ] AMRZ: Validating primary data. [2025-09-14T16:47:59.985587] [WARN ] [VALIDATOR ] AMRZ: Validation failed - insufficient historical data. Have 58 unique days, need 150 days [2025-09-14T16:47:59.986097] [FATAL] [MAIN ] AMRZ: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:47:59.986209] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:47:59.986311] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-14T16:47:59.991606] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-14T16:47:59.998049] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-14T16:47:59.999178] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T16:47:59.999257] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-14T16:48:00.004616] [INFO ] [MAIN ] Update Progress: 109/2370 symbols completed. AMRZ took 24.3s. Estimated remaining: 3h 44m 8s. Rate: 10.1 symbols/min [2025-09-14T16:48:00.198254] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:48:00.203883] [DEBUG] [LOCAL ] AMWL: Loaded 4016 existing records from primary storage. [2025-09-14T16:48:00.204014] [INFO ] [MAIN ] AMWL: Loaded 4016 existing records. [2025-09-14T16:48:00.379279] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:48:00.379534] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-09-14T16:48:00.379595] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-09-14T16:48:00.379844] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-09-14T16:48:00.379902] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-09-14T16:48:00.563945] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-09-14T16:48:00.742807] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:48:01.358824] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-09-14T16:48:01.502524] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T16:48:01.590783] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-14T16:48:01.991809] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-14T16:48:02.158828] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-09-14T16:48:02.725825] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-14T16:48:02.958837] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-09-14T16:48:03.534595] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-14T16:48:03.758831] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-09-14T16:48:04.558842] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-09-14T16:48:05.358823] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-09-14T16:48:05.532336] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T16:48:05.773108] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T16:48:06.158823] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-09-14T16:48:06.201613] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-14T16:48:06.958838] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-09-14T16:48:07.508726] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-14T16:48:07.758886] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-09-14T16:48:08.039269] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T16:48:08.558880] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-09-14T16:48:08.861570] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-14T16:48:09.069468] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-14T16:48:09.358841] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-09-14T16:48:10.158847] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-09-14T16:48:10.693930] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-14T16:48:10.958869] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-09-14T16:48:11.010468] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-14T16:48:11.012612] [INFO ] [REMOTE ] AMTB: Full fetch complete (22497 records). [2025-09-14T16:48:11.012746] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-09-14T16:48:11.378852] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-09-14T16:48:11.378966] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-09-14T16:48:11.379339] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-09-14T16:48:11.379397] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-09-14T16:48:11.380093] [DEBUG] [LOCAL ] AMTB: Trimmed 22497 records to 15567 (keeping 150 days of data) [2025-09-14T16:48:11.476752] [DEBUG] [LOCAL ] AMTB: Primary data saved (15567 records). [2025-09-14T16:48:11.476937] [INFO ] [MAIN ] AMTB: Full history saved. [2025-09-14T16:48:11.477040] [INFO ] [MAIN ] Update Progress: 110/2370 symbols completed. AMTB took 29.2s. Estimated remaining: 3h 45m 56s. Rate: 10.0 symbols/min [2025-09-14T16:48:11.658300] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:48:11.659049] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-14T16:48:11.682538] [DEBUG] [LOCAL ] AMX: Loaded 21502 existing records from primary storage. [2025-09-14T16:48:11.682777] [INFO ] [MAIN ] AMX: Loaded 21502 existing records. [2025-09-14T16:48:11.763929] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-09-14T16:48:11.869215] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:48:11.869497] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-09-14T16:48:11.869603] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-09-14T16:48:11.870258] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-09-14T16:48:11.870323] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-09-14T16:48:12.225784] [INFO ] [REMOTE ] AMX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:48:12.535038] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T16:48:12.537163] [INFO ] [REMOTE ] AMWL: Full fetch complete (10140 records). [2025-09-14T16:48:12.537357] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-09-14T16:48:12.569271] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-09-14T16:48:12.900960] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-09-14T16:48:12.901073] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-09-14T16:48:12.901307] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-09-14T16:48:12.901365] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-09-14T16:48:12.901966] [DEBUG] [LOCAL ] AMWL: Trimmed 10140 records to 6581 (keeping 150 days of data) [2025-09-14T16:48:12.938896] [DEBUG] [LOCAL ] AMWL: Primary data saved (6581 records). [2025-09-14T16:48:12.939017] [INFO ] [MAIN ] AMWL: Full history saved. [2025-09-14T16:48:12.939107] [INFO ] [MAIN ] Update Progress: 111/2370 symbols completed. AMWL took 12.9s. Estimated remaining: 3h 44m 17s. Rate: 10.1 symbols/min [2025-09-14T16:48:13.107167] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:48:13.122008] [DEBUG] [LOCAL ] AN: Loaded 13415 existing records from primary storage. [2025-09-14T16:48:13.122187] [INFO ] [MAIN ] AN: Loaded 13415 existing records. [2025-09-14T16:48:13.312210] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:48:13.312533] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-09-14T16:48:13.312600] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-09-14T16:48:13.313119] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-09-14T16:48:13.313187] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-09-14T16:48:13.371046] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-09-14T16:48:13.680636] [INFO ] [REMOTE ] AN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:48:14.158849] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-09-14T16:48:14.415749] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T16:48:14.920710] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T16:48:14.958776] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-09-14T16:48:15.758845] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-09-14T16:48:15.938498] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-14T16:48:16.177993] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-14T16:48:16.558853] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-09-14T16:48:17.180966] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-14T16:48:17.358829] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-09-14T16:48:17.646134] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-14T16:48:17.651852] [INFO ] [REMOTE ] AMT: Full fetch complete (57020 records). [2025-09-14T16:48:17.651990] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-09-14T16:48:18.039313] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-09-14T16:48:18.039447] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-09-14T16:48:18.040202] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-09-14T16:48:18.040282] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-09-14T16:48:18.041629] [DEBUG] [LOCAL ] AMT: Trimmed 57020 records to 39337 (keeping 150 days of data) [2025-09-14T16:48:18.159063] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-09-14T16:48:18.294840] [DEBUG] [LOCAL ] AMT: Primary data saved (39337 records). [2025-09-14T16:48:18.295122] [INFO ] [MAIN ] AMT: Full history saved. [2025-09-14T16:48:18.295355] [INFO ] [MAIN ] Update Progress: 112/2370 symbols completed. AMT took 41.1s. Estimated remaining: 3h 43m 59s. Rate: 10.1 symbols/min [2025-09-14T16:48:18.428678] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T16:48:18.509763] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:48:18.533239] [DEBUG] [LOCAL ] ANET: Loaded 24126 existing records from primary storage. [2025-09-14T16:48:18.533413] [INFO ] [MAIN ] ANET: Loaded 24126 existing records. [2025-09-14T16:48:18.713974] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:48:18.714292] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-09-14T16:48:18.714369] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-09-14T16:48:18.714990] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-09-14T16:48:18.715056] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-09-14T16:48:18.964409] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-09-14T16:48:19.086706] [INFO ] [REMOTE ] ANET: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:48:19.758839] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-09-14T16:48:19.867630] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-14T16:48:20.493669] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T16:48:20.558802] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-09-14T16:48:21.358884] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-09-14T16:48:21.826123] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T16:48:21.900233] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-14T16:48:22.158888] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-09-14T16:48:22.958932] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-09-14T16:48:23.093578] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-14T16:48:23.677076] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-14T16:48:23.758833] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-09-14T16:48:24.526134] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T16:48:24.558825] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-09-14T16:48:25.211620] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-14T16:48:25.358774] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-09-14T16:48:25.456902] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-14T16:48:25.659235] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-14T16:48:25.664318] [INFO ] [REMOTE ] AMTM: Full fetch complete (55183 records). [2025-09-14T16:48:25.664445] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-09-14T16:48:26.042199] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-09-14T16:48:26.042356] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-09-14T16:48:26.042993] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-09-14T16:48:26.043071] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-09-14T16:48:26.044260] [DEBUG] [LOCAL ] AMTM: Trimmed 55183 records to 37905 (keeping 150 days of data) [2025-09-14T16:48:26.158965] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-09-14T16:48:26.289192] [DEBUG] [LOCAL ] AMTM: Primary data saved (37905 records). [2025-09-14T16:48:26.289445] [INFO ] [MAIN ] AMTM: Full history saved. [2025-09-14T16:48:26.289570] [INFO ] [MAIN ] Update Progress: 113/2370 symbols completed. AMTM took 27.9s. Estimated remaining: 3h 44m 34s. Rate: 10.1 symbols/min [2025-09-14T16:48:26.473517] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:48:26.499624] [DEBUG] [LOCAL ] ANF: Loaded 23198 existing records from primary storage. [2025-09-14T16:48:26.499889] [INFO ] [MAIN ] ANF: Loaded 23198 existing records. [2025-09-14T16:48:26.694246] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:48:26.694620] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-09-14T16:48:26.694724] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-09-14T16:48:26.695459] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-09-14T16:48:26.695539] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-09-14T16:48:26.964054] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-09-14T16:48:27.084705] [INFO ] [REMOTE ] ANF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:48:27.758835] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-09-14T16:48:28.558859] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-09-14T16:48:28.592701] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T16:48:28.631667] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-14T16:48:29.358920] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-09-14T16:48:29.524722] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T16:48:29.552718] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T16:48:30.158903] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-09-14T16:48:30.958898] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-09-14T16:48:31.537684] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-14T16:48:31.606595] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-14T16:48:31.758846] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-09-14T16:48:32.429018] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T16:48:32.558814] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-09-14T16:48:32.688527] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-14T16:48:33.358845] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-09-14T16:48:34.158841] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-09-14T16:48:34.519014] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T16:48:34.958851] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-09-14T16:48:35.058847] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-14T16:48:35.574745] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T16:48:35.578667] [INFO ] [REMOTE ] AN: Full fetch complete (36061 records). [2025-09-14T16:48:35.578772] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-09-14T16:48:35.761768] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-09-14T16:48:35.984508] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-09-14T16:48:35.984922] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-09-14T16:48:35.985618] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-09-14T16:48:36.014028] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-09-14T16:48:36.017198] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T16:48:36.029873] [DEBUG] [LOCAL ] AN: Trimmed 36061 records to 23541 (keeping 150 days of data) [2025-09-14T16:48:36.205496] [DEBUG] [LOCAL ] AN: Primary data saved (23541 records). [2025-09-14T16:48:36.205764] [INFO ] [MAIN ] AN: Full history saved. [2025-09-14T16:48:36.205966] [INFO ] [MAIN ] Update Progress: 114/2370 symbols completed. AN took 23.3s. Estimated remaining: 3h 45m 46s. Rate: 10.0 symbols/min [2025-09-14T16:48:36.385870] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:48:36.389082] [DEBUG] [LOCAL ] ANGX: Loaded 636 existing records from primary storage. [2025-09-14T16:48:36.389184] [INFO ] [MAIN ] ANGX: Loaded 636 existing records. [2025-09-14T16:48:36.568537] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-09-14T16:48:36.576390] [WARN ] [MAIN ] ANGX: Insufficient historical data. Have data from 2025-09-11, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:48:36.577834] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-14T16:48:36.577961] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-14T16:48:36.578575] [DEBUG] [LOCAL ] ANGX: Deleted primary data file. [2025-09-14T16:48:36.578768] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-14T16:48:36.960381] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:48:37.358893] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-02. [2025-09-14T16:48:37.465978] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T16:48:37.615518] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:48:37.615856] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-02 [2025-09-14T16:48:38.158881] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-09-14T16:48:38.964322] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-09-14T16:48:38.968169] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-14T16:48:39.758889] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-09-14T16:48:39.787885] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T16:48:40.142439] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-14T16:48:40.147407] [INFO ] [REMOTE ] AMX: Full fetch complete (53261 records). [2025-09-14T16:48:40.147536] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-09-14T16:48:40.521804] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-09-14T16:48:40.521906] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-09-14T16:48:40.522490] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-09-14T16:48:40.522547] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-09-14T16:48:40.523729] [DEBUG] [LOCAL ] AMX: Trimmed 53261 records to 36855 (keeping 150 days of data) [2025-09-14T16:48:40.581548] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-03. [2025-09-14T16:48:40.771213] [DEBUG] [LOCAL ] AMX: Primary data saved (36855 records). [2025-09-14T16:48:40.771470] [INFO ] [MAIN ] AMX: Full history saved. [2025-09-14T16:48:40.771745] [INFO ] [MAIN ] Update Progress: 115/2370 symbols completed. AMX took 29.3s. Estimated remaining: 3h 45m 12s. Rate: 10.0 symbols/min [2025-09-14T16:48:40.894945] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:48:40.927499] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-03 [2025-09-14T16:48:40.952363] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:48:40.963901] [DEBUG] [LOCAL ] ANRO: Loaded 7432 existing records from primary storage. [2025-09-14T16:48:40.964075] [INFO ] [MAIN ] ANRO: Loaded 7432 existing records. [2025-09-14T16:48:41.141200] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:48:41.141483] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-09-14T16:48:41.141573] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-09-14T16:48:41.141979] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-09-14T16:48:41.142065] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-09-14T16:48:41.364179] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-09-14T16:48:41.538171] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:48:41.644726] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-14T16:48:42.158823] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-09-14T16:48:42.958844] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-09-14T16:48:43.331071] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-14T16:48:43.758834] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-09-14T16:48:44.005409] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T16:48:44.261468] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-14T16:48:44.558841] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-04. [2025-09-14T16:48:44.809762] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:48:44.810101] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-04 [2025-09-14T16:48:45.229803] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-14T16:48:45.358886] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-09-14T16:48:46.158978] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-09-14T16:48:46.830371] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T16:48:46.836726] [INFO ] [REMOTE ] ANET: Full fetch complete (58446 records). [2025-09-14T16:48:46.837191] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-09-14T16:48:46.964007] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-09-14T16:48:47.232062] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-09-14T16:48:47.232298] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-09-14T16:48:47.233185] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-09-14T16:48:47.233407] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-09-14T16:48:47.235039] [DEBUG] [LOCAL ] ANET: Trimmed 58446 records to 40506 (keeping 150 days of data) [2025-09-14T16:48:47.376784] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-14T16:48:47.549186] [DEBUG] [LOCAL ] ANET: Primary data saved (40506 records). [2025-09-14T16:48:47.549355] [INFO ] [MAIN ] ANET: Full history saved. [2025-09-14T16:48:47.549484] [INFO ] [MAIN ] Update Progress: 116/2370 symbols completed. ANET took 29.3s. Estimated remaining: 3h 45m 21s. Rate: 10.0 symbols/min [2025-09-14T16:48:47.725737] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:48:47.737539] [DEBUG] [LOCAL ] ANVS: Loaded 9915 existing records from primary storage. [2025-09-14T16:48:47.737726] [INFO ] [MAIN ] ANVS: Loaded 9915 existing records. [2025-09-14T16:48:47.767878] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-05. [2025-09-14T16:48:47.918305] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:48:47.918580] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-09-14T16:48:47.918658] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-09-14T16:48:47.919029] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-09-14T16:48:47.919088] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-09-14T16:48:48.161187] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:48:48.192487] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-05 [2025-09-14T16:48:48.268033] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:48:48.369618] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-14T16:48:48.558835] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-09-14T16:48:49.358888] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-09-14T16:48:50.087673] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T16:48:50.158802] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-09-14T16:48:50.573011] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T16:48:50.958793] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-09-14T16:48:51.315046] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T16:48:51.403746] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T16:48:51.409075] [INFO ] [REMOTE ] ANF: Full fetch complete (56855 records). [2025-09-14T16:48:51.409254] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-09-14T16:48:51.758930] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-06. [2025-09-14T16:48:51.792009] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-09-14T16:48:51.792150] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-09-14T16:48:51.792867] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-09-14T16:48:51.792949] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-09-14T16:48:51.794769] [DEBUG] [LOCAL ] ANF: Trimmed 56855 records to 39151 (keeping 150 days of data) [2025-09-14T16:48:52.038334] [DEBUG] [LOCAL ] ANF: Primary data saved (39151 records). [2025-09-14T16:48:52.038575] [INFO ] [MAIN ] ANF: Full history saved. [2025-09-14T16:48:52.038787] [INFO ] [MAIN ] Update Progress: 117/2370 symbols completed. ANF took 25.7s. Estimated remaining: 3h 44m 46s. Rate: 10.0 symbols/min [2025-09-14T16:48:52.098685] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:48:52.098949] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-06 [2025-09-14T16:48:52.558829] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-09-14T16:48:53.358824] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-07. [2025-09-14T16:48:53.635514] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-14T16:48:53.660312] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:48:53.660723] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-07 [2025-09-14T16:48:54.158829] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-09-14T16:48:54.911776] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-14T16:48:54.958817] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-09-14T16:48:55.758911] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-09-14T16:48:56.227011] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-14T16:48:56.558842] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-09-14T16:48:56.953904] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T16:48:57.358834] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-09-14T16:48:57.853978] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-14T16:48:58.158900] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-09-14T16:48:58.386007] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-14T16:48:58.958835] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-08. [2025-09-14T16:48:59.326840] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:48:59.327415] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-08 [2025-09-14T16:48:59.343088] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-14T16:48:59.758837] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-09-14T16:49:00.558846] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-09-14T16:49:00.846610] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T16:49:01.328811] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-14T16:49:01.358811] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-09-14T16:49:02.158879] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-09-14T16:49:02.189623] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-14T16:49:02.191415] [INFO ] [REMOTE ] ANRO: Full fetch complete (22698 records). [2025-09-14T16:49:02.191505] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-09-14T16:49:02.579782] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-09-14T16:49:02.579886] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-09-14T16:49:02.580220] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-09-14T16:49:02.580272] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-09-14T16:49:02.580914] [DEBUG] [LOCAL ] ANRO: Trimmed 22698 records to 13852 (keeping 150 days of data) [2025-09-14T16:49:02.663930] [DEBUG] [LOCAL ] ANRO: Primary data saved (13852 records). [2025-09-14T16:49:02.664106] [INFO ] [MAIN ] ANRO: Full history saved. [2025-09-14T16:49:02.664238] [INFO ] [MAIN ] Update Progress: 118/2370 symbols completed. ANRO took 21.9s. Estimated remaining: 3h 46m 9s. Rate: 10.0 symbols/min [2025-09-14T16:49:02.926932] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T16:49:02.930553] [INFO ] [REMOTE ] ANVS: Full fetch complete (26834 records). [2025-09-14T16:49:02.930720] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-09-14T16:49:02.963886] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-09. [2025-09-14T16:49:03.298715] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-09-14T16:49:03.298823] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-09-14T16:49:03.299203] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-09-14T16:49:03.299274] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-09-14T16:49:03.299992] [DEBUG] [LOCAL ] ANVS: Trimmed 26834 records to 17780 (keeping 150 days of data) [2025-09-14T16:49:03.413071] [DEBUG] [LOCAL ] ANVS: Primary data saved (17780 records). [2025-09-14T16:49:03.413267] [INFO ] [MAIN ] ANVS: Full history saved. [2025-09-14T16:49:03.413388] [INFO ] [MAIN ] Update Progress: 119/2370 symbols completed. ANVS took 15.9s. Estimated remaining: 3h 44m 23s. Rate: 10.0 symbols/min [2025-09-14T16:49:03.511793] [INFO ] [REMOTE ] ANGX: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T16:49:03.513295] [INFO ] [REMOTE ] ANGX: Full fetch complete (636 records). [2025-09-14T16:49:03.513380] [DEBUG] [VALIDATOR ] ANGX: Validating primary data. [2025-09-14T16:49:03.692832] [WARN ] [VALIDATOR ] ANGX: Validation failed - insufficient historical data. Have 2 unique days, need 150 days [2025-09-14T16:49:03.693042] [FATAL] [MAIN ] ANGX: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:49:03.693096] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:49:03.693143] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-14T16:49:03.693223] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-14T16:49:03.693281] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-14T16:49:03.693345] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-14T16:49:03.693480] [INFO ] [MAIN ] Update Progress: 120/2370 symbols completed. ANGX took 27.5s. Estimated remaining: 3h 42m 30s. Rate: 10.1 symbols/min [2025-09-14T16:49:04.345144] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:49:04.367077] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:49:04.392859] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:49:04.429925] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:49:04.438918] [DEBUG] [LOCAL ] AOMD: Loaded 1124 existing records from primary storage. [2025-09-14T16:49:04.439861] [INFO ] [MAIN ] AOMD: Loaded 1124 existing records. [2025-09-14T16:49:04.494396] [DEBUG] [LOCAL ] AOMR: Loaded 7561 existing records from primary storage. [2025-09-14T16:49:04.523793] [INFO ] [MAIN ] AOMR: Loaded 7561 existing records. [2025-09-14T16:49:04.631692] [DEBUG] [LOCAL ] AOD: Loaded 13926 existing records from primary storage. [2025-09-14T16:49:04.710763] [INFO ] [MAIN ] AOD: Loaded 13926 existing records. [2025-09-14T16:49:04.754887] [WARN ] [MAIN ] AOMD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:49:04.747555] [DEBUG] [LOCAL ] AON: Loaded 19818 existing records from primary storage. [2025-09-14T16:49:04.799527] [INFO ] [MAIN ] AON: Loaded 19818 existing records. [2025-09-14T16:49:04.799379] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-14T16:49:04.854814] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-14T16:49:04.941914] [DEBUG] [LOCAL ] AOMD: Deleted primary data file. [2025-09-14T16:49:05.018206] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-14T16:49:05.012722] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:49:05.061782] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-09-14T16:49:05.088315] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-14T16:49:05.228563] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:49:05.202198] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-09-14T16:49:05.296535] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-09-14T16:49:05.296468] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:49:05.312361] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-09-14T16:49:05.323142] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-14T16:49:05.354981] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-09-14T16:49:05.398155] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-09-14T16:49:05.408566] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-09-14T16:49:05.528502] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-09-14T16:49:05.564571] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-09-14T16:49:05.553969] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-09-14T16:49:06.134352] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:49:06.303730] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-02. [2025-09-14T16:49:06.386601] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:49:06.435417] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-09-14T16:49:06.683261] [INFO ] [REMOTE ] AOD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:49:06.702606] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:49:06.704393] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-09-14T16:49:06.725805] [INFO ] [REMOTE ] AON: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:49:06.727423] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-09-14T16:49:06.727576] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-02 [2025-09-14T16:49:06.958831] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-03. [2025-09-14T16:49:07.289039] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:49:07.289505] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-03 [2025-09-14T16:49:07.554679] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-14T16:49:07.644768] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-14T16:49:07.758805] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-09-14T16:49:08.443534] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-14T16:49:08.510025] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T16:49:08.558849] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-09-14T16:49:09.358846] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-04. [2025-09-14T16:49:09.631004] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:49:09.631460] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-04 [2025-09-14T16:49:09.694226] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-14T16:49:10.158862] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-09-14T16:49:10.958873] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-09-14T16:49:11.566308] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-14T16:49:11.758851] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-05. [2025-09-14T16:49:12.072894] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-14T16:49:12.425192] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T16:49:12.558876] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-06. [2025-09-14T16:49:13.161908] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-14T16:49:13.358834] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-09-14T16:49:14.158889] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-09-14T16:49:14.772103] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-14T16:49:14.958887] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-09-14T16:49:15.270788] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-14T16:49:15.758839] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-09-14T16:49:16.115251] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T16:49:16.345187] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-14T16:49:16.558880] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-09-14T16:49:17.358805] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-09-14T16:49:17.801040] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-14T16:49:18.158883] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-09-14T16:49:18.254398] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-14T16:49:18.958867] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-09-14T16:49:19.758859] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-07. [2025-09-14T16:49:19.872106] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-14T16:49:19.875611] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-07 [2025-09-14T16:49:19.877298] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T16:49:19.927223] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-14T16:49:20.558901] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-09-14T16:49:21.358868] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-09-14T16:49:21.582752] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-14T16:49:22.158795] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-09-14T16:49:22.611595] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T16:49:22.958848] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-09-14T16:49:23.271223] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-14T16:49:23.275047] [INFO ] [REMOTE ] AOD: Full fetch complete (32870 records). [2025-09-14T16:49:23.275163] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-09-14T16:49:23.670763] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-09-14T16:49:23.670910] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-09-14T16:49:23.671436] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-09-14T16:49:23.671513] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-09-14T16:49:23.672825] [DEBUG] [LOCAL ] AOD: Trimmed 32870 records to 22575 (keeping 150 days of data) [2025-09-14T16:49:23.763671] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-09-14T16:49:23.814719] [DEBUG] [LOCAL ] AOD: Primary data saved (22575 records). [2025-09-14T16:49:23.814881] [INFO ] [MAIN ] AOD: Full history saved. [2025-09-14T16:49:23.814979] [INFO ] [MAIN ] Update Progress: 121/2370 symbols completed. AOD took 20.1s. Estimated remaining: 3h 46m 48s. Rate: 9.9 symbols/min [2025-09-14T16:49:23.960067] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T16:49:23.991991] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:49:23.992082] [INFO ] [REMOTE ] AOMR: Full fetch complete (19016 records). [2025-09-14T16:49:23.992310] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-09-14T16:49:24.155563] [DEBUG] [LOCAL ] AORT: Loaded 13183 existing records from primary storage. [2025-09-14T16:49:24.176242] [INFO ] [MAIN ] AORT: Loaded 13183 existing records. [2025-09-14T16:49:24.535201] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:49:24.566027] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-08. [2025-09-14T16:49:24.567331] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-09-14T16:49:24.594408] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-09-14T16:49:24.594266] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-09-14T16:49:24.594672] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-09-14T16:49:24.595072] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-09-14T16:49:24.595125] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-09-14T16:49:24.595312] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-09-14T16:49:24.595624] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-09-14T16:49:24.617374] [DEBUG] [LOCAL ] AOMR: Trimmed 19016 records to 12788 (keeping 150 days of data) [2025-09-14T16:49:25.027201] [INFO ] [REMOTE ] AORT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:49:25.041113] [DEBUG] [LOCAL ] AOMR: Primary data saved (12788 records). [2025-09-14T16:49:25.041306] [INFO ] [MAIN ] AOMR: Full history saved. [2025-09-14T16:49:25.041416] [INFO ] [MAIN ] Update Progress: 122/2370 symbols completed. AOMR took 21.3s. Estimated remaining: 3h 45m 13s. Rate: 10.0 symbols/min [2025-09-14T16:49:25.143806] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-14T16:49:25.214115] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:49:25.237719] [DEBUG] [LOCAL ] AOS: Loaded 21715 existing records from primary storage. [2025-09-14T16:49:25.237885] [INFO ] [MAIN ] AOS: Loaded 21715 existing records. [2025-09-14T16:49:25.363949] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-09. [2025-09-14T16:49:25.428036] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:49:25.428335] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-09-14T16:49:25.428451] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-09-14T16:49:25.429926] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-09-14T16:49:25.429996] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-09-14T16:49:25.793914] [INFO ] [REMOTE ] AOS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:49:25.822619] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-14T16:49:25.860664] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T16:49:25.861588] [INFO ] [REMOTE ] AOMD: Full fetch complete (1347 records). [2025-09-14T16:49:25.861709] [DEBUG] [VALIDATOR ] AOMD: Validating primary data. [2025-09-14T16:49:26.035860] [WARN ] [VALIDATOR ] AOMD: Validation failed - insufficient historical data. Have 54 unique days, need 150 days [2025-09-14T16:49:26.036101] [FATAL] [MAIN ] AOMD: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:49:26.036170] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:49:26.036242] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-14T16:49:26.036371] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-14T16:49:26.036437] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-14T16:49:26.036527] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-14T16:49:26.036636] [INFO ] [MAIN ] Update Progress: 123/2370 symbols completed. AOMD took 22.3s. Estimated remaining: 3h 43m 35s. Rate: 10.0 symbols/min [2025-09-14T16:49:26.163922] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-09-14T16:49:26.207118] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:49:26.212097] [DEBUG] [LOCAL ] AP: Loaded 3325 existing records from primary storage. [2025-09-14T16:49:26.212221] [INFO ] [MAIN ] AP: Loaded 3325 existing records. [2025-09-14T16:49:26.392755] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:49:26.393044] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-09-14T16:49:26.393107] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-14T16:49:26.393368] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-09-14T16:49:26.393447] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-09-14T16:49:26.749944] [INFO ] [REMOTE ] AP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:49:26.958889] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-09-14T16:49:27.490411] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T16:49:27.582786] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-14T16:49:27.758829] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-09-14T16:49:28.203145] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-14T16:49:28.558867] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-09-14T16:49:29.358887] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-09-14T16:49:29.598385] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-14T16:49:29.787536] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-14T16:49:30.158845] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-09-14T16:49:30.958898] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-09-14T16:49:31.029780] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T16:49:31.758853] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-09-14T16:49:32.483819] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T16:49:32.558868] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-09-14T16:49:32.567895] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-14T16:49:33.358875] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-09-14T16:49:34.158856] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-09-14T16:49:34.399580] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-14T16:49:34.958876] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-09-14T16:49:35.101942] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T16:49:35.142160] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-14T16:49:35.758832] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-09-14T16:49:36.538864] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-14T16:49:36.558806] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-09-14T16:49:36.655930] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T16:49:36.998295] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T16:49:36.999490] [INFO ] [REMOTE ] AP: Full fetch complete (6997 records). [2025-09-14T16:49:36.999583] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-09-14T16:49:37.363785] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-09-14T16:49:37.370415] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-09-14T16:49:37.371423] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-09-14T16:49:37.371727] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-09-14T16:49:37.371787] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-09-14T16:49:37.372318] [DEBUG] [LOCAL ] AP: Trimmed 6997 records to 5808 (keeping 150 days of data) [2025-09-14T16:49:37.406776] [DEBUG] [LOCAL ] AP: Primary data saved (5808 records). [2025-09-14T16:49:37.406941] [INFO ] [MAIN ] AP: Full history saved. [2025-09-14T16:49:37.407074] [INFO ] [MAIN ] Update Progress: 124/2370 symbols completed. AP took 11.4s. Estimated remaining: 3h 45m 7s. Rate: 10.0 symbols/min [2025-09-14T16:49:37.578475] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:49:37.594841] [DEBUG] [LOCAL ] APAM: Loaded 16068 existing records from primary storage. [2025-09-14T16:49:37.595030] [INFO ] [MAIN ] APAM: Loaded 16068 existing records. [2025-09-14T16:49:37.791777] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:49:37.792042] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-09-14T16:49:37.792101] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-14T16:49:37.792740] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-09-14T16:49:37.792807] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-09-14T16:49:38.146636] [INFO ] [REMOTE ] APAM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:49:38.158781] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-09-14T16:49:38.958866] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-09-14T16:49:39.079631] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T16:49:39.579159] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-14T16:49:39.606339] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T16:49:39.611792] [INFO ] [REMOTE ] AON: Full fetch complete (49434 records). [2025-09-14T16:49:39.611963] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-09-14T16:49:39.765413] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-09-14T16:49:40.046873] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-09-14T16:49:40.046998] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-09-14T16:49:40.047578] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-09-14T16:49:40.047657] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-09-14T16:49:40.048931] [DEBUG] [LOCAL ] AON: Trimmed 49434 records to 34078 (keeping 150 days of data) [2025-09-14T16:49:40.274093] [DEBUG] [LOCAL ] AON: Primary data saved (34078 records). [2025-09-14T16:49:40.274294] [INFO ] [MAIN ] AON: Full history saved. [2025-09-14T16:49:40.274402] [INFO ] [MAIN ] Update Progress: 125/2370 symbols completed. AON took 36.6s. Estimated remaining: 3h 44m 5s. Rate: 10.0 symbols/min [2025-09-14T16:49:40.455697] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:49:40.475210] [DEBUG] [LOCAL ] APD: Loaded 19504 existing records from primary storage. [2025-09-14T16:49:40.475402] [INFO ] [MAIN ] APD: Loaded 19504 existing records. [2025-09-14T16:49:40.564612] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-09-14T16:49:40.654552] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:49:40.654842] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-09-14T16:49:40.654907] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-14T16:49:40.655493] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-09-14T16:49:40.655557] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-09-14T16:49:41.028866] [INFO ] [REMOTE ] APD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:49:41.085924] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-14T16:49:41.358858] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-09-14T16:49:41.835155] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-14T16:49:42.158858] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-09-14T16:49:42.568416] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T16:49:42.958807] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-09-14T16:49:43.407301] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T16:49:43.758830] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-09-14T16:49:44.258155] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-14T16:49:44.558864] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-09-14T16:49:45.199732] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-14T16:49:45.358832] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-09-14T16:49:46.114690] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-14T16:49:46.158844] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-09-14T16:49:46.684341] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-14T16:49:46.958816] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-09-14T16:49:47.267135] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T16:49:47.758886] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-09-14T16:49:48.487705] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T16:49:48.558840] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-09-14T16:49:49.100689] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-14T16:49:49.358836] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-09-14T16:49:49.684865] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-14T16:49:50.158850] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-09-14T16:49:50.958833] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-09-14T16:49:51.209447] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T16:49:51.326107] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-14T16:49:51.758835] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-09-14T16:49:52.371193] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-14T16:49:52.558835] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-09-14T16:49:53.358864] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-09-14T16:49:53.431100] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-14T16:49:53.908339] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T16:49:53.911927] [INFO ] [REMOTE ] AORT: Full fetch complete (32566 records). [2025-09-14T16:49:53.912043] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-09-14T16:49:54.163916] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-09-14T16:49:54.286149] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-09-14T16:49:54.286398] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-09-14T16:49:54.287057] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-09-14T16:49:54.287222] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-09-14T16:49:54.288444] [DEBUG] [LOCAL ] AORT: Trimmed 32566 records to 21896 (keeping 150 days of data) [2025-09-14T16:49:54.417589] [DEBUG] [LOCAL ] AORT: Primary data saved (21896 records). [2025-09-14T16:49:54.417938] [INFO ] [MAIN ] AORT: Full history saved. [2025-09-14T16:49:54.418170] [INFO ] [MAIN ] Update Progress: 126/2370 symbols completed. AORT took 30.6s. Estimated remaining: 3h 46m 24s. Rate: 9.9 symbols/min [2025-09-14T16:49:54.567353] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-14T16:49:54.648447] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:49:54.672497] [DEBUG] [LOCAL ] APG: Loaded 22857 existing records from primary storage. [2025-09-14T16:49:54.672709] [INFO ] [MAIN ] APG: Loaded 22857 existing records. [2025-09-14T16:49:54.849205] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:49:54.849490] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-09-14T16:49:54.849562] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-14T16:49:54.850208] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-09-14T16:49:54.850277] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-09-14T16:49:54.963922] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-09-14T16:49:55.221206] [INFO ] [REMOTE ] APG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:49:55.690443] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T16:49:55.694297] [INFO ] [REMOTE ] APAM: Full fetch complete (39959 records). [2025-09-14T16:49:55.694477] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-09-14T16:49:55.764053] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-09-14T16:49:55.831130] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T16:49:56.123450] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-09-14T16:49:56.123563] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-09-14T16:49:56.124093] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-09-14T16:49:56.124154] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-09-14T16:49:56.125098] [DEBUG] [LOCAL ] APAM: Trimmed 39959 records to 27241 (keeping 150 days of data) [2025-09-14T16:49:56.299084] [DEBUG] [LOCAL ] APAM: Primary data saved (27241 records). [2025-09-14T16:49:56.299440] [INFO ] [MAIN ] APAM: Full history saved. [2025-09-14T16:49:56.299723] [INFO ] [MAIN ] Update Progress: 127/2370 symbols completed. APAM took 18.9s. Estimated remaining: 3h 45m 4s. Rate: 10.0 symbols/min [2025-09-14T16:49:56.470726] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:49:56.495008] [DEBUG] [LOCAL ] APH: Loaded 24102 existing records from primary storage. [2025-09-14T16:49:56.495171] [INFO ] [MAIN ] APH: Loaded 24102 existing records. [2025-09-14T16:49:56.563973] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-09-14T16:49:56.678285] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:49:56.678541] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-09-14T16:49:56.678604] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-14T16:49:56.679351] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-09-14T16:49:56.679417] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-09-14T16:49:57.033911] [INFO ] [REMOTE ] APH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:49:57.185040] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-14T16:49:57.358825] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-09-14T16:49:58.158883] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-09-14T16:49:58.494942] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-14T16:49:58.699468] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-14T16:49:58.958835] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-09-14T16:49:59.550592] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T16:49:59.758839] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-09-14T16:50:00.558847] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-09-14T16:50:00.594244] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-14T16:50:01.358828] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-09-14T16:50:01.589377] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T16:50:02.158846] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-09-14T16:50:02.558207] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-14T16:50:02.958876] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-09-14T16:50:03.077134] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-14T16:50:03.508588] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T16:50:03.758846] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-09-14T16:50:04.418374] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T16:50:04.423107] [INFO ] [REMOTE ] APD: Full fetch complete (49795 records). [2025-09-14T16:50:04.423298] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-09-14T16:50:04.576061] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-09-14T16:50:04.834384] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-09-14T16:50:04.834628] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-09-14T16:50:04.835318] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-09-14T16:50:04.835506] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-09-14T16:50:04.837447] [DEBUG] [LOCAL ] APD: Trimmed 49795 records to 33825 (keeping 150 days of data) [2025-09-14T16:50:05.061416] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-14T16:50:05.097928] [DEBUG] [LOCAL ] APD: Primary data saved (33825 records). [2025-09-14T16:50:05.098118] [INFO ] [MAIN ] APD: Full history saved. [2025-09-14T16:50:05.098225] [INFO ] [MAIN ] Update Progress: 128/2370 symbols completed. APD took 24.8s. Estimated remaining: 3h 45m 47s. Rate: 9.9 symbols/min [2025-09-14T16:50:05.275868] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:50:05.300852] [DEBUG] [LOCAL ] APLE: Loaded 23196 existing records from primary storage. [2025-09-14T16:50:05.301021] [INFO ] [MAIN ] APLE: Loaded 23196 existing records. [2025-09-14T16:50:05.363987] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-09-14T16:50:05.506118] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:50:05.506456] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-09-14T16:50:05.506539] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-14T16:50:05.507541] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-09-14T16:50:05.507608] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-09-14T16:50:05.867566] [INFO ] [REMOTE ] APLE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:50:05.970379] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T16:50:06.158905] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-09-14T16:50:06.743684] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T16:50:06.748990] [INFO ] [REMOTE ] AOS: Full fetch complete (53730 records). [2025-09-14T16:50:06.749160] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-09-14T16:50:06.964207] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-09-14T16:50:07.151711] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-09-14T16:50:07.151892] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-09-14T16:50:07.152683] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-09-14T16:50:07.152755] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-09-14T16:50:07.154187] [DEBUG] [LOCAL ] AOS: Trimmed 53730 records to 37044 (keeping 150 days of data) [2025-09-14T16:50:07.289206] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-14T16:50:07.437290] [DEBUG] [LOCAL ] AOS: Primary data saved (37044 records). [2025-09-14T16:50:07.437516] [INFO ] [MAIN ] AOS: Full history saved. [2025-09-14T16:50:07.437629] [INFO ] [MAIN ] Update Progress: 129/2370 symbols completed. AOS took 42.4s. Estimated remaining: 3h 44m 36s. Rate: 10.0 symbols/min [2025-09-14T16:50:07.616387] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:50:07.641932] [DEBUG] [LOCAL ] APO: Loaded 23855 existing records from primary storage. [2025-09-14T16:50:07.642156] [INFO ] [MAIN ] APO: Loaded 23855 existing records. [2025-09-14T16:50:07.763990] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-09-14T16:50:07.833007] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:50:07.833392] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-09-14T16:50:07.833460] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-09-14T16:50:07.834221] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-09-14T16:50:07.834287] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-09-14T16:50:08.187988] [INFO ] [REMOTE ] APO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:50:08.558921] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-09-14T16:50:08.822540] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T16:50:09.066972] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-14T16:50:09.358886] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-09-14T16:50:10.158852] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-09-14T16:50:10.217103] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T16:50:10.752916] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T16:50:10.958854] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-09-14T16:50:11.652075] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T16:50:11.758905] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-09-14T16:50:12.002838] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-14T16:50:12.008063] [INFO ] [REMOTE ] APG: Full fetch complete (54393 records). [2025-09-14T16:50:12.008181] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-09-14T16:50:12.391194] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-09-14T16:50:12.391317] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-09-14T16:50:12.391977] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-09-14T16:50:12.392041] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-09-14T16:50:12.393314] [DEBUG] [LOCAL ] APG: Trimmed 54393 records to 38148 (keeping 150 days of data) [2025-09-14T16:50:12.565417] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-09-14T16:50:12.630339] [DEBUG] [LOCAL ] APG: Primary data saved (38148 records). [2025-09-14T16:50:12.630531] [INFO ] [MAIN ] APG: Full history saved. [2025-09-14T16:50:12.630663] [INFO ] [MAIN ] Update Progress: 130/2370 symbols completed. APG took 18.2s. Estimated remaining: 3h 44m 16s. Rate: 10.0 symbols/min [2025-09-14T16:50:12.799489] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:50:12.804721] [DEBUG] [LOCAL ] APOS: Loaded 2996 existing records from primary storage. [2025-09-14T16:50:12.804838] [INFO ] [MAIN ] APOS: Loaded 2996 existing records. [2025-09-14T16:50:12.987709] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:50:12.988019] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-09-14T16:50:12.988088] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-14T16:50:12.988399] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-09-14T16:50:12.988465] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-09-14T16:50:13.346417] [INFO ] [REMOTE ] APOS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:50:13.358780] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-09-14T16:50:13.597542] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T16:50:13.987623] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-14T16:50:14.158871] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-09-14T16:50:14.582721] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-14T16:50:14.958836] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-09-14T16:50:15.758884] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-09-14T16:50:16.110755] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T16:50:16.286007] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-14T16:50:16.558846] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-09-14T16:50:16.935728] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T16:50:17.358841] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-09-14T16:50:18.158877] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-09-14T16:50:18.751522] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-14T16:50:18.771072] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-14T16:50:18.958849] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-09-14T16:50:19.128940] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T16:50:19.433862] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-14T16:50:19.758872] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-09-14T16:50:20.558907] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-09-14T16:50:21.256662] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-14T16:50:21.358788] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-09-14T16:50:21.503678] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T16:50:22.158842] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-09-14T16:50:22.958877] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-09-14T16:50:23.412904] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-14T16:50:23.520973] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-14T16:50:23.758843] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-09-14T16:50:23.931345] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T16:50:24.558857] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-09-14T16:50:25.358810] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-09-14T16:50:25.418803] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T16:50:25.849003] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-14T16:50:26.158839] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-09-14T16:50:26.618203] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-14T16:50:26.958837] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-09-14T16:50:27.758892] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-09-14T16:50:27.996490] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-14T16:50:28.558837] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-09-14T16:50:28.620175] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T16:50:29.208121] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T16:50:29.209689] [INFO ] [REMOTE ] APOS: Full fetch complete (8085 records). [2025-09-14T16:50:29.209798] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-09-14T16:50:29.362871] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-09-14T16:50:29.571817] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-09-14T16:50:29.572033] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-09-14T16:50:29.572387] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-09-14T16:50:29.572464] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-09-14T16:50:29.573086] [DEBUG] [LOCAL ] APOS: Trimmed 8085 records to 5346 (keeping 150 days of data) [2025-09-14T16:50:29.635683] [DEBUG] [LOCAL ] APOS: Primary data saved (5346 records). [2025-09-14T16:50:29.636856] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-14T16:50:29.637046] [INFO ] [MAIN ] APOS: Full history saved. [2025-09-14T16:50:29.648201] [INFO ] [MAIN ] Update Progress: 131/2370 symbols completed. APOS took 17.0s. Estimated remaining: 3h 47m 18s. Rate: 9.9 symbols/min [2025-09-14T16:50:29.820012] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:50:29.844181] [DEBUG] [LOCAL ] APTV: Loaded 23229 existing records from primary storage. [2025-09-14T16:50:29.844387] [INFO ] [MAIN ] APTV: Loaded 23229 existing records. [2025-09-14T16:50:30.048521] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:50:30.048847] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-09-14T16:50:30.048921] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-14T16:50:30.049675] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-09-14T16:50:30.049742] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-09-14T16:50:30.159027] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-09-14T16:50:30.426295] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-14T16:50:30.453031] [INFO ] [REMOTE ] APTV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:50:30.454478] [INFO ] [REMOTE ] APH: Full fetch complete (58371 records). [2025-09-14T16:50:30.454632] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-09-14T16:50:30.831882] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-09-14T16:50:30.832013] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-09-14T16:50:30.832738] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-09-14T16:50:30.832863] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-09-14T16:50:30.834270] [DEBUG] [LOCAL ] APH: Trimmed 58371 records to 40431 (keeping 150 days of data) [2025-09-14T16:50:30.958890] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-09-14T16:50:31.098736] [DEBUG] [LOCAL ] APH: Primary data saved (40431 records). [2025-09-14T16:50:31.098906] [INFO ] [MAIN ] APH: Full history saved. [2025-09-14T16:50:31.099033] [INFO ] [MAIN ] Update Progress: 132/2370 symbols completed. APH took 34.8s. Estimated remaining: 3h 45m 54s. Rate: 9.9 symbols/min [2025-09-14T16:50:31.287996] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:50:31.309992] [DEBUG] [LOCAL ] AQN: Loaded 22979 existing records from primary storage. [2025-09-14T16:50:31.310183] [INFO ] [MAIN ] AQN: Loaded 22979 existing records. [2025-09-14T16:50:31.488634] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:50:31.488943] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-09-14T16:50:31.489030] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-09-14T16:50:31.489631] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-09-14T16:50:31.489726] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-09-14T16:50:31.759265] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-09-14T16:50:31.859458] [INFO ] [REMOTE ] AQN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:50:31.874951] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-14T16:50:31.880556] [INFO ] [REMOTE ] APO: Full fetch complete (58023 records). [2025-09-14T16:50:31.880720] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-09-14T16:50:32.208066] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-14T16:50:32.309969] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-09-14T16:50:32.310080] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-09-14T16:50:32.310756] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-09-14T16:50:32.310828] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-09-14T16:50:32.312154] [DEBUG] [LOCAL ] APO: Trimmed 58023 records to 40146 (keeping 150 days of data) [2025-09-14T16:50:32.558871] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-09-14T16:50:32.572039] [DEBUG] [LOCAL ] APO: Primary data saved (40146 records). [2025-09-14T16:50:32.572164] [INFO ] [MAIN ] APO: Full history saved. [2025-09-14T16:50:32.572266] [INFO ] [MAIN ] Update Progress: 133/2370 symbols completed. APO took 25.1s. Estimated remaining: 3h 44m 30s. Rate: 10.0 symbols/min [2025-09-14T16:50:32.749878] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:50:32.753438] [DEBUG] [LOCAL ] AQNB: Loaded 1849 existing records from primary storage. [2025-09-14T16:50:32.753538] [INFO ] [MAIN ] AQNB: Loaded 1849 existing records. [2025-09-14T16:50:32.929324] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:50:32.929669] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-09-14T16:50:32.929748] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-14T16:50:32.930073] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-09-14T16:50:32.930137] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-09-14T16:50:33.283280] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:50:33.358816] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-09-14T16:50:33.530089] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T16:50:33.683510] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-14T16:50:33.857662] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-14T16:50:34.158847] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-09-14T16:50:34.958890] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-09-14T16:50:35.509991] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-14T16:50:35.758866] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-09-14T16:50:35.941623] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-14T16:50:36.558849] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-09-14T16:50:37.011243] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-14T16:50:37.260341] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-14T16:50:37.358880] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-09-14T16:50:37.999734] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-14T16:50:38.158835] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-09-14T16:50:38.958840] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-09-14T16:50:39.600449] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T16:50:39.606338] [INFO ] [REMOTE ] APLE: Full fetch complete (56315 records). [2025-09-14T16:50:39.606483] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-09-14T16:50:39.781286] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-09-14T16:50:39.994365] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-09-14T16:50:39.994503] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-09-14T16:50:39.995354] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-09-14T16:50:39.995442] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-09-14T16:50:39.997011] [DEBUG] [LOCAL ] APLE: Trimmed 56315 records to 39120 (keeping 150 days of data) [2025-09-14T16:50:40.123594] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-14T16:50:40.292553] [DEBUG] [LOCAL ] APLE: Primary data saved (39120 records). [2025-09-14T16:50:40.292751] [INFO ] [MAIN ] APLE: Full history saved. [2025-09-14T16:50:40.292857] [INFO ] [MAIN ] Update Progress: 134/2370 symbols completed. APLE took 35.2s. Estimated remaining: 3h 44m 53s. Rate: 9.9 symbols/min [2025-09-14T16:50:40.404548] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T16:50:40.471554] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:50:40.494446] [DEBUG] [LOCAL ] AR: Loaded 24041 existing records from primary storage. [2025-09-14T16:50:40.494604] [INFO ] [MAIN ] AR: Loaded 24041 existing records. [2025-09-14T16:50:40.564025] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-09-14T16:50:40.673555] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:50:40.673816] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-09-14T16:50:40.673876] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-09-14T16:50:40.674504] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-09-14T16:50:40.674571] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-09-14T16:50:41.026442] [INFO ] [REMOTE ] AR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:50:41.358883] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-09-14T16:50:42.158842] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-09-14T16:50:42.457619] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-14T16:50:42.720574] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-14T16:50:42.764072] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-14T16:50:42.958838] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-09-14T16:50:43.530493] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-14T16:50:43.758876] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-09-14T16:50:44.558847] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-09-14T16:50:45.358875] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-09-14T16:50:45.610999] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-14T16:50:45.925857] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T16:50:46.158861] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-09-14T16:50:46.823103] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T16:50:46.958840] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-09-14T16:50:47.758851] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-09-14T16:50:48.014056] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T16:50:48.280107] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-14T16:50:48.558874] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-09-14T16:50:49.077171] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T16:50:49.078151] [INFO ] [REMOTE ] AQNB: Full fetch complete (4382 records). [2025-09-14T16:50:49.078237] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-09-14T16:50:49.361592] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-09-14T16:50:49.484311] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-09-14T16:50:49.487675] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T16:50:49.487951] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-09-14T16:50:49.498775] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-09-14T16:50:49.499197] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-09-14T16:50:49.499827] [DEBUG] [LOCAL ] AQNB: Trimmed 4382 records to 2963 (keeping 150 days of data) [2025-09-14T16:50:49.519177] [DEBUG] [LOCAL ] AQNB: Primary data saved (2963 records). [2025-09-14T16:50:49.519320] [INFO ] [MAIN ] AQNB: Full history saved. [2025-09-14T16:50:49.519429] [INFO ] [MAIN ] Update Progress: 135/2370 symbols completed. AQNB took 16.9s. Estimated remaining: 3h 45m 40s. Rate: 9.9 symbols/min [2025-09-14T16:50:49.701531] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:50:49.723660] [DEBUG] [LOCAL ] ARCO: Loaded 19776 existing records from primary storage. [2025-09-14T16:50:49.723831] [INFO ] [MAIN ] ARCO: Loaded 19776 existing records. [2025-09-14T16:50:49.907389] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:50:49.907709] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-09-14T16:50:49.907777] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-09-14T16:50:49.908411] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-09-14T16:50:49.908486] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-09-14T16:50:50.165828] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-09-14T16:50:50.430670] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:50:50.958956] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-09-14T16:50:51.176694] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-14T16:50:51.758878] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-09-14T16:50:52.006667] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T16:50:52.268632] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-14T16:50:52.558847] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-09-14T16:50:53.309426] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T16:50:53.358786] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-09-14T16:50:54.166217] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-09-14T16:50:54.195131] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-14T16:50:54.733431] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-14T16:50:54.958842] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-09-14T16:50:55.758847] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-09-14T16:50:55.831360] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T16:50:56.558829] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-09-14T16:50:56.832845] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T16:50:57.358821] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-09-14T16:50:57.411519] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T16:50:58.071485] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-14T16:50:58.077699] [INFO ] [REMOTE ] AQN: Full fetch complete (56594 records). [2025-09-14T16:50:58.077830] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-09-14T16:50:58.166719] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-09-14T16:50:58.456583] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-09-14T16:50:58.456763] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-09-14T16:50:58.457591] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-09-14T16:50:58.457726] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-09-14T16:50:58.459551] [DEBUG] [LOCAL ] AQN: Trimmed 56594 records to 38906 (keeping 150 days of data) [2025-09-14T16:50:58.719380] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-14T16:50:58.755538] [DEBUG] [LOCAL ] AQN: Primary data saved (38906 records). [2025-09-14T16:50:58.755736] [INFO ] [MAIN ] AQN: Full history saved. [2025-09-14T16:50:58.755886] [INFO ] [MAIN ] Update Progress: 136/2370 symbols completed. AQN took 27.7s. Estimated remaining: 3h 46m 26s. Rate: 9.9 symbols/min [2025-09-14T16:50:58.927699] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:50:58.937250] [DEBUG] [LOCAL ] ARDC: Loaded 6834 existing records from primary storage. [2025-09-14T16:50:58.937399] [INFO ] [MAIN ] ARDC: Loaded 6834 existing records. [2025-09-14T16:50:58.967625] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-09-14T16:50:59.119090] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:50:59.119334] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-09-14T16:50:59.119414] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-09-14T16:50:59.119780] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-09-14T16:50:59.119845] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-09-14T16:50:59.481174] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:50:59.758785] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-09-14T16:50:59.811163] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T16:51:00.117607] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-14T16:51:00.123278] [INFO ] [REMOTE ] APTV: Full fetch complete (56907 records). [2025-09-14T16:51:00.123502] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-09-14T16:51:00.528174] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-09-14T16:51:00.528386] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-09-14T16:51:00.529143] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-09-14T16:51:00.537791] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-09-14T16:51:00.554677] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-14T16:51:00.564860] [DEBUG] [LOCAL ] APTV: Trimmed 56907 records to 39109 (keeping 150 days of data) [2025-09-14T16:51:00.564055] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-09-14T16:51:00.804071] [DEBUG] [LOCAL ] APTV: Primary data saved (39109 records). [2025-09-14T16:51:00.804257] [INFO ] [MAIN ] APTV: Full history saved. [2025-09-14T16:51:00.804367] [INFO ] [MAIN ] Update Progress: 137/2370 symbols completed. APTV took 31.2s. Estimated remaining: 3h 45m 14s. Rate: 9.9 symbols/min [2025-09-14T16:51:00.975778] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:51:00.990243] [DEBUG] [LOCAL ] ARDT: Loaded 12876 existing records from primary storage. [2025-09-14T16:51:00.990391] [INFO ] [MAIN ] ARDT: Loaded 12876 existing records. [2025-09-14T16:51:01.176272] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:51:01.176532] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-09-14T16:51:01.176592] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-14T16:51:01.177092] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-09-14T16:51:01.177169] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-09-14T16:51:01.359980] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-09-14T16:51:01.562018] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:51:01.570551] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-14T16:51:02.158837] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-09-14T16:51:02.850973] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T16:51:02.958823] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-09-14T16:51:03.213378] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T16:51:03.759056] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-09-14T16:51:03.758972] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-14T16:51:04.413935] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T16:51:04.419679] [INFO ] [REMOTE ] AR: Full fetch complete (58261 records). [2025-09-14T16:51:04.419896] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-09-14T16:51:04.568142] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-09-14T16:51:04.820065] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-09-14T16:51:04.820200] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-09-14T16:51:04.820897] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-09-14T16:51:04.820971] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-09-14T16:51:04.822458] [DEBUG] [LOCAL ] AR: Trimmed 58261 records to 40342 (keeping 150 days of data) [2025-09-14T16:51:05.071148] [DEBUG] [LOCAL ] AR: Primary data saved (40342 records). [2025-09-14T16:51:05.071326] [INFO ] [MAIN ] AR: Full history saved. [2025-09-14T16:51:05.071451] [INFO ] [MAIN ] Update Progress: 138/2370 symbols completed. AR took 24.8s. Estimated remaining: 3h 44m 39s. Rate: 9.9 symbols/min [2025-09-14T16:51:05.248416] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:51:05.275998] [DEBUG] [LOCAL ] ARE: Loaded 22587 existing records from primary storage. [2025-09-14T16:51:05.276325] [INFO ] [MAIN ] ARE: Loaded 22587 existing records. [2025-09-14T16:51:05.363971] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-09-14T16:51:05.467589] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:51:05.467919] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-09-14T16:51:05.467983] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-09-14T16:51:05.468599] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-09-14T16:51:05.468710] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-09-14T16:51:05.841161] [INFO ] [REMOTE ] ARE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:51:06.158824] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-09-14T16:51:06.184449] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-14T16:51:06.230562] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T16:51:06.958887] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-09-14T16:51:07.352400] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-14T16:51:07.758841] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-09-14T16:51:08.145906] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-14T16:51:08.558882] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-09-14T16:51:08.653303] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-14T16:51:09.358843] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-09-14T16:51:09.944553] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-14T16:51:10.158843] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-09-14T16:51:10.958859] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-09-14T16:51:11.036336] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-14T16:51:11.127753] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T16:51:11.758892] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-09-14T16:51:11.940794] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-14T16:51:12.558821] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-09-14T16:51:12.870886] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T16:51:13.358923] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-09-14T16:51:13.771568] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-14T16:51:14.158874] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-09-14T16:51:14.966689] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-09-14T16:51:14.969683] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T16:51:15.061486] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T16:51:15.758850] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-09-14T16:51:16.558824] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-09-14T16:51:16.905401] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T16:51:16.958355] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T16:51:17.183781] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T16:51:17.185818] [INFO ] [REMOTE ] ARDC: Full fetch complete (15956 records). [2025-09-14T16:51:17.185908] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-09-14T16:51:17.363951] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-09-14T16:51:17.567994] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-09-14T16:51:17.568118] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-09-14T16:51:17.568480] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-09-14T16:51:17.568537] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-09-14T16:51:17.569251] [DEBUG] [LOCAL ] ARDC: Trimmed 15956 records to 10479 (keeping 150 days of data) [2025-09-14T16:51:17.642618] [DEBUG] [LOCAL ] ARDC: Primary data saved (10479 records). [2025-09-14T16:51:17.642842] [INFO ] [MAIN ] ARDC: Full history saved. [2025-09-14T16:51:17.642950] [INFO ] [MAIN ] Update Progress: 139/2370 symbols completed. ARDC took 18.9s. Estimated remaining: 3h 46m 18s. Rate: 9.9 symbols/min [2025-09-14T16:51:17.812443] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:51:17.834356] [DEBUG] [LOCAL ] ARES: Loaded 21664 existing records from primary storage. [2025-09-14T16:51:17.834540] [INFO ] [MAIN ] ARES: Loaded 21664 existing records. [2025-09-14T16:51:18.009571] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:51:18.009849] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-09-14T16:51:18.009912] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-09-14T16:51:18.010512] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-09-14T16:51:18.010577] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-09-14T16:51:18.165974] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-09-14T16:51:18.376138] [INFO ] [REMOTE ] ARES: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:51:18.958817] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-09-14T16:51:19.277005] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T16:51:19.494846] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-14T16:51:19.499520] [INFO ] [REMOTE ] ARCO: Full fetch complete (48596 records). [2025-09-14T16:51:19.499680] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-09-14T16:51:19.763905] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-09-14T16:51:19.876549] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-09-14T16:51:19.876695] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-09-14T16:51:19.877304] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-09-14T16:51:19.877401] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-09-14T16:51:19.878954] [DEBUG] [LOCAL ] ARCO: Trimmed 48596 records to 33598 (keeping 150 days of data) [2025-09-14T16:51:20.082886] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T16:51:20.112591] [DEBUG] [LOCAL ] ARCO: Primary data saved (33598 records). [2025-09-14T16:51:20.112805] [INFO ] [MAIN ] ARCO: Full history saved. [2025-09-14T16:51:20.112926] [INFO ] [MAIN ] Update Progress: 140/2370 symbols completed. ARCO took 30.6s. Estimated remaining: 3h 45m 14s. Rate: 9.9 symbols/min [2025-09-14T16:51:20.283584] [INFO ] [MAIN ] ARGD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:51:20.286853] [DEBUG] [LOCAL ] ARGD: Loaded 1416 existing records from primary storage. [2025-09-14T16:51:20.286945] [INFO ] [MAIN ] ARGD: Loaded 1416 existing records. [2025-09-14T16:51:20.463213] [WARN ] [MAIN ] ARGD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:51:20.463506] [INFO ] [MAIN ] ARGD: Wiping existing primary data before full refresh. [2025-09-14T16:51:20.463571] [INFO ] [LOCAL ] ARGD: Starting deletion of primary data. [2025-09-14T16:51:20.463816] [DEBUG] [LOCAL ] ARGD: Deleted primary data file. [2025-09-14T16:51:20.463904] [INFO ] [MAIN ] ARGD: Starting full primary refresh. [2025-09-14T16:51:20.567803] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-09-14T16:51:20.869100] [INFO ] [REMOTE ] ARGD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:51:21.358887] [INFO ] [REMOTE ] ARGD: Fetching primary data for 2025-02. [2025-09-14T16:51:21.699685] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-14T16:51:21.841692] [INFO ] [REMOTE ] ARGD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-14T16:51:22.158933] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-09-14T16:51:22.298296] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T16:51:22.958837] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-09-14T16:51:23.720212] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-14T16:51:23.758809] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-09-14T16:51:24.558865] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-09-14T16:51:24.780525] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T16:51:25.358861] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-09-14T16:51:25.526708] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T16:51:25.574022] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-14T16:51:26.158828] [INFO ] [REMOTE ] ARGD: Fetching primary data for 2025-03. [2025-09-14T16:51:26.600062] [INFO ] [REMOTE ] ARGD: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-14T16:51:26.814457] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T16:51:26.958875] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-09-14T16:51:27.758880] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-09-14T16:51:27.900318] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-14T16:51:27.904662] [INFO ] [REMOTE ] ARDT: Full fetch complete (31342 records). [2025-09-14T16:51:27.904935] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-09-14T16:51:28.287137] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-09-14T16:51:28.287277] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-09-14T16:51:28.287895] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-09-14T16:51:28.287967] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-09-14T16:51:28.289108] [DEBUG] [LOCAL ] ARDT: Trimmed 31342 records to 20242 (keeping 150 days of data) [2025-09-14T16:51:28.422788] [DEBUG] [LOCAL ] ARDT: Primary data saved (20242 records). [2025-09-14T16:51:28.439012] [INFO ] [MAIN ] ARDT: Full history saved. [2025-09-14T16:51:28.439974] [INFO ] [MAIN ] Update Progress: 141/2370 symbols completed. ARDT took 27.6s. Estimated remaining: 3h 45m 44s. Rate: 9.9 symbols/min [2025-09-14T16:51:28.441035] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T16:51:28.531125] [INFO ] [REMOTE ] ARE: Full fetch complete (54822 records). [2025-09-14T16:51:28.556931] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-09-14T16:51:28.563588] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-09-14T16:51:28.759513] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:51:29.003817] [DEBUG] [LOCAL ] ARI: Loaded 18692 existing records from primary storage. [2025-09-14T16:51:29.030183] [INFO ] [MAIN ] ARI: Loaded 18692 existing records. [2025-09-14T16:51:29.168563] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-09-14T16:51:29.194871] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-09-14T16:51:29.215521] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-09-14T16:51:29.222414] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-09-14T16:51:29.313686] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:51:29.313947] [DEBUG] [LOCAL ] ARE: Trimmed 54822 records to 38314 (keeping 150 days of data) [2025-09-14T16:51:29.314406] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-09-14T16:51:29.315009] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-09-14T16:51:29.315713] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-09-14T16:51:29.315796] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-09-14T16:51:29.410188] [INFO ] [REMOTE ] ARGD: Fetching primary data for 2025-04. [2025-09-14T16:51:29.799603] [INFO ] [REMOTE ] ARI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:51:29.921781] [INFO ] [REMOTE ] ARGD: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-14T16:51:29.959378] [DEBUG] [LOCAL ] ARE: Primary data saved (38314 records). [2025-09-14T16:51:29.959662] [INFO ] [MAIN ] ARE: Full history saved. [2025-09-14T16:51:29.959802] [INFO ] [MAIN ] Update Progress: 142/2370 symbols completed. ARE took 24.9s. Estimated remaining: 3h 44m 26s. Rate: 9.9 symbols/min [2025-09-14T16:51:30.142713] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:51:30.163873] [INFO ] [REMOTE ] ARGD: Fetching primary data for 2025-05. [2025-09-14T16:51:30.165850] [DEBUG] [LOCAL ] ARIS: Loaded 18640 existing records from primary storage. [2025-09-14T16:51:30.166055] [INFO ] [MAIN ] ARIS: Loaded 18640 existing records. [2025-09-14T16:51:30.362070] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:51:30.362468] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-09-14T16:51:30.362630] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-14T16:51:30.363482] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-09-14T16:51:30.363558] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-09-14T16:51:30.764723] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:51:30.764950] [INFO ] [REMOTE ] ARGD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-14T16:51:30.769539] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-14T16:51:30.958872] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-09-14T16:51:31.758927] [INFO ] [REMOTE ] ARGD: Fetching primary data for 2025-06. [2025-09-14T16:51:32.117899] [INFO ] [REMOTE ] ARGD: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-14T16:51:32.370229] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T16:51:32.558894] [INFO ] [REMOTE ] ARGD: Fetching primary data for 2025-07. [2025-09-14T16:51:32.976071] [INFO ] [REMOTE ] ARGD: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-14T16:51:33.358877] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-09-14T16:51:34.158850] [INFO ] [REMOTE ] ARGD: Fetching primary data for 2025-08. [2025-09-14T16:51:34.766832] [INFO ] [REMOTE ] ARGD: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-14T16:51:34.847010] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-14T16:51:34.958809] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-09-14T16:51:35.758849] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-09-14T16:51:36.518181] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-14T16:51:36.558888] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-09-14T16:51:37.281312] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T16:51:37.358834] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-09-14T16:51:38.158843] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-09-14T16:51:38.194958] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T16:51:38.906053] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T16:51:38.958838] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-09-14T16:51:39.560751] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-14T16:51:39.758822] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-09-14T16:51:40.558824] [INFO ] [REMOTE ] ARGD: Fetching primary data for 2025-09. [2025-09-14T16:51:40.691301] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-14T16:51:41.087060] [INFO ] [REMOTE ] ARGD: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T16:51:41.088069] [INFO ] [REMOTE ] ARGD: Full fetch complete (2549 records). [2025-09-14T16:51:41.088153] [DEBUG] [VALIDATOR ] ARGD: Validating primary data. [2025-09-14T16:51:41.363951] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-09-14T16:51:41.448487] [DEBUG] [VALIDATOR ] ARGD: All expected trading days are present. [2025-09-14T16:51:41.448790] [DEBUG] [VALIDATOR ] ARGD: Primary data validation passed. [2025-09-14T16:51:41.448929] [INFO ] [MAIN ] ARGD: Fetched primary data is valid. [2025-09-14T16:51:41.449028] [DEBUG] [LOCAL ] ARGD: Saving primary data. [2025-09-14T16:51:41.449687] [DEBUG] [LOCAL ] ARGD: Trimmed 2549 records to 1963 (keeping 150 days of data) [2025-09-14T16:51:41.462509] [DEBUG] [LOCAL ] ARGD: Primary data saved (1963 records). [2025-09-14T16:51:41.462625] [INFO ] [MAIN ] ARGD: Full history saved. [2025-09-14T16:51:41.462793] [INFO ] [MAIN ] Update Progress: 143/2370 symbols completed. ARGD took 21.3s. Estimated remaining: 3h 45m 45s. Rate: 9.9 symbols/min [2025-09-14T16:51:41.584541] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-14T16:51:41.672581] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:51:41.694359] [DEBUG] [LOCAL ] ARLO: Loaded 20471 existing records from primary storage. [2025-09-14T16:51:41.694521] [INFO ] [MAIN ] ARLO: Loaded 20471 existing records. [2025-09-14T16:51:41.896515] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:51:41.896943] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-09-14T16:51:41.897017] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-14T16:51:41.897777] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-09-14T16:51:41.897846] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-09-14T16:51:42.166559] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-09-14T16:51:42.249976] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:51:42.959037] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-09-14T16:51:43.018754] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T16:51:43.758828] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-09-14T16:51:43.829686] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T16:51:44.234557] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-14T16:51:44.558874] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-09-14T16:51:45.258266] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T16:51:45.358833] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-09-14T16:51:45.813099] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-14T16:51:46.158834] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-09-14T16:51:46.738703] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-14T16:51:46.958841] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-09-14T16:51:47.440529] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-14T16:51:47.758835] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-09-14T16:51:48.558843] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-09-14T16:51:48.810770] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-14T16:51:49.358832] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-09-14T16:51:49.451553] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T16:51:50.168955] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-09-14T16:51:50.172251] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T16:51:50.423242] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-09-14T16:51:50.427753] [INFO ] [REMOTE ] ARI: Full fetch complete (46885 records). [2025-09-14T16:51:50.427924] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-09-14T16:51:50.804155] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-09-14T16:51:50.804265] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-09-14T16:51:50.804811] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-09-14T16:51:50.804871] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-09-14T16:51:50.805987] [DEBUG] [LOCAL ] ARI: Trimmed 46885 records to 32487 (keeping 150 days of data) [2025-09-14T16:51:50.966371] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-09-14T16:51:50.997590] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-14T16:51:51.010781] [INFO ] [REMOTE ] ARES: Full fetch complete (53933 records). [2025-09-14T16:51:51.012177] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-09-14T16:51:51.292352] [DEBUG] [LOCAL ] ARI: Primary data saved (32487 records). [2025-09-14T16:51:51.318768] [INFO ] [MAIN ] ARI: Full history saved. [2025-09-14T16:51:51.318932] [INFO ] [MAIN ] Update Progress: 144/2370 symbols completed. ARI took 22.9s. Estimated remaining: 3h 46m 38s. Rate: 9.8 symbols/min [2025-09-14T16:51:51.515183] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-09-14T16:51:51.518498] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-09-14T16:51:51.519388] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-09-14T16:51:51.529963] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-09-14T16:51:51.596064] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:51:51.596456] [DEBUG] [LOCAL ] ARES: Trimmed 53933 records to 36960 (keeping 150 days of data) [2025-09-14T16:51:51.718491] [DEBUG] [LOCAL ] ARMK: Loaded 22387 existing records from primary storage. [2025-09-14T16:51:51.720543] [INFO ] [MAIN ] ARMK: Loaded 22387 existing records. [2025-09-14T16:51:51.767727] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-09-14T16:51:51.922829] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:51:51.925631] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-09-14T16:51:51.927858] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-14T16:51:51.929860] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-09-14T16:51:51.930201] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-09-14T16:51:52.381296] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:51:52.406001] [DEBUG] [LOCAL ] ARES: Primary data saved (36960 records). [2025-09-14T16:51:52.406181] [INFO ] [MAIN ] ARES: Full history saved. [2025-09-14T16:51:52.406322] [INFO ] [MAIN ] Update Progress: 145/2370 symbols completed. ARES took 34.8s. Estimated remaining: 3h 45m 14s. Rate: 9.9 symbols/min [2025-09-14T16:51:52.578176] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:51:52.575713] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-09-14T16:51:52.604885] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-14T16:51:52.627925] [DEBUG] [LOCAL ] AROC: Loaded 21959 existing records from primary storage. [2025-09-14T16:51:52.628072] [INFO ] [MAIN ] AROC: Loaded 21959 existing records. [2025-09-14T16:51:52.817569] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:51:52.817910] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-09-14T16:51:52.817987] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-14T16:51:52.824559] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-09-14T16:51:52.834825] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-09-14T16:51:52.867010] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-14T16:51:52.941071] [INFO ] [REMOTE ] ARIS: Full fetch complete (45552 records). [2025-09-14T16:51:52.943460] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-09-14T16:51:53.367753] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-09-14T16:51:53.442243] [INFO ] [REMOTE ] AROC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:51:53.577021] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-09-14T16:51:53.577123] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-09-14T16:51:53.577629] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-09-14T16:51:53.577702] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-09-14T16:51:53.578821] [DEBUG] [LOCAL ] ARIS: Trimmed 45552 records to 31143 (keeping 150 days of data) [2025-09-14T16:51:53.777832] [DEBUG] [LOCAL ] ARIS: Primary data saved (31143 records). [2025-09-14T16:51:53.778026] [INFO ] [MAIN ] ARIS: Full history saved. [2025-09-14T16:51:53.778156] [INFO ] [MAIN ] Update Progress: 146/2370 symbols completed. ARIS took 23.8s. Estimated remaining: 3h 43m 57s. Rate: 9.9 symbols/min [2025-09-14T16:51:53.953831] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:51:53.994864] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-14T16:51:54.026120] [DEBUG] [LOCAL ] ARR: Loaded 23340 existing records from primary storage. [2025-09-14T16:51:54.026331] [INFO ] [MAIN ] ARR: Loaded 23340 existing records. [2025-09-14T16:51:54.164018] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-09-14T16:51:54.202269] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:51:54.202554] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-09-14T16:51:54.202639] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-09-14T16:51:54.203271] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-09-14T16:51:54.203339] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-09-14T16:51:54.558119] [INFO ] [REMOTE ] ARR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:51:54.619486] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T16:51:54.958825] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-09-14T16:51:55.758810] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-09-14T16:51:55.918234] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T16:51:56.558810] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-09-14T16:51:56.641577] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-14T16:51:57.346997] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T16:51:57.358776] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-09-14T16:51:58.158825] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-09-14T16:51:58.424596] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T16:51:58.958845] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-09-14T16:51:59.073169] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-14T16:51:59.767943] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-09-14T16:51:59.786145] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T16:52:00.558839] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-09-14T16:52:00.857432] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-14T16:52:01.358847] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-09-14T16:52:01.638901] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T16:52:02.158846] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-09-14T16:52:02.662952] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-14T16:52:02.958834] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-09-14T16:52:03.098471] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T16:52:03.526124] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-14T16:52:03.758843] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-09-14T16:52:04.558809] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-09-14T16:52:04.892044] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-14T16:52:05.364013] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-09-14T16:52:05.369306] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T16:52:06.158835] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-09-14T16:52:06.273449] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T16:52:06.790840] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-14T16:52:06.958869] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-09-14T16:52:07.758907] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-09-14T16:52:07.940818] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-14T16:52:08.550947] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-14T16:52:08.561613] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-09-14T16:52:08.926498] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-14T16:52:09.358849] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-09-14T16:52:09.686727] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T16:52:09.691896] [INFO ] [REMOTE ] ARLO: Full fetch complete (47521 records). [2025-09-14T16:52:09.692066] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-09-14T16:52:10.098943] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-09-14T16:52:10.099094] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-09-14T16:52:10.099684] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-09-14T16:52:10.099771] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-09-14T16:52:10.100951] [DEBUG] [LOCAL ] ARLO: Trimmed 47521 records to 32823 (keeping 150 days of data) [2025-09-14T16:52:10.161094] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-09-14T16:52:10.311800] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T16:52:10.336693] [DEBUG] [LOCAL ] ARLO: Primary data saved (32823 records). [2025-09-14T16:52:10.336847] [INFO ] [MAIN ] ARLO: Full history saved. [2025-09-14T16:52:10.336940] [INFO ] [MAIN ] Update Progress: 147/2370 symbols completed. ARLO took 28.9s. Estimated remaining: 3h 46m 30s. Rate: 9.8 symbols/min [2025-09-14T16:52:10.536557] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:52:10.552960] [DEBUG] [LOCAL ] ARW: Loaded 13792 existing records from primary storage. [2025-09-14T16:52:10.553101] [INFO ] [MAIN ] ARW: Loaded 13792 existing records. [2025-09-14T16:52:10.733519] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:52:10.733896] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-09-14T16:52:10.733970] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-14T16:52:10.734436] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-09-14T16:52:10.734506] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-09-14T16:52:10.967416] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-09-14T16:52:11.092688] [INFO ] [REMOTE ] ARW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:52:11.623844] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T16:52:11.758881] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-09-14T16:52:12.558858] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-09-14T16:52:12.736564] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T16:52:13.270163] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T16:52:13.297844] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T16:52:13.305807] [INFO ] [REMOTE ] AROC: Full fetch complete (53184 records). [2025-09-14T16:52:13.306038] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-09-14T16:52:13.368002] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-09-14T16:52:13.710529] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-09-14T16:52:13.710661] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-09-14T16:52:13.711260] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-09-14T16:52:13.711326] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-09-14T16:52:13.712623] [DEBUG] [LOCAL ] AROC: Trimmed 53184 records to 36498 (keeping 150 days of data) [2025-09-14T16:52:13.950627] [DEBUG] [LOCAL ] AROC: Primary data saved (36498 records). [2025-09-14T16:52:13.950838] [INFO ] [MAIN ] AROC: Full history saved. [2025-09-14T16:52:13.950962] [INFO ] [MAIN ] Update Progress: 148/2370 symbols completed. AROC took 21.5s. Estimated remaining: 3h 45m 46s. Rate: 9.8 symbols/min [2025-09-14T16:52:14.120676] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:52:14.133245] [DEBUG] [LOCAL ] ARX: Loaded 11341 existing records from primary storage. [2025-09-14T16:52:14.133388] [INFO ] [MAIN ] ARX: Loaded 11341 existing records. [2025-09-14T16:52:14.164196] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-09-14T16:52:14.312241] [WARN ] [MAIN ] ARX: Insufficient historical data. Have data from 2025-07-24, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:52:14.312490] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-14T16:52:14.312569] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-14T16:52:14.312985] [DEBUG] [LOCAL ] ARX: Deleted primary data file. [2025-09-14T16:52:14.313065] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-14T16:52:14.674382] [INFO ] [REMOTE ] ARX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:52:14.688510] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T16:52:14.693901] [INFO ] [REMOTE ] ARMK: Full fetch complete (54686 records). [2025-09-14T16:52:14.694011] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-09-14T16:52:14.963885] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-09-14T16:52:15.080364] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-09-14T16:52:15.080467] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-09-14T16:52:15.081096] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-09-14T16:52:15.081162] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-09-14T16:52:15.082383] [DEBUG] [LOCAL ] ARMK: Trimmed 54686 records to 37720 (keeping 150 days of data) [2025-09-14T16:52:15.317334] [DEBUG] [LOCAL ] ARMK: Primary data saved (37720 records). [2025-09-14T16:52:15.317532] [INFO ] [MAIN ] ARMK: Full history saved. [2025-09-14T16:52:15.317696] [INFO ] [MAIN ] Update Progress: 149/2370 symbols completed. ARMK took 24.0s. Estimated remaining: 3h 44m 30s. Rate: 9.9 symbols/min [2025-09-14T16:52:15.490016] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:52:15.522977] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-14T16:52:15.552011] [DEBUG] [LOCAL ] AS: Loaded 23795 existing records from primary storage. [2025-09-14T16:52:15.552179] [INFO ] [MAIN ] AS: Loaded 23795 existing records. [2025-09-14T16:52:15.726846] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:52:15.727110] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-09-14T16:52:15.727183] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-14T16:52:15.727772] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-09-14T16:52:15.727842] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-09-14T16:52:15.764014] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-02. [2025-09-14T16:52:16.086287] [INFO ] [REMOTE ] AS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:52:16.088961] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:52:16.089217] [WARN ] [REMOTE ] ARX: No data returned for month 2025-02 [2025-09-14T16:52:16.563887] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-03. [2025-09-14T16:52:16.578220] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T16:52:16.829219] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:52:16.829599] [WARN ] [REMOTE ] ARX: No data returned for month 2025-03 [2025-09-14T16:52:17.358841] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-09-14T16:52:18.158899] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-09-14T16:52:18.958838] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-04. [2025-09-14T16:52:19.214274] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:52:19.214679] [WARN ] [REMOTE ] ARX: No data returned for month 2025-04 [2025-09-14T16:52:19.351031] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-14T16:52:19.760265] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-09-14T16:52:19.763128] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T16:52:20.558830] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-09-14T16:52:21.358883] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-09-14T16:52:21.410892] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-14T16:52:21.565475] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-14T16:52:21.988267] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T16:52:21.993603] [INFO ] [REMOTE ] ARR: Full fetch complete (56582 records). [2025-09-14T16:52:21.993746] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-09-14T16:52:22.170483] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-05. [2025-09-14T16:52:22.384677] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-09-14T16:52:22.384789] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-09-14T16:52:22.385466] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-09-14T16:52:22.385537] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-09-14T16:52:22.386879] [DEBUG] [LOCAL ] ARR: Trimmed 56582 records to 39076 (keeping 150 days of data) [2025-09-14T16:52:22.528932] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:52:22.529426] [WARN ] [REMOTE ] ARX: No data returned for month 2025-05 [2025-09-14T16:52:22.654854] [DEBUG] [LOCAL ] ARR: Primary data saved (39076 records). [2025-09-14T16:52:22.655058] [INFO ] [MAIN ] ARR: Full history saved. [2025-09-14T16:52:22.655173] [INFO ] [MAIN ] Update Progress: 150/2370 symbols completed. ARR took 28.9s. Estimated remaining: 3h 44m 42s. Rate: 9.9 symbols/min [2025-09-14T16:52:22.832805] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:52:22.841621] [DEBUG] [LOCAL ] ASA: Loaded 6464 existing records from primary storage. [2025-09-14T16:52:22.841795] [INFO ] [MAIN ] ASA: Loaded 6464 existing records. [2025-09-14T16:52:22.963899] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-06. [2025-09-14T16:52:23.025173] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:52:23.025434] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-09-14T16:52:23.025495] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-14T16:52:23.025803] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-09-14T16:52:23.025869] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-09-14T16:52:23.310431] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:52:23.316326] [WARN ] [REMOTE ] ARX: No data returned for month 2025-06 [2025-09-14T16:52:23.393427] [INFO ] [REMOTE ] ASA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:52:23.758865] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-09-14T16:52:24.558843] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-09-14T16:52:25.209600] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-14T16:52:25.358837] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-09-14T16:52:25.545847] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T16:52:26.158843] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-07. [2025-09-14T16:52:26.861444] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-14T16:52:26.958822] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-09-14T16:52:27.223290] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T16:52:27.590199] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-14T16:52:27.758847] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-09-14T16:52:28.558879] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-08. [2025-09-14T16:52:28.651337] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T16:52:29.358844] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-09-14T16:52:30.120893] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T16:52:30.158791] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-09-14T16:52:30.433968] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T16:52:30.958845] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-09-14T16:52:31.758835] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-09-14T16:52:31.909550] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-14T16:52:31.943163] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T16:52:32.558870] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-09-14T16:52:33.094214] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T16:52:33.358826] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-09. [2025-09-14T16:52:33.383194] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T16:52:34.158849] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-09-14T16:52:34.698251] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-14T16:52:34.702927] [INFO ] [REMOTE ] ARX: Full fetch complete (11316 records). [2025-09-14T16:52:34.703020] [DEBUG] [VALIDATOR ] ARX: Validating primary data. [2025-09-14T16:52:34.889244] [WARN ] [VALIDATOR ] ARX: Validation failed - insufficient historical data. Have 36 unique days, need 150 days [2025-09-14T16:52:34.889581] [FATAL] [MAIN ] ARX: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:52:34.889655] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:52:34.889716] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-14T16:52:34.889810] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-14T16:52:34.889913] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-14T16:52:34.890006] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-14T16:52:34.890139] [INFO ] [MAIN ] Update Progress: 151/2370 symbols completed. ARX took 20.9s. Estimated remaining: 3h 46m 7s. Rate: 9.8 symbols/min [2025-09-14T16:52:34.964327] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-09-14T16:52:35.098160] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:52:35.133082] [DEBUG] [LOCAL ] ASAN: Loaded 23750 existing records from primary storage. [2025-09-14T16:52:35.133340] [INFO ] [MAIN ] ASAN: Loaded 23750 existing records. [2025-09-14T16:52:35.368708] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:52:35.369076] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-09-14T16:52:35.369175] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-14T16:52:35.370093] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-09-14T16:52:35.370194] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-09-14T16:52:35.728768] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T16:52:35.768575] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-09-14T16:52:36.016154] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:52:36.570853] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-09-14T16:52:36.605394] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T16:52:36.606421] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-14T16:52:36.841418] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-14T16:52:36.846158] [INFO ] [REMOTE ] ARW: Full fetch complete (36172 records). [2025-09-14T16:52:36.846387] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-09-14T16:52:37.240586] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-09-14T16:52:37.240754] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-09-14T16:52:37.241353] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-09-14T16:52:37.241415] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-09-14T16:52:37.242808] [DEBUG] [LOCAL ] ARW: Trimmed 36172 records to 24276 (keeping 150 days of data) [2025-09-14T16:52:37.359359] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-09-14T16:52:37.409354] [DEBUG] [LOCAL ] ARW: Primary data saved (24276 records). [2025-09-14T16:52:37.409546] [INFO ] [MAIN ] ARW: Full history saved. [2025-09-14T16:52:37.409699] [INFO ] [MAIN ] Update Progress: 152/2370 symbols completed. ARW took 27.1s. Estimated remaining: 3h 45m 8s. Rate: 9.9 symbols/min [2025-09-14T16:52:37.585971] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:52:37.607735] [DEBUG] [LOCAL ] ASB: Loaded 22101 existing records from primary storage. [2025-09-14T16:52:37.607912] [INFO ] [MAIN ] ASB: Loaded 22101 existing records. [2025-09-14T16:52:37.783378] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:52:37.783700] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-09-14T16:52:37.783766] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-14T16:52:37.784365] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-09-14T16:52:37.784439] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-09-14T16:52:38.151370] [INFO ] [REMOTE ] ASB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:52:38.158799] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-09-14T16:52:38.399519] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-14T16:52:38.958844] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-09-14T16:52:39.759006] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-09-14T16:52:39.807200] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-14T16:52:39.832543] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T16:52:39.835922] [INFO ] [REMOTE ] ASA: Full fetch complete (14199 records). [2025-09-14T16:52:39.836033] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-09-14T16:52:40.220094] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-09-14T16:52:40.220239] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-09-14T16:52:40.220696] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-09-14T16:52:40.220769] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-09-14T16:52:40.221688] [DEBUG] [LOCAL ] ASA: Trimmed 14199 records to 10448 (keeping 150 days of data) [2025-09-14T16:52:40.289000] [DEBUG] [LOCAL ] ASA: Primary data saved (10448 records). [2025-09-14T16:52:40.289173] [INFO ] [MAIN ] ASA: Full history saved. [2025-09-14T16:52:40.289303] [INFO ] [MAIN ] Update Progress: 153/2370 symbols completed. ASA took 17.6s. Estimated remaining: 3h 44m 16s. Rate: 9.9 symbols/min [2025-09-14T16:52:40.456958] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:52:40.460675] [DEBUG] [LOCAL ] ASBA: Loaded 1676 existing records from primary storage. [2025-09-14T16:52:40.460773] [INFO ] [MAIN ] ASBA: Loaded 1676 existing records. [2025-09-14T16:52:40.559036] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-09-14T16:52:40.637864] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:52:40.638139] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-09-14T16:52:40.638200] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-09-14T16:52:40.638449] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-09-14T16:52:40.638510] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-09-14T16:52:40.992550] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:52:41.358857] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-09-14T16:52:41.471555] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T16:52:41.953588] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-14T16:52:42.158858] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-09-14T16:52:42.371964] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T16:52:42.751208] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-14T16:52:42.958831] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-09-14T16:52:43.758861] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-09-14T16:52:44.164893] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-14T16:52:44.558809] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-09-14T16:52:44.674446] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T16:52:45.358837] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-09-14T16:52:45.952480] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-14T16:52:46.158819] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-09-14T16:52:46.232782] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T16:52:46.958893] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-09-14T16:52:47.669708] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-14T16:52:47.675403] [INFO ] [REMOTE ] AS: Full fetch complete (57682 records). [2025-09-14T16:52:47.675624] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-09-14T16:52:47.767244] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-09-14T16:52:48.064915] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-09-14T16:52:48.065065] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-09-14T16:52:48.065694] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-09-14T16:52:48.065754] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-09-14T16:52:48.067306] [DEBUG] [LOCAL ] AS: Trimmed 57682 records to 39972 (keeping 150 days of data) [2025-09-14T16:52:48.280194] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-14T16:52:48.317851] [DEBUG] [LOCAL ] AS: Primary data saved (39972 records). [2025-09-14T16:52:48.318035] [INFO ] [MAIN ] AS: Full history saved. [2025-09-14T16:52:48.318153] [INFO ] [MAIN ] Update Progress: 154/2370 symbols completed. AS took 33.0s. Estimated remaining: 3h 44m 38s. Rate: 9.9 symbols/min [2025-09-14T16:52:48.490677] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:52:48.508786] [DEBUG] [LOCAL ] ASC: Loaded 16590 existing records from primary storage. [2025-09-14T16:52:48.508946] [INFO ] [MAIN ] ASC: Loaded 16590 existing records. [2025-09-14T16:52:48.564081] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-09-14T16:52:48.694347] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:52:48.694706] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-09-14T16:52:48.694772] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-14T16:52:48.695778] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-09-14T16:52:48.695853] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-09-14T16:52:49.053217] [INFO ] [REMOTE ] ASC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:52:49.083178] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-14T16:52:49.358812] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-09-14T16:52:49.980466] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-14T16:52:50.158846] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-09-14T16:52:50.911912] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T16:52:50.958803] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-09-14T16:52:51.489483] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-14T16:52:51.758854] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-09-14T16:52:52.401452] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-14T16:52:52.431868] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T16:52:52.558802] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-09-14T16:52:53.358887] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-09-14T16:52:54.113156] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T16:52:54.158798] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-09-14T16:52:54.754932] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-14T16:52:54.880763] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T16:52:54.958841] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-09-14T16:52:55.758836] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-09-14T16:52:56.430773] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T16:52:56.558827] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-09-14T16:52:57.103512] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T16:52:57.358876] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-09-14T16:52:57.634254] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T16:52:58.158854] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-09-14T16:52:58.656111] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T16:52:58.657130] [INFO ] [REMOTE ] ASBA: Full fetch complete (3760 records). [2025-09-14T16:52:58.657227] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-09-14T16:52:58.969621] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-09-14T16:52:59.009869] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-09-14T16:52:59.010115] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-09-14T16:52:59.010339] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-09-14T16:52:59.010416] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-09-14T16:52:59.011117] [DEBUG] [LOCAL ] ASBA: Trimmed 3760 records to 2556 (keeping 150 days of data) [2025-09-14T16:52:59.028763] [DEBUG] [LOCAL ] ASBA: Primary data saved (2556 records). [2025-09-14T16:52:59.028874] [INFO ] [MAIN ] ASBA: Full history saved. [2025-09-14T16:52:59.029005] [INFO ] [MAIN ] Update Progress: 155/2370 symbols completed. ASBA took 18.7s. Estimated remaining: 3h 45m 38s. Rate: 9.8 symbols/min [2025-09-14T16:52:59.199319] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:52:59.232903] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T16:52:59.247981] [DEBUG] [LOCAL ] ASG: Loaded 8690 existing records from primary storage. [2025-09-14T16:52:59.248432] [INFO ] [MAIN ] ASG: Loaded 8690 existing records. [2025-09-14T16:52:59.423182] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:52:59.423434] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-09-14T16:52:59.423508] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-14T16:52:59.423927] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-09-14T16:52:59.423994] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-09-14T16:52:59.771794] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-09-14T16:52:59.776250] [INFO ] [REMOTE ] ASG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:53:00.308847] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-14T16:53:00.558831] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-09-14T16:53:01.276710] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T16:53:01.358826] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-09-14T16:53:01.820263] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-14T16:53:02.015377] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T16:53:02.020808] [INFO ] [REMOTE ] ASB: Full fetch complete (53952 records). [2025-09-14T16:53:02.020999] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-09-14T16:53:02.165526] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-09-14T16:53:02.417198] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-09-14T16:53:02.417320] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-09-14T16:53:02.417927] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-09-14T16:53:02.417987] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-09-14T16:53:02.419153] [DEBUG] [LOCAL ] ASB: Trimmed 53952 records to 36945 (keeping 150 days of data) [2025-09-14T16:53:02.655150] [DEBUG] [LOCAL ] ASB: Primary data saved (36945 records). [2025-09-14T16:53:02.655368] [INFO ] [MAIN ] ASB: Full history saved. [2025-09-14T16:53:02.655478] [INFO ] [MAIN ] Update Progress: 156/2370 symbols completed. ASB took 25.2s. Estimated remaining: 3h 44m 56s. Rate: 9.8 symbols/min [2025-09-14T16:53:02.827865] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:53:02.839939] [DEBUG] [LOCAL ] ASGI: Loaded 10421 existing records from primary storage. [2025-09-14T16:53:02.840072] [INFO ] [MAIN ] ASGI: Loaded 10421 existing records. [2025-09-14T16:53:02.963993] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-09-14T16:53:03.031719] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:53:03.032099] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-09-14T16:53:03.032229] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-09-14T16:53:03.032731] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-09-14T16:53:03.032801] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-09-14T16:53:03.473266] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:53:03.758866] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-09-14T16:53:03.997766] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-14T16:53:04.329335] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-14T16:53:04.558826] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-09-14T16:53:04.866182] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-14T16:53:05.358877] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-09-14T16:53:06.058239] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T16:53:06.158826] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-09-14T16:53:06.369474] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-14T16:53:06.958839] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-09-14T16:53:07.758852] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-09-14T16:53:08.059225] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T16:53:08.170682] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T16:53:08.558804] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-09-14T16:53:08.868998] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-14T16:53:09.358834] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-09-14T16:53:10.012910] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-14T16:53:10.022271] [INFO ] [REMOTE ] ASAN: Full fetch complete (57362 records). [2025-09-14T16:53:10.022518] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-09-14T16:53:10.163999] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-09-14T16:53:10.427600] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-09-14T16:53:10.427838] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-09-14T16:53:10.428758] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-09-14T16:53:10.428827] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-09-14T16:53:10.430587] [DEBUG] [LOCAL ] ASAN: Trimmed 57362 records to 39578 (keeping 150 days of data) [2025-09-14T16:53:10.690839] [DEBUG] [LOCAL ] ASAN: Primary data saved (39578 records). [2025-09-14T16:53:10.691071] [INFO ] [MAIN ] ASAN: Full history saved. [2025-09-14T16:53:10.691195] [INFO ] [MAIN ] Update Progress: 157/2370 symbols completed. ASAN took 35.8s. Estimated remaining: 3h 45m 18s. Rate: 9.8 symbols/min [2025-09-14T16:53:10.897821] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-14T16:53:10.958782] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-09-14T16:53:11.274727] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T16:53:11.758834] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-09-14T16:53:12.075765] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T16:53:12.558944] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-09-14T16:53:12.832450] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-14T16:53:13.358869] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-09-14T16:53:13.540070] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T16:53:13.544150] [INFO ] [REMOTE ] ASC: Full fetch complete (42004 records). [2025-09-14T16:53:13.544298] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-09-14T16:53:13.960094] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-09-14T16:53:13.960267] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-09-14T16:53:13.961175] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-09-14T16:53:13.961255] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-09-14T16:53:13.963036] [DEBUG] [LOCAL ] ASC: Trimmed 42004 records to 28033 (keeping 150 days of data) [2025-09-14T16:53:14.092295] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-14T16:53:14.159154] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-09-14T16:53:14.171363] [DEBUG] [LOCAL ] ASC: Primary data saved (28033 records). [2025-09-14T16:53:14.171517] [INFO ] [MAIN ] ASC: Full history saved. [2025-09-14T16:53:14.171680] [INFO ] [MAIN ] Update Progress: 158/2370 symbols completed. ASC took 25.9s. Estimated remaining: 3h 44m 35s. Rate: 9.8 symbols/min [2025-09-14T16:53:14.958839] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-09-14T16:53:15.391347] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T16:53:15.758857] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-09-14T16:53:15.967039] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-14T16:53:15.969450] [INFO ] [REMOTE ] ASG: Full fetch complete (23126 records). [2025-09-14T16:53:15.969553] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-09-14T16:53:16.333963] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-09-14T16:53:16.334070] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-09-14T16:53:16.334467] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-09-14T16:53:16.334554] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-09-14T16:53:16.335343] [DEBUG] [LOCAL ] ASG: Trimmed 23126 records to 14539 (keeping 150 days of data) [2025-09-14T16:53:16.421619] [DEBUG] [LOCAL ] ASG: Primary data saved (14539 records). [2025-09-14T16:53:16.421849] [INFO ] [MAIN ] ASG: Full history saved. [2025-09-14T16:53:16.421994] [INFO ] [MAIN ] Update Progress: 159/2370 symbols completed. ASG took 17.4s. Estimated remaining: 3h 43m 35s. Rate: 9.9 symbols/min [2025-09-14T16:53:16.634321] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-14T16:53:16.642080] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-09-14T16:53:17.716635] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T16:53:17.721830] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-09-14T16:53:18.940585] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-14T16:53:18.946493] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-09-14T16:53:19.818111] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-14T16:53:19.823758] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-09-14T16:53:20.824678] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T16:53:20.828104] [INFO ] [REMOTE ] ASGI: Full fetch complete (23917 records). [2025-09-14T16:53:20.828260] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-09-14T16:53:21.250463] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-09-14T16:53:21.250721] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-09-14T16:53:21.251204] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-09-14T16:53:21.251265] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-09-14T16:53:21.252313] [DEBUG] [LOCAL ] ASGI: Trimmed 23917 records to 16822 (keeping 150 days of data) [2025-09-14T16:53:21.365571] [DEBUG] [LOCAL ] ASGI: Primary data saved (16822 records). [2025-09-14T16:53:21.365855] [INFO ] [MAIN ] ASGI: Full history saved. [2025-09-14T16:53:21.365983] [INFO ] [MAIN ] Update Progress: 160/2370 symbols completed. ASGI took 18.7s. Estimated remaining: 3h 43m 14s. Rate: 9.9 symbols/min [2025-09-14T16:53:21.879580] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:53:22.060907] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:53:22.083572] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:53:22.103137] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:53:22.116459] [DEBUG] [LOCAL ] ASH: Loaded 15965 existing records from primary storage. [2025-09-14T16:53:22.116834] [INFO ] [MAIN ] ASH: Loaded 15965 existing records. [2025-09-14T16:53:22.218988] [DEBUG] [LOCAL ] ASIX: Loaded 10488 existing records from primary storage. [2025-09-14T16:53:22.248345] [INFO ] [MAIN ] ASIX: Loaded 10488 existing records. [2025-09-14T16:53:22.322987] [DEBUG] [LOCAL ] ASPN: Loaded 22143 existing records from primary storage. [2025-09-14T16:53:22.390746] [INFO ] [MAIN ] ASPN: Loaded 22143 existing records. [2025-09-14T16:53:22.442134] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:53:22.396636] [DEBUG] [LOCAL ] ASGN: Loaded 16516 existing records from primary storage. [2025-09-14T16:53:22.489467] [INFO ] [MAIN ] ASGN: Loaded 16516 existing records. [2025-09-14T16:53:22.525545] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-09-14T16:53:22.546350] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-14T16:53:22.659267] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-09-14T16:53:22.783287] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:53:22.743735] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-09-14T16:53:22.809565] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-09-14T16:53:22.892281] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-14T16:53:22.932854] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:53:22.953713] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-09-14T16:53:22.988355] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-09-14T16:53:22.988575] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:53:22.988757] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-09-14T16:53:23.035313] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-14T16:53:23.080961] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-09-14T16:53:23.117368] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-09-14T16:53:23.152416] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-09-14T16:53:23.171992] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-14T16:53:23.259050] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-09-14T16:53:23.373173] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-09-14T16:53:24.189232] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:53:24.250575] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-09-14T16:53:24.352188] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:53:24.399708] [INFO ] [REMOTE ] ASH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:53:24.400121] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-09-14T16:53:24.449611] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:53:24.449926] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-09-14T16:53:24.450993] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-09-14T16:53:25.462709] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-14T16:53:25.466550] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-09-14T16:53:25.788998] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T16:53:25.799083] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-09-14T16:53:25.882014] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T16:53:25.889955] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-09-14T16:53:26.050121] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-14T16:53:26.058298] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-09-14T16:53:26.376008] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-14T16:53:26.380599] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-09-14T16:53:27.252900] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-14T16:53:27.262268] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-09-14T16:53:27.467912] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T16:53:27.652869] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T16:53:27.710725] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T16:53:27.758860] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-09-14T16:53:28.558931] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-09-14T16:53:28.614111] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-14T16:53:29.208464] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-14T16:53:29.358840] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-09-14T16:53:30.158815] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-09-14T16:53:30.400844] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T16:53:30.815631] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T16:53:30.937194] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-14T16:53:30.958798] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-09-14T16:53:31.758904] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-09-14T16:53:32.101251] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-14T16:53:32.558838] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-09-14T16:53:32.792724] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-14T16:53:33.358854] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-09-14T16:53:33.775044] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-14T16:53:34.158897] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-09-14T16:53:34.381223] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-14T16:53:34.958854] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-09-14T16:53:35.659174] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-14T16:53:35.758845] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-09-14T16:53:36.144100] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-14T16:53:36.381284] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T16:53:36.385012] [INFO ] [REMOTE ] ASH: Full fetch complete (41568 records). [2025-09-14T16:53:36.385111] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-09-14T16:53:36.561889] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-09-14T16:53:36.759721] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-09-14T16:53:36.759824] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-09-14T16:53:36.760299] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-09-14T16:53:36.760353] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-09-14T16:53:36.761299] [DEBUG] [LOCAL ] ASH: Trimmed 41568 records to 27620 (keeping 150 days of data) [2025-09-14T16:53:36.931574] [DEBUG] [LOCAL ] ASH: Primary data saved (27620 records). [2025-09-14T16:53:36.931754] [INFO ] [MAIN ] ASH: Full history saved. [2025-09-14T16:53:36.931863] [INFO ] [MAIN ] Update Progress: 161/2370 symbols completed. ASH took 15.6s. Estimated remaining: 3h 45m 18s. Rate: 9.8 symbols/min [2025-09-14T16:53:37.085868] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T16:53:37.117892] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:53:37.118711] [INFO ] [REMOTE ] ASIX: Full fetch complete (23797 records). [2025-09-14T16:53:37.118814] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-09-14T16:53:37.225032] [DEBUG] [LOCAL ] ASR: Loaded 4369 existing records from primary storage. [2025-09-14T16:53:37.225224] [INFO ] [MAIN ] ASR: Loaded 4369 existing records. [2025-09-14T16:53:37.364587] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-09-14T16:53:37.580401] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:53:37.616060] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-09-14T16:53:37.616277] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-14T16:53:37.638102] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-09-14T16:53:37.667160] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-09-14T16:53:37.804252] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-09-14T16:53:37.815199] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-09-14T16:53:37.836907] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-09-14T16:53:37.866092] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-09-14T16:53:37.964170] [DEBUG] [LOCAL ] ASIX: Trimmed 23797 records to 17222 (keeping 150 days of data) [2025-09-14T16:53:38.160518] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-09-14T16:53:38.166758] [INFO ] [REMOTE ] ASR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:53:38.206859] [DEBUG] [LOCAL ] ASIX: Primary data saved (17222 records). [2025-09-14T16:53:38.207210] [INFO ] [MAIN ] ASIX: Full history saved. [2025-09-14T16:53:38.207356] [INFO ] [MAIN ] Update Progress: 162/2370 symbols completed. ASIX took 16.8s. Estimated remaining: 3h 44m 6s. Rate: 9.9 symbols/min [2025-09-14T16:53:38.413971] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:53:38.439499] [DEBUG] [LOCAL ] ASX: Loaded 23560 existing records from primary storage. [2025-09-14T16:53:38.439720] [INFO ] [MAIN ] ASX: Loaded 23560 existing records. [2025-09-14T16:53:38.625438] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:53:38.625777] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-09-14T16:53:38.625844] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-14T16:53:38.626503] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-09-14T16:53:38.626567] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-09-14T16:53:38.960442] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-09-14T16:53:39.004831] [INFO ] [REMOTE ] ASX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:53:39.026434] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T16:53:39.527806] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-14T16:53:39.758864] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-09-14T16:53:39.928452] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-14T16:53:40.558855] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-09-14T16:53:41.358874] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-09-14T16:53:41.452846] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T16:53:42.131335] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T16:53:42.146976] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-14T16:53:42.158783] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-09-14T16:53:42.819797] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-14T16:53:42.958847] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-09-14T16:53:43.758919] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-09-14T16:53:44.036774] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T16:53:44.558883] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-09-14T16:53:45.358850] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-09-14T16:53:45.496048] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-14T16:53:45.691116] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-14T16:53:46.158848] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-09-14T16:53:46.179829] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T16:53:46.958884] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-09-14T16:53:47.418586] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T16:53:47.758910] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-09-14T16:53:47.782512] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T16:53:48.558849] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-09-14T16:53:49.358917] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-09-14T16:53:49.498052] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T16:53:49.978787] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T16:53:49.982545] [INFO ] [REMOTE ] ASGN: Full fetch complete (39813 records). [2025-09-14T16:53:49.982662] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-09-14T16:53:50.159141] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-09-14T16:53:50.360841] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-09-14T16:53:50.361003] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-09-14T16:53:50.361587] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-09-14T16:53:50.361716] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-09-14T16:53:50.362786] [DEBUG] [LOCAL ] ASGN: Trimmed 39813 records to 26592 (keeping 150 days of data) [2025-09-14T16:53:50.480089] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T16:53:50.560289] [DEBUG] [LOCAL ] ASGN: Primary data saved (26592 records). [2025-09-14T16:53:50.560457] [INFO ] [MAIN ] ASGN: Full history saved. [2025-09-14T16:53:50.560569] [INFO ] [MAIN ] Update Progress: 163/2370 symbols completed. ASGN took 29.2s. Estimated remaining: 3h 45m 25s. Rate: 9.8 symbols/min [2025-09-14T16:53:50.726917] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:53:50.744489] [DEBUG] [LOCAL ] ATEN: Loaded 17300 existing records from primary storage. [2025-09-14T16:53:50.744661] [INFO ] [MAIN ] ATEN: Loaded 17300 existing records. [2025-09-14T16:53:50.964062] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-09-14T16:53:50.964708] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:53:50.965006] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-14T16:53:50.968835] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-09-14T16:53:50.969616] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-14T16:53:50.970442] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-09-14T16:53:50.970505] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-09-14T16:53:51.334022] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:53:51.758871] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-09-14T16:53:52.558838] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-09-14T16:53:52.705430] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T16:53:52.736930] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-14T16:53:53.358845] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-09-14T16:53:54.158817] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-09-14T16:53:54.268470] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T16:53:54.290403] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-14T16:53:54.292108] [INFO ] [REMOTE ] ASR: Full fetch complete (9602 records). [2025-09-14T16:53:54.292197] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-09-14T16:53:54.654781] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-09-14T16:53:54.654888] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-09-14T16:53:54.655186] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-09-14T16:53:54.655240] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-09-14T16:53:54.655748] [DEBUG] [LOCAL ] ASR: Trimmed 9602 records to 7112 (keeping 150 days of data) [2025-09-14T16:53:54.699891] [DEBUG] [LOCAL ] ASR: Primary data saved (7112 records). [2025-09-14T16:53:54.700030] [INFO ] [MAIN ] ASR: Full history saved. [2025-09-14T16:53:54.700149] [INFO ] [MAIN ] Update Progress: 164/2370 symbols completed. ASR took 17.8s. Estimated remaining: 3h 44m 52s. Rate: 9.8 symbols/min [2025-09-14T16:53:54.869283] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:53:54.888098] [DEBUG] [LOCAL ] ATGE: Loaded 12884 existing records from primary storage. [2025-09-14T16:53:54.888336] [INFO ] [MAIN ] ATGE: Loaded 12884 existing records. [2025-09-14T16:53:54.963907] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-09-14T16:53:55.068694] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:53:55.068996] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-09-14T16:53:55.069068] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-09-14T16:53:55.069551] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-09-14T16:53:55.069633] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-09-14T16:53:55.417538] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:53:55.576263] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T16:53:55.758803] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-09-14T16:53:56.455297] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-14T16:53:56.460313] [INFO ] [REMOTE ] ASPN: Full fetch complete (54319 records). [2025-09-14T16:53:56.460432] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-09-14T16:53:56.560664] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-09-14T16:53:56.856036] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-09-14T16:53:56.856163] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-09-14T16:53:56.856866] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-09-14T16:53:56.856951] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-09-14T16:53:56.858112] [DEBUG] [LOCAL ] ASPN: Trimmed 54319 records to 37369 (keeping 150 days of data) [2025-09-14T16:53:57.083203] [DEBUG] [LOCAL ] ASPN: Primary data saved (37369 records). [2025-09-14T16:53:57.083390] [INFO ] [MAIN ] ASPN: Full history saved. [2025-09-14T16:53:57.083496] [INFO ] [MAIN ] Update Progress: 165/2370 symbols completed. ASPN took 35.7s. Estimated remaining: 3h 43m 56s. Rate: 9.8 symbols/min [2025-09-14T16:53:57.256235] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:53:57.269413] [DEBUG] [LOCAL ] ATHM: Loaded 12106 existing records from primary storage. [2025-09-14T16:53:57.269580] [INFO ] [MAIN ] ATHM: Loaded 12106 existing records. [2025-09-14T16:53:57.366557] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-09-14T16:53:57.454828] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:53:57.455321] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-09-14T16:53:57.455424] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-14T16:53:57.455987] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-09-14T16:53:57.456057] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-09-14T16:53:57.787274] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-14T16:53:57.878727] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:53:57.901004] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T16:53:58.158871] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-09-14T16:53:58.775954] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T16:53:58.958854] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-09-14T16:53:59.758808] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-09-14T16:53:59.796871] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T16:54:00.558838] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-09-14T16:54:00.660135] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T16:54:01.358811] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-09-14T16:54:01.438103] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-14T16:54:02.096004] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-14T16:54:02.101771] [INFO ] [REMOTE ] ASX: Full fetch complete (57538 records). [2025-09-14T16:54:02.101964] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-09-14T16:54:02.166274] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-09-14T16:54:02.493318] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-09-14T16:54:02.493516] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-09-14T16:54:02.494182] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-09-14T16:54:02.494265] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-09-14T16:54:02.495765] [DEBUG] [LOCAL ] ASX: Trimmed 57538 records to 39787 (keeping 150 days of data) [2025-09-14T16:54:02.614041] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-14T16:54:02.779839] [DEBUG] [LOCAL ] ASX: Primary data saved (39787 records). [2025-09-14T16:54:02.780043] [INFO ] [MAIN ] ASX: Full history saved. [2025-09-14T16:54:02.780153] [INFO ] [MAIN ] Update Progress: 166/2370 symbols completed. ASX took 24.6s. Estimated remaining: 3h 43m 44s. Rate: 9.9 symbols/min [2025-09-14T16:54:02.956068] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:54:02.960927] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-09-14T16:54:02.960788] [DEBUG] [LOCAL ] ATHS: Loaded 3127 existing records from primary storage. [2025-09-14T16:54:02.961246] [INFO ] [MAIN ] ATHS: Loaded 3127 existing records. [2025-09-14T16:54:03.147881] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:54:03.148147] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-09-14T16:54:03.148221] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-14T16:54:03.148528] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-09-14T16:54:03.148589] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-09-14T16:54:03.500676] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:54:03.651681] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T16:54:03.758845] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-09-14T16:54:04.293969] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-14T16:54:04.558827] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-09-14T16:54:05.296747] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-14T16:54:05.358823] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-09-14T16:54:06.128088] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T16:54:06.158781] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-09-14T16:54:06.646431] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-14T16:54:06.958823] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-09-14T16:54:07.459153] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-14T16:54:07.758837] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-09-14T16:54:08.497631] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T16:54:08.558837] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-09-14T16:54:09.208487] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-14T16:54:09.247445] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-14T16:54:09.358811] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-09-14T16:54:10.158868] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-09-14T16:54:10.934907] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T16:54:10.958806] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-09-14T16:54:11.280945] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-14T16:54:11.758898] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-09-14T16:54:12.208947] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T16:54:12.294038] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-14T16:54:12.558872] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-09-14T16:54:13.321669] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-14T16:54:13.358800] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-09-14T16:54:14.014052] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-14T16:54:14.158841] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-09-14T16:54:14.552409] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T16:54:14.556475] [INFO ] [REMOTE ] ATEN: Full fetch complete (43645 records). [2025-09-14T16:54:14.556605] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-09-14T16:54:14.929299] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-09-14T16:54:14.929402] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-09-14T16:54:14.929914] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-09-14T16:54:14.929975] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-09-14T16:54:14.930955] [DEBUG] [LOCAL ] ATEN: Trimmed 43645 records to 29040 (keeping 150 days of data) [2025-09-14T16:54:14.986886] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-09-14T16:54:15.114798] [DEBUG] [LOCAL ] ATEN: Primary data saved (29040 records). [2025-09-14T16:54:15.114982] [INFO ] [MAIN ] ATEN: Full history saved. [2025-09-14T16:54:15.115097] [INFO ] [MAIN ] Update Progress: 167/2370 symbols completed. ATEN took 24.6s. Estimated remaining: 3h 45m 1s. Rate: 9.8 symbols/min [2025-09-14T16:54:15.288047] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:54:15.312035] [DEBUG] [LOCAL ] ATI: Loaded 22882 existing records from primary storage. [2025-09-14T16:54:15.312249] [INFO ] [MAIN ] ATI: Loaded 22882 existing records. [2025-09-14T16:54:15.497771] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:54:15.498083] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-09-14T16:54:15.498146] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-09-14T16:54:15.498796] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-09-14T16:54:15.498859] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-09-14T16:54:15.763978] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-09-14T16:54:15.868479] [INFO ] [REMOTE ] ATI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:54:16.224918] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-14T16:54:16.558841] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-09-14T16:54:16.855343] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T16:54:17.358863] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-09-14T16:54:17.739683] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T16:54:18.158792] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-09-14T16:54:18.572928] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T16:54:18.958895] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-09-14T16:54:19.563780] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-14T16:54:19.758834] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-09-14T16:54:20.236158] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-14T16:54:20.558855] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-09-14T16:54:21.070354] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-14T16:54:21.358867] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-09-14T16:54:21.872410] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T16:54:21.875537] [INFO ] [REMOTE ] ATGE: Full fetch complete (35349 records). [2025-09-14T16:54:21.875634] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-09-14T16:54:22.163877] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-09-14T16:54:22.253344] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-09-14T16:54:22.253528] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-09-14T16:54:22.254083] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-09-14T16:54:22.254256] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-09-14T16:54:22.255441] [DEBUG] [LOCAL ] ATGE: Trimmed 35349 records to 23587 (keeping 150 days of data) [2025-09-14T16:54:22.373454] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T16:54:22.440257] [DEBUG] [LOCAL ] ATGE: Primary data saved (23587 records). [2025-09-14T16:54:22.440416] [INFO ] [MAIN ] ATGE: Full history saved. [2025-09-14T16:54:22.440522] [INFO ] [MAIN ] Update Progress: 168/2370 symbols completed. ATGE took 27.7s. Estimated remaining: 3h 45m 10s. Rate: 9.8 symbols/min [2025-09-14T16:54:22.609001] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:54:22.626961] [DEBUG] [LOCAL ] ATKR: Loaded 15949 existing records from primary storage. [2025-09-14T16:54:22.627126] [INFO ] [MAIN ] ATKR: Loaded 15949 existing records. [2025-09-14T16:54:22.806261] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:54:22.806542] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-09-14T16:54:22.806601] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-09-14T16:54:22.807169] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-09-14T16:54:22.807253] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-09-14T16:54:22.962568] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-09-14T16:54:23.093336] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-14T16:54:23.122199] [INFO ] [REMOTE ] ATHM: Full fetch complete (37237 records). [2025-09-14T16:54:23.168242] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-09-14T16:54:23.172424] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:54:23.546284] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-09-14T16:54:23.546402] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-09-14T16:54:23.546867] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-09-14T16:54:23.546923] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-09-14T16:54:23.547898] [DEBUG] [LOCAL ] ATHM: Trimmed 37237 records to 23577 (keeping 150 days of data) [2025-09-14T16:54:23.691968] [DEBUG] [LOCAL ] ATHM: Primary data saved (23577 records). [2025-09-14T16:54:23.692173] [INFO ] [MAIN ] ATHM: Full history saved. [2025-09-14T16:54:23.692354] [INFO ] [MAIN ] Update Progress: 169/2370 symbols completed. ATHM took 26.6s. Estimated remaining: 3h 44m 0s. Rate: 9.8 symbols/min [2025-09-14T16:54:23.763916] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-09-14T16:54:23.866503] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:54:23.886968] [DEBUG] [LOCAL ] ATMU: Loaded 18144 existing records from primary storage. [2025-09-14T16:54:23.887138] [INFO ] [MAIN ] ATMU: Loaded 18144 existing records. [2025-09-14T16:54:24.064265] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:54:24.064538] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-09-14T16:54:24.064599] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-14T16:54:24.065173] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-09-14T16:54:24.065244] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-09-14T16:54:24.427967] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:54:24.435729] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-14T16:54:24.558824] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-09-14T16:54:24.870573] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T16:54:25.358824] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-09-14T16:54:25.971423] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T16:54:26.158883] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-09-14T16:54:26.951355] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T16:54:26.961609] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-09-14T16:54:26.976308] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-14T16:54:27.758844] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-09-14T16:54:28.446734] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T16:54:28.467144] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-14T16:54:28.558842] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-09-14T16:54:29.102829] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T16:54:29.104270] [INFO ] [REMOTE ] ATHS: Full fetch complete (7700 records). [2025-09-14T16:54:29.104382] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-09-14T16:54:29.363946] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-09-14T16:54:29.481843] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-09-14T16:54:29.481960] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-09-14T16:54:29.482228] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-09-14T16:54:29.482287] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-09-14T16:54:29.482781] [DEBUG] [LOCAL ] ATHS: Trimmed 7700 records to 5007 (keeping 150 days of data) [2025-09-14T16:54:29.516009] [DEBUG] [LOCAL ] ATHS: Primary data saved (5007 records). [2025-09-14T16:54:29.516153] [INFO ] [MAIN ] ATHS: Full history saved. [2025-09-14T16:54:29.516313] [INFO ] [MAIN ] Update Progress: 170/2370 symbols completed. ATHS took 26.7s. Estimated remaining: 3h 43m 51s. Rate: 9.8 symbols/min [2025-09-14T16:54:29.684627] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:54:29.707629] [DEBUG] [LOCAL ] ATO: Loaded 17504 existing records from primary storage. [2025-09-14T16:54:29.707802] [INFO ] [MAIN ] ATO: Loaded 17504 existing records. [2025-09-14T16:54:29.885919] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:54:29.886207] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-09-14T16:54:29.886286] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-09-14T16:54:29.886950] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-09-14T16:54:29.887025] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-09-14T16:54:30.163982] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-09-14T16:54:30.256499] [INFO ] [REMOTE ] ATO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:54:30.615905] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-14T16:54:30.958835] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-09-14T16:54:31.427550] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-14T16:54:31.758869] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-09-14T16:54:32.387840] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-14T16:54:32.558827] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-09-14T16:54:32.858290] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T16:54:33.358833] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-09-14T16:54:33.654687] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T16:54:34.158837] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-09-14T16:54:34.875889] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T16:54:34.958792] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-09-14T16:54:35.214904] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-14T16:54:35.758829] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-09-14T16:54:36.409481] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-14T16:54:36.558851] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-09-14T16:54:37.358833] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-09-14T16:54:37.456817] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-14T16:54:37.504447] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-14T16:54:38.158852] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-09-14T16:54:38.958796] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-09-14T16:54:39.061423] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-14T16:54:39.758893] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-09-14T16:54:40.124863] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-14T16:54:40.536947] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T16:54:40.558917] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-09-14T16:54:41.358896] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-09-14T16:54:41.394496] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-14T16:54:41.951708] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T16:54:42.158860] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-09-14T16:54:42.429338] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-14T16:54:42.437373] [INFO ] [REMOTE ] ATI: Full fetch complete (56290 records). [2025-09-14T16:54:42.437762] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-09-14T16:54:42.891796] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-09-14T16:54:42.892035] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-09-14T16:54:42.892903] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-09-14T16:54:42.893112] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-09-14T16:54:42.911252] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T16:54:42.919086] [DEBUG] [LOCAL ] ATI: Trimmed 56290 records to 39009 (keeping 150 days of data) [2025-09-14T16:54:42.991325] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-09-14T16:54:43.181216] [DEBUG] [LOCAL ] ATI: Primary data saved (39009 records). [2025-09-14T16:54:43.181423] [INFO ] [MAIN ] ATI: Full history saved. [2025-09-14T16:54:43.181571] [INFO ] [MAIN ] Update Progress: 171/2370 symbols completed. ATI took 28.1s. Estimated remaining: 3h 45m 22s. Rate: 9.8 symbols/min [2025-09-14T16:54:43.353363] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:54:43.369533] [DEBUG] [LOCAL ] ATR: Loaded 13805 existing records from primary storage. [2025-09-14T16:54:43.369721] [INFO ] [MAIN ] ATR: Loaded 13805 existing records. [2025-09-14T16:54:43.547780] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:54:43.548052] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-09-14T16:54:43.548115] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-09-14T16:54:43.548675] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-09-14T16:54:43.548740] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-09-14T16:54:43.766129] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-09-14T16:54:43.922141] [INFO ] [REMOTE ] ATR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:54:44.482014] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-14T16:54:44.558803] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-09-14T16:54:45.244065] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-14T16:54:45.248922] [INFO ] [REMOTE ] ATMU: Full fetch complete (43279 records). [2025-09-14T16:54:45.249023] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-09-14T16:54:45.364255] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-09-14T16:54:45.626133] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-09-14T16:54:45.626275] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-09-14T16:54:45.626806] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-09-14T16:54:45.626865] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-09-14T16:54:45.627982] [DEBUG] [LOCAL ] ATMU: Trimmed 43279 records to 28868 (keeping 150 days of data) [2025-09-14T16:54:45.810209] [DEBUG] [LOCAL ] ATMU: Primary data saved (28868 records). [2025-09-14T16:54:45.810369] [INFO ] [MAIN ] ATMU: Full history saved. [2025-09-14T16:54:45.810466] [INFO ] [MAIN ] Update Progress: 172/2370 symbols completed. ATMU took 22.1s. Estimated remaining: 3h 44m 31s. Rate: 9.8 symbols/min [2025-09-14T16:54:45.976527] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:54:45.985714] [DEBUG] [LOCAL ] ATS: Loaded 7803 existing records from primary storage. [2025-09-14T16:54:45.985857] [INFO ] [MAIN ] ATS: Loaded 7803 existing records. [2025-09-14T16:54:46.160353] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-09-14T16:54:46.163624] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:54:46.164821] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-09-14T16:54:46.164970] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-09-14T16:54:46.165480] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-09-14T16:54:46.165602] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-09-14T16:54:46.444776] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T16:54:46.557218] [INFO ] [REMOTE ] ATS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:54:46.847915] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-14T16:54:46.958814] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-09-14T16:54:47.638117] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T16:54:47.758844] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-09-14T16:54:48.090581] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-14T16:54:48.558829] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-09-14T16:54:49.016752] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T16:54:49.358879] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-09-14T16:54:49.850223] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-14T16:54:50.158842] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-09-14T16:54:50.345223] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-14T16:54:50.958835] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-09-14T16:54:51.501949] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-14T16:54:51.506146] [INFO ] [REMOTE ] ATKR: Full fetch complete (39984 records). [2025-09-14T16:54:51.506319] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-09-14T16:54:51.764065] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-09-14T16:54:51.900100] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-09-14T16:54:51.900252] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-09-14T16:54:51.900960] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-09-14T16:54:51.901027] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-09-14T16:54:51.902476] [DEBUG] [LOCAL ] ATKR: Trimmed 39984 records to 25920 (keeping 150 days of data) [2025-09-14T16:54:52.073098] [DEBUG] [LOCAL ] ATKR: Primary data saved (25920 records). [2025-09-14T16:54:52.073307] [INFO ] [MAIN ] ATKR: Full history saved. [2025-09-14T16:54:52.073491] [INFO ] [MAIN ] Update Progress: 173/2370 symbols completed. ATKR took 29.6s. Estimated remaining: 3h 44m 26s. Rate: 9.8 symbols/min [2025-09-14T16:54:52.286336] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:54:52.308128] [DEBUG] [LOCAL ] ATUS: Loaded 22455 existing records from primary storage. [2025-09-14T16:54:52.308350] [INFO ] [MAIN ] ATUS: Loaded 22455 existing records. [2025-09-14T16:54:52.486890] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:54:52.487274] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-09-14T16:54:52.487415] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-14T16:54:52.488201] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-09-14T16:54:52.488286] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-09-14T16:54:52.567455] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-09-14T16:54:52.653221] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T16:54:52.907910] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:54:52.921552] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T16:54:53.358829] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-09-14T16:54:54.163942] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-09-14T16:54:54.176583] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T16:54:54.420035] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-14T16:54:54.958864] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-09-14T16:54:55.586475] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T16:54:55.592123] [INFO ] [REMOTE ] ATO: Full fetch complete (45733 records). [2025-09-14T16:54:55.592336] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-09-14T16:54:55.771851] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-09-14T16:54:56.020048] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-09-14T16:54:56.021282] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-09-14T16:54:56.021132] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T16:54:56.022059] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-09-14T16:54:56.022222] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-09-14T16:54:56.033494] [DEBUG] [LOCAL ] ATO: Trimmed 45733 records to 31430 (keeping 150 days of data) [2025-09-14T16:54:56.242009] [DEBUG] [LOCAL ] ATO: Primary data saved (31430 records). [2025-09-14T16:54:56.242184] [INFO ] [MAIN ] ATO: Full history saved. [2025-09-14T16:54:56.242282] [INFO ] [MAIN ] Update Progress: 174/2370 symbols completed. ATO took 26.7s. Estimated remaining: 3h 43m 55s. Rate: 9.8 symbols/min [2025-09-14T16:54:56.412878] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:54:56.434565] [DEBUG] [LOCAL ] AU: Loaded 23633 existing records from primary storage. [2025-09-14T16:54:56.434745] [INFO ] [MAIN ] AU: Loaded 23633 existing records. [2025-09-14T16:54:56.563922] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-09-14T16:54:56.614456] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:54:56.614781] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-09-14T16:54:56.614886] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-09-14T16:54:56.615639] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-09-14T16:54:56.615735] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-09-14T16:54:56.874680] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-14T16:54:56.993154] [INFO ] [REMOTE ] AU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:54:57.358914] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-09-14T16:54:58.032964] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-14T16:54:58.049047] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-14T16:54:58.158822] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-09-14T16:54:58.958831] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-09-14T16:54:59.510103] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T16:54:59.758829] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-09-14T16:55:00.501751] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-14T16:55:00.558778] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-09-14T16:55:00.873794] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T16:55:01.358817] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-09-14T16:55:02.158833] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-09-14T16:55:02.228525] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T16:55:02.635533] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T16:55:02.958816] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-09-14T16:55:03.194597] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-14T16:55:03.758823] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-09-14T16:55:04.370364] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T16:55:04.374391] [INFO ] [REMOTE ] ATR: Full fetch complete (33538 records). [2025-09-14T16:55:04.374762] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-09-14T16:55:04.519105] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-14T16:55:04.574303] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-09-14T16:55:04.811594] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-09-14T16:55:04.811733] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-09-14T16:55:04.812267] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-09-14T16:55:04.812346] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-09-14T16:55:04.813236] [DEBUG] [LOCAL ] ATR: Trimmed 33538 records to 23237 (keeping 150 days of data) [2025-09-14T16:55:04.958973] [DEBUG] [LOCAL ] ATR: Primary data saved (23237 records). [2025-09-14T16:55:04.959163] [INFO ] [MAIN ] ATR: Full history saved. [2025-09-14T16:55:04.959290] [INFO ] [MAIN ] Update Progress: 175/2370 symbols completed. ATR took 21.8s. Estimated remaining: 3h 44m 22s. Rate: 9.8 symbols/min [2025-09-14T16:55:05.131114] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:55:05.150883] [DEBUG] [LOCAL ] AUB: Loaded 20131 existing records from primary storage. [2025-09-14T16:55:05.151066] [INFO ] [MAIN ] AUB: Loaded 20131 existing records. [2025-09-14T16:55:05.335776] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:55:05.336105] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-09-14T16:55:05.336433] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-14T16:55:05.337117] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-09-14T16:55:05.337190] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-09-14T16:55:05.370589] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-09-14T16:55:05.704145] [INFO ] [REMOTE ] AUB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:55:06.107264] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T16:55:06.109763] [INFO ] [REMOTE ] ATS: Full fetch complete (19626 records). [2025-09-14T16:55:06.109879] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-09-14T16:55:06.165110] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-09-14T16:55:06.493557] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T16:55:06.552003] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-09-14T16:55:06.552279] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-09-14T16:55:06.552736] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-09-14T16:55:06.552809] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-09-14T16:55:06.554123] [DEBUG] [LOCAL ] ATS: Trimmed 19626 records to 13232 (keeping 150 days of data) [2025-09-14T16:55:06.638996] [DEBUG] [LOCAL ] ATS: Primary data saved (13232 records). [2025-09-14T16:55:06.639255] [INFO ] [MAIN ] ATS: Full history saved. [2025-09-14T16:55:06.639381] [INFO ] [MAIN ] Update Progress: 176/2370 symbols completed. ATS took 20.8s. Estimated remaining: 3h 43m 20s. Rate: 9.8 symbols/min [2025-09-14T16:55:06.823828] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:55:06.828382] [DEBUG] [LOCAL ] AUNA: Loaded 2339 existing records from primary storage. [2025-09-14T16:55:06.828488] [INFO ] [MAIN ] AUNA: Loaded 2339 existing records. [2025-09-14T16:55:06.964039] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-09-14T16:55:07.024786] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:55:07.025127] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-09-14T16:55:07.025221] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-14T16:55:07.025573] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-09-14T16:55:07.025667] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-09-14T16:55:07.399626] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:55:07.556298] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T16:55:07.758840] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-09-14T16:55:08.375251] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-14T16:55:08.558852] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-09-14T16:55:08.704997] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T16:55:08.958231] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-14T16:55:09.358833] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-09-14T16:55:10.158841] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-09-14T16:55:10.838799] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-14T16:55:10.958852] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-09-14T16:55:11.742409] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-14T16:55:11.758779] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-09-14T16:55:12.527132] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T16:55:12.558787] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-09-14T16:55:13.358821] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-09-14T16:55:13.485956] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T16:55:13.993824] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-14T16:55:14.158830] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-09-14T16:55:14.196731] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-14T16:55:14.958860] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-09-14T16:55:15.376000] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-14T16:55:15.404781] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-14T16:55:15.758884] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-09-14T16:55:16.558887] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-09-14T16:55:16.934005] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-14T16:55:16.939427] [INFO ] [REMOTE ] ATUS: Full fetch complete (53523 records). [2025-09-14T16:55:16.939628] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-09-14T16:55:17.327695] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-09-14T16:55:17.327881] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-09-14T16:55:17.328514] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-09-14T16:55:17.328582] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-09-14T16:55:17.329955] [DEBUG] [LOCAL ] ATUS: Trimmed 53523 records to 37778 (keeping 150 days of data) [2025-09-14T16:55:17.378072] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-09-14T16:55:17.550088] [DEBUG] [LOCAL ] ATUS: Primary data saved (37778 records). [2025-09-14T16:55:17.550289] [INFO ] [MAIN ] ATUS: Full history saved. [2025-09-14T16:55:17.550394] [INFO ] [MAIN ] Update Progress: 177/2370 symbols completed. ATUS took 25.5s. Estimated remaining: 3h 44m 14s. Rate: 9.8 symbols/min [2025-09-14T16:55:17.720865] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:55:17.739012] [DEBUG] [LOCAL ] AVA: Loaded 17440 existing records from primary storage. [2025-09-14T16:55:17.739195] [INFO ] [MAIN ] AVA: Loaded 17440 existing records. [2025-09-14T16:55:17.934848] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:55:17.935495] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-09-14T16:55:17.935699] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-09-14T16:55:17.936410] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-09-14T16:55:17.936478] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-09-14T16:55:18.165833] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-09-14T16:55:18.206970] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T16:55:18.286784] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T16:55:18.365338] [INFO ] [REMOTE ] AVA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:55:18.958821] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-09-14T16:55:19.645596] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-14T16:55:19.758831] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-09-14T16:55:20.497608] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-14T16:55:20.499815] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-14T16:55:20.558876] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-09-14T16:55:21.358870] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-09-14T16:55:21.594709] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-14T16:55:22.158842] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-09-14T16:55:22.958801] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-09-14T16:55:23.034825] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T16:55:23.758825] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-09-14T16:55:24.134533] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-14T16:55:24.459998] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T16:55:24.558810] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-09-14T16:55:24.948275] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-14T16:55:25.358888] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-09-14T16:55:26.091582] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-14T16:55:26.158839] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-09-14T16:55:26.552977] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T16:55:26.557752] [INFO ] [REMOTE ] AUB: Full fetch complete (50171 records). [2025-09-14T16:55:26.557920] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-09-14T16:55:26.936367] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-09-14T16:55:26.936489] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-09-14T16:55:26.937105] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-09-14T16:55:26.937170] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-09-14T16:55:26.938473] [DEBUG] [LOCAL ] AUB: Trimmed 50171 records to 34357 (keeping 150 days of data) [2025-09-14T16:55:26.995782] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-09-14T16:55:27.171106] [DEBUG] [LOCAL ] AUB: Primary data saved (34357 records). [2025-09-14T16:55:27.171296] [INFO ] [MAIN ] AUB: Full history saved. [2025-09-14T16:55:27.171416] [INFO ] [MAIN ] Update Progress: 178/2370 symbols completed. AUB took 22.2s. Estimated remaining: 3h 44m 50s. Rate: 9.7 symbols/min [2025-09-14T16:55:27.350789] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:55:27.356833] [DEBUG] [LOCAL ] AVAL: Loaded 3607 existing records from primary storage. [2025-09-14T16:55:27.356939] [INFO ] [MAIN ] AVAL: Loaded 3607 existing records. [2025-09-14T16:55:27.535744] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T16:55:27.557535] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:55:27.560002] [INFO ] [REMOTE ] AUNA: Full fetch complete (5184 records). [2025-09-14T16:55:27.560382] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-09-14T16:55:27.560858] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-09-14T16:55:27.597611] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-09-14T16:55:27.632569] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-09-14T16:55:27.656066] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-09-14T16:55:27.785519] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-09-14T16:55:27.884126] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-09-14T16:55:28.310207] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-09-14T16:55:28.325802] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-09-14T16:55:28.351206] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-09-14T16:55:28.377065] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-09-14T16:55:28.383227] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:55:28.384539] [DEBUG] [LOCAL ] AUNA: Trimmed 5184 records to 3632 (keeping 150 days of data) [2025-09-14T16:55:28.405811] [DEBUG] [LOCAL ] AUNA: Primary data saved (3632 records). [2025-09-14T16:55:28.405924] [INFO ] [MAIN ] AUNA: Full history saved. [2025-09-14T16:55:28.406049] [INFO ] [MAIN ] Update Progress: 179/2370 symbols completed. AUNA took 21.8s. Estimated remaining: 3h 43m 44s. Rate: 9.8 symbols/min [2025-09-14T16:55:28.571707] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-09-14T16:55:28.574500] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:55:28.596690] [DEBUG] [LOCAL ] AVB: Loaded 18835 existing records from primary storage. [2025-09-14T16:55:28.596901] [INFO ] [MAIN ] AVB: Loaded 18835 existing records. [2025-09-14T16:55:28.776824] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:55:28.777098] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-09-14T16:55:28.777162] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-14T16:55:28.777855] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-09-14T16:55:28.777919] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-09-14T16:55:29.139298] [INFO ] [REMOTE ] AVB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:55:29.164082] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-14T16:55:29.358830] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-09-14T16:55:30.158870] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-09-14T16:55:30.249203] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T16:55:30.781283] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-14T16:55:30.958834] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-09-14T16:55:31.617897] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T16:55:31.758892] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-09-14T16:55:32.453052] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-14T16:55:32.558955] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-09-14T16:55:32.782242] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T16:55:33.358920] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-09-14T16:55:34.158870] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-09-14T16:55:34.662611] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-14T16:55:34.958843] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-09-14T16:55:35.054261] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-14T16:55:35.169886] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T16:55:35.758827] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-09-14T16:55:36.452536] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-14T16:55:36.458513] [INFO ] [REMOTE ] AU: Full fetch complete (57426 records). [2025-09-14T16:55:36.458780] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-09-14T16:55:36.566265] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-09-14T16:55:36.888567] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-09-14T16:55:36.888770] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-09-14T16:55:36.889618] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-09-14T16:55:36.889707] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-09-14T16:55:36.891669] [DEBUG] [LOCAL ] AU: Trimmed 57426 records to 39866 (keeping 150 days of data) [2025-09-14T16:55:37.163494] [DEBUG] [LOCAL ] AU: Primary data saved (39866 records). [2025-09-14T16:55:37.163752] [INFO ] [MAIN ] AU: Full history saved. [2025-09-14T16:55:37.163891] [INFO ] [MAIN ] Update Progress: 180/2370 symbols completed. AU took 40.9s. Estimated remaining: 3h 44m 10s. Rate: 9.8 symbols/min [2025-09-14T16:55:37.352202] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:55:37.365703] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-09-14T16:55:37.368997] [DEBUG] [LOCAL ] AVBC: Loaded 3893 existing records from primary storage. [2025-09-14T16:55:37.384687] [INFO ] [MAIN ] AVBC: Loaded 3893 existing records. [2025-09-14T16:55:37.386597] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T16:55:37.584099] [WARN ] [MAIN ] AVBC: Insufficient historical data. Have data from 2025-08-01, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:55:37.584450] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-14T16:55:37.584539] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-14T16:55:37.584890] [DEBUG] [LOCAL ] AVBC: Deleted primary data file. [2025-09-14T16:55:37.584971] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-14T16:55:37.964852] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:55:37.992715] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-14T16:55:38.158838] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-09-14T16:55:38.402293] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-14T16:55:38.768582] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T16:55:38.772672] [INFO ] [REMOTE ] AVA: Full fetch complete (42826 records). [2025-09-14T16:55:38.772776] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-09-14T16:55:38.963960] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-09-14T16:55:39.163505] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-09-14T16:55:39.163618] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-09-14T16:55:39.164222] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-09-14T16:55:39.164283] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-09-14T16:55:39.165529] [DEBUG] [LOCAL ] AVA: Trimmed 42826 records to 29173 (keeping 150 days of data) [2025-09-14T16:55:39.347317] [DEBUG] [LOCAL ] AVA: Primary data saved (29173 records). [2025-09-14T16:55:39.347493] [INFO ] [MAIN ] AVA: Full history saved. [2025-09-14T16:55:39.347595] [INFO ] [MAIN ] Update Progress: 181/2370 symbols completed. AVA took 21.8s. Estimated remaining: 3h 43m 16s. Rate: 9.8 symbols/min [2025-09-14T16:55:39.515246] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:55:39.526021] [DEBUG] [LOCAL ] AVD: Loaded 10298 existing records from primary storage. [2025-09-14T16:55:39.526165] [INFO ] [MAIN ] AVD: Loaded 10298 existing records. [2025-09-14T16:55:39.705252] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:55:39.705658] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-09-14T16:55:39.705726] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-09-14T16:55:39.706079] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-09-14T16:55:39.706138] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-09-14T16:55:39.767320] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-02. [2025-09-14T16:55:40.078081] [INFO ] [REMOTE ] AVD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:55:40.080336] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-14T16:55:40.110905] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:55:40.111342] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-02 [2025-09-14T16:55:40.558849] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-09-14T16:55:41.358856] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-09-14T16:55:41.490170] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-14T16:55:42.158834] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-03. [2025-09-14T16:55:42.431169] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:55:42.433922] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-03 [2025-09-14T16:55:42.433837] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T16:55:42.958831] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-09-14T16:55:43.758861] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-09-14T16:55:44.287224] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T16:55:44.528010] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-14T16:55:44.558801] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-09-14T16:55:45.156320] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-14T16:55:45.358840] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-04. [2025-09-14T16:55:45.615808] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:55:45.616183] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-04 [2025-09-14T16:55:46.158902] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-09-14T16:55:46.958865] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-09-14T16:55:47.710237] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-14T16:55:47.758820] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-09-14T16:55:47.876233] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T16:55:48.366864] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T16:55:48.368098] [INFO ] [REMOTE ] AVAL: Full fetch complete (11046 records). [2025-09-14T16:55:48.368183] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-09-14T16:55:48.586021] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-05. [2025-09-14T16:55:48.771765] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-09-14T16:55:48.771871] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-09-14T16:55:48.772119] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-09-14T16:55:48.772178] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-09-14T16:55:48.772672] [DEBUG] [LOCAL ] AVAL: Trimmed 11046 records to 6001 (keeping 150 days of data) [2025-09-14T16:55:48.813102] [DEBUG] [LOCAL ] AVAL: Primary data saved (6001 records). [2025-09-14T16:55:48.813413] [INFO ] [MAIN ] AVAL: Full history saved. [2025-09-14T16:55:48.813560] [INFO ] [MAIN ] Update Progress: 182/2370 symbols completed. AVAL took 21.6s. Estimated remaining: 3h 43m 50s. Rate: 9.8 symbols/min [2025-09-14T16:55:48.988105] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:55:48.991802] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:55:48.992407] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-05 [2025-09-14T16:55:49.005952] [DEBUG] [LOCAL ] AVK: Loaded 8724 existing records from primary storage. [2025-09-14T16:55:49.006170] [INFO ] [MAIN ] AVK: Loaded 8724 existing records. [2025-09-14T16:55:49.201245] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:55:49.201613] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-09-14T16:55:49.201702] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-09-14T16:55:49.202171] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-09-14T16:55:49.202239] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-09-14T16:55:49.369370] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-09-14T16:55:49.583979] [INFO ] [REMOTE ] AVK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:55:50.158838] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-06. [2025-09-14T16:55:50.432538] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:55:50.432916] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-06 [2025-09-14T16:55:50.651242] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T16:55:50.958832] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-07. [2025-09-14T16:55:51.227175] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:55:51.227504] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-07 [2025-09-14T16:55:51.758895] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-08. [2025-09-14T16:55:52.558830] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-09-14T16:55:52.826110] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-14T16:55:53.358912] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-09-14T16:55:53.828621] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-14T16:55:54.033389] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-14T16:55:54.158835] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-09-14T16:55:54.958863] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-09-14T16:55:55.288257] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-14T16:55:55.758869] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-09-14T16:55:56.558842] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-09. [2025-09-14T16:55:56.589631] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T16:55:56.841145] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T16:55:57.358829] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-09-14T16:55:57.373415] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T16:55:57.375203] [INFO ] [REMOTE ] AVBC: Full fetch complete (3893 records). [2025-09-14T16:55:57.375310] [DEBUG] [VALIDATOR ] AVBC: Validating primary data. [2025-09-14T16:55:57.555122] [WARN ] [VALIDATOR ] AVBC: Validation failed - insufficient historical data. Have 30 unique days, need 150 days [2025-09-14T16:55:57.555348] [FATAL] [MAIN ] AVBC: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:55:57.555404] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:55:57.555463] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-14T16:55:57.555545] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-14T16:55:57.555625] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-14T16:55:57.555726] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-14T16:55:57.555842] [INFO ] [MAIN ] Update Progress: 183/2370 symbols completed. AVBC took 20.4s. Estimated remaining: 3h 44m 15s. Rate: 9.8 symbols/min [2025-09-14T16:55:57.726370] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:55:57.742830] [DEBUG] [LOCAL ] AVNS: Loaded 15455 existing records from primary storage. [2025-09-14T16:55:57.742991] [INFO ] [MAIN ] AVNS: Loaded 15455 existing records. [2025-09-14T16:55:57.920937] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:55:57.921401] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-09-14T16:55:57.926624] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-09-14T16:55:57.932404] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T16:55:57.936319] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-09-14T16:55:57.936769] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-09-14T16:55:57.979520] [INFO ] [REMOTE ] AVB: Full fetch complete (44630 records). [2025-09-14T16:55:58.011445] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-09-14T16:55:58.178072] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-09-14T16:55:58.584531] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:55:58.670839] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-09-14T16:55:58.670941] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-09-14T16:55:58.671432] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-09-14T16:55:58.671493] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-09-14T16:55:58.672493] [DEBUG] [LOCAL ] AVB: Trimmed 44630 records to 31412 (keeping 150 days of data) [2025-09-14T16:55:58.871119] [DEBUG] [LOCAL ] AVB: Primary data saved (31412 records). [2025-09-14T16:55:58.871316] [INFO ] [MAIN ] AVB: Full history saved. [2025-09-14T16:55:58.871425] [INFO ] [MAIN ] Update Progress: 184/2370 symbols completed. AVB took 30.5s. Estimated remaining: 3h 43m 11s. Rate: 9.8 symbols/min [2025-09-14T16:55:58.968147] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-09-14T16:55:59.046144] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:55:59.066407] [DEBUG] [LOCAL ] AVNT: Loaded 17850 existing records from primary storage. [2025-09-14T16:55:59.066587] [INFO ] [MAIN ] AVNT: Loaded 17850 existing records. [2025-09-14T16:55:59.239176] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:55:59.239432] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-09-14T16:55:59.239574] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-14T16:55:59.240098] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-09-14T16:55:59.240160] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-09-14T16:55:59.555900] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-14T16:55:59.633946] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:55:59.758851] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-09-14T16:56:00.210349] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-14T16:56:00.558840] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-09-14T16:56:01.186530] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T16:56:01.360168] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-09-14T16:56:01.361667] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-14T16:56:02.158837] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-09-14T16:56:02.665163] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-14T16:56:02.865889] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T16:56:02.869673] [INFO ] [REMOTE ] AVD: Full fetch complete (24780 records). [2025-09-14T16:56:02.869834] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-09-14T16:56:02.964049] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-09-14T16:56:03.269730] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-09-14T16:56:03.269847] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-09-14T16:56:03.270259] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-09-14T16:56:03.270315] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-09-14T16:56:03.271044] [DEBUG] [LOCAL ] AVD: Trimmed 24780 records to 16581 (keeping 150 days of data) [2025-09-14T16:56:03.364091] [DEBUG] [LOCAL ] AVD: Primary data saved (16581 records). [2025-09-14T16:56:03.364264] [INFO ] [MAIN ] AVD: Full history saved. [2025-09-14T16:56:03.364371] [INFO ] [MAIN ] Update Progress: 185/2370 symbols completed. AVD took 24.0s. Estimated remaining: 3h 42m 46s. Rate: 9.8 symbols/min [2025-09-14T16:56:03.530829] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:56:03.554329] [DEBUG] [LOCAL ] AVTR: Loaded 23979 existing records from primary storage. [2025-09-14T16:56:03.554486] [INFO ] [MAIN ] AVTR: Loaded 23979 existing records. [2025-09-14T16:56:03.727128] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:56:03.727363] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-09-14T16:56:03.727420] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-14T16:56:03.728180] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-09-14T16:56:03.728244] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-09-14T16:56:03.763995] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-09-14T16:56:04.077564] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:56:04.323460] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-14T16:56:04.558881] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-09-14T16:56:05.364597] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-09-14T16:56:05.369030] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T16:56:06.158852] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-09-14T16:56:06.301729] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T16:56:06.465243] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T16:56:06.958887] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-09-14T16:56:07.738204] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-14T16:56:07.758796] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-09-14T16:56:08.068060] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-14T16:56:08.558858] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-09-14T16:56:09.068615] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-14T16:56:09.358823] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-09-14T16:56:10.158886] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-09-14T16:56:10.395121] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-14T16:56:10.433279] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T16:56:10.958843] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-09-14T16:56:11.231300] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T16:56:11.758830] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-09-14T16:56:11.980613] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-14T16:56:12.558843] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-09-14T16:56:13.358790] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-09-14T16:56:13.522206] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-14T16:56:13.633249] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-14T16:56:14.158872] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-09-14T16:56:14.435240] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-14T16:56:14.869194] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-14T16:56:14.958826] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-09-14T16:56:15.758825] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-09-14T16:56:15.943203] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T16:56:15.945773] [INFO ] [REMOTE ] AVK: Full fetch complete (19674 records). [2025-09-14T16:56:15.945889] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-09-14T16:56:16.354877] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-09-14T16:56:16.355005] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-09-14T16:56:16.355366] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-09-14T16:56:16.355437] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-09-14T16:56:16.356134] [DEBUG] [LOCAL ] AVK: Trimmed 19674 records to 13507 (keeping 150 days of data) [2025-09-14T16:56:16.450738] [DEBUG] [LOCAL ] AVK: Primary data saved (13507 records). [2025-09-14T16:56:16.450955] [INFO ] [MAIN ] AVK: Full history saved. [2025-09-14T16:56:16.451074] [INFO ] [MAIN ] Update Progress: 186/2370 symbols completed. AVK took 27.6s. Estimated remaining: 3h 44m 2s. Rate: 9.7 symbols/min [2025-09-14T16:56:16.563996] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-09-14T16:56:16.628576] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:56:16.647513] [DEBUG] [LOCAL ] AVY: Loaded 15831 existing records from primary storage. [2025-09-14T16:56:16.647704] [INFO ] [MAIN ] AVY: Loaded 15831 existing records. [2025-09-14T16:56:16.831615] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:56:16.831998] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-09-14T16:56:16.832063] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-14T16:56:16.832544] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-09-14T16:56:16.832618] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-09-14T16:56:17.204425] [INFO ] [REMOTE ] AVY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:56:17.228205] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T16:56:17.358867] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-09-14T16:56:18.158853] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-09-14T16:56:18.380437] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T16:56:18.831553] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-14T16:56:18.958854] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-09-14T16:56:19.646173] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T16:56:19.758839] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-09-14T16:56:20.363984] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T16:56:20.367787] [INFO ] [REMOTE ] AVNS: Full fetch complete (36259 records). [2025-09-14T16:56:20.367894] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-09-14T16:56:20.569669] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-09-14T16:56:20.765871] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-09-14T16:56:20.766066] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-09-14T16:56:20.766718] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-09-14T16:56:20.766898] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-09-14T16:56:20.789757] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-14T16:56:20.789946] [DEBUG] [LOCAL ] AVNS: Trimmed 36259 records to 25223 (keeping 150 days of data) [2025-09-14T16:56:20.951042] [DEBUG] [LOCAL ] AVNS: Primary data saved (25223 records). [2025-09-14T16:56:20.951238] [INFO ] [MAIN ] AVNS: Full history saved. [2025-09-14T16:56:20.951356] [INFO ] [MAIN ] Update Progress: 187/2370 symbols completed. AVNS took 23.4s. Estimated remaining: 3h 43m 36s. Rate: 9.8 symbols/min [2025-09-14T16:56:21.140357] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:56:21.154404] [DEBUG] [LOCAL ] AWF: Loaded 10476 existing records from primary storage. [2025-09-14T16:56:21.154582] [INFO ] [MAIN ] AWF: Loaded 10476 existing records. [2025-09-14T16:56:21.362767] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-09-14T16:56:21.367073] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:56:21.368191] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-09-14T16:56:21.368251] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-14T16:56:21.368625] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-09-14T16:56:21.368710] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-09-14T16:56:21.725590] [INFO ] [REMOTE ] AWF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:56:22.158847] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-09-14T16:56:22.280266] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T16:56:22.958874] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-09-14T16:56:23.157299] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T16:56:23.207043] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T16:56:23.758845] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-09-14T16:56:24.558868] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-09-14T16:56:24.591087] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T16:56:24.873701] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-14T16:56:25.358901] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-09-14T16:56:25.693898] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T16:56:25.702304] [INFO ] [REMOTE ] AVNT: Full fetch complete (43041 records). [2025-09-14T16:56:25.702590] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-09-14T16:56:26.163969] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-09-14T16:56:26.244876] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-09-14T16:56:26.245007] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-09-14T16:56:26.246024] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-09-14T16:56:26.246089] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-09-14T16:56:26.247271] [DEBUG] [LOCAL ] AVNT: Trimmed 43041 records to 29154 (keeping 150 days of data) [2025-09-14T16:56:26.459845] [DEBUG] [LOCAL ] AVNT: Primary data saved (29154 records). [2025-09-14T16:56:26.461471] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-14T16:56:26.461694] [INFO ] [MAIN ] AVNT: Full history saved. [2025-09-14T16:56:26.471343] [INFO ] [MAIN ] Update Progress: 188/2370 symbols completed. AVNT took 27.6s. Estimated remaining: 3h 43m 23s. Rate: 9.8 symbols/min [2025-09-14T16:56:26.675130] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:56:26.689700] [DEBUG] [LOCAL ] AWI: Loaded 12079 existing records from primary storage. [2025-09-14T16:56:26.689886] [INFO ] [MAIN ] AWI: Loaded 12079 existing records. [2025-09-14T16:56:26.875660] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:56:26.875950] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-09-14T16:56:26.876013] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-14T16:56:26.876517] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-09-14T16:56:26.876617] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-09-14T16:56:26.964137] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-09-14T16:56:27.244239] [INFO ] [REMOTE ] AWI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:56:27.436864] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-14T16:56:27.758856] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-09-14T16:56:28.508101] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T16:56:28.558802] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-09-14T16:56:28.789140] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T16:56:29.358848] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-09-14T16:56:30.158840] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-09-14T16:56:30.349985] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T16:56:30.373795] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-14T16:56:30.958845] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-09-14T16:56:31.391042] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-14T16:56:31.758873] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-09-14T16:56:32.558828] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-09-14T16:56:32.829979] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-14T16:56:32.872541] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-14T16:56:33.358841] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-09-14T16:56:33.566794] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-14T16:56:34.158844] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-09-14T16:56:34.306612] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-14T16:56:34.958840] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-09-14T16:56:35.086126] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-14T16:56:35.758837] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-09-14T16:56:36.321300] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-14T16:56:36.558832] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-09-14T16:56:37.260777] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T16:56:37.358826] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-09-14T16:56:38.158845] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-09-14T16:56:38.399368] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T16:56:38.412207] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-14T16:56:38.415579] [INFO ] [REMOTE ] AWF: Full fetch complete (26601 records). [2025-09-14T16:56:38.416082] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-09-14T16:56:38.786608] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-09-14T16:56:38.786742] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-09-14T16:56:38.787149] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-09-14T16:56:38.787219] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-09-14T16:56:38.788006] [DEBUG] [LOCAL ] AWF: Trimmed 26601 records to 17314 (keeping 150 days of data) [2025-09-14T16:56:38.899464] [DEBUG] [LOCAL ] AWF: Primary data saved (17314 records). [2025-09-14T16:56:38.899667] [INFO ] [MAIN ] AWF: Full history saved. [2025-09-14T16:56:38.899797] [INFO ] [MAIN ] Update Progress: 189/2370 symbols completed. AWF took 17.9s. Estimated remaining: 3h 44m 29s. Rate: 9.7 symbols/min [2025-09-14T16:56:38.963298] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-09-14T16:56:39.077222] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:56:39.097103] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-14T16:56:39.131496] [DEBUG] [LOCAL ] AWK: Loaded 21679 existing records from primary storage. [2025-09-14T16:56:39.131806] [INFO ] [MAIN ] AWK: Loaded 21679 existing records. [2025-09-14T16:56:39.306165] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:56:39.306499] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-09-14T16:56:39.306587] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-09-14T16:56:39.307841] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-09-14T16:56:39.307905] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-09-14T16:56:39.658873] [INFO ] [REMOTE ] AWK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:56:39.758800] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-09-14T16:56:40.194919] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-14T16:56:40.558864] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-09-14T16:56:41.185083] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T16:56:41.188983] [INFO ] [REMOTE ] AVY: Full fetch complete (41208 records). [2025-09-14T16:56:41.189121] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-09-14T16:56:41.364873] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-09-14T16:56:41.580171] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-09-14T16:56:41.580356] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-09-14T16:56:41.580896] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-09-14T16:56:41.581091] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-09-14T16:56:41.582786] [DEBUG] [LOCAL ] AVY: Trimmed 41208 records to 27556 (keeping 150 days of data) [2025-09-14T16:56:41.682136] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-14T16:56:41.823157] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-14T16:56:41.830894] [INFO ] [REMOTE ] AVTR: Full fetch complete (58235 records). [2025-09-14T16:56:41.832147] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-09-14T16:56:42.001622] [DEBUG] [LOCAL ] AVY: Primary data saved (27556 records). [2025-09-14T16:56:42.041277] [INFO ] [MAIN ] AVY: Full history saved. [2025-09-14T16:56:42.083297] [INFO ] [MAIN ] Update Progress: 190/2370 symbols completed. AVY took 25.6s. Estimated remaining: 3h 43m 49s. Rate: 9.7 symbols/min [2025-09-14T16:56:42.162798] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-09-14T16:56:42.399589] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:56:42.399766] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-09-14T16:56:42.399932] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-09-14T16:56:42.400817] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-09-14T16:56:42.401036] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-09-14T16:56:42.402926] [DEBUG] [LOCAL ] AVTR: Trimmed 58235 records to 40334 (keeping 150 days of data) [2025-09-14T16:56:42.465177] [DEBUG] [LOCAL ] AWP: Loaded 11198 existing records from primary storage. [2025-09-14T16:56:42.465426] [INFO ] [MAIN ] AWP: Loaded 11198 existing records. [2025-09-14T16:56:42.698804] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:56:42.700581] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-09-14T16:56:42.701168] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-09-14T16:56:42.702550] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-09-14T16:56:42.703205] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-09-14T16:56:42.959136] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-09-14T16:56:43.070387] [INFO ] [REMOTE ] AWP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:56:43.207223] [DEBUG] [LOCAL ] AVTR: Primary data saved (40334 records). [2025-09-14T16:56:43.207419] [INFO ] [MAIN ] AVTR: Full history saved. [2025-09-14T16:56:43.207555] [INFO ] [MAIN ] Update Progress: 191/2370 symbols completed. AVTR took 39.8s. Estimated remaining: 3h 42m 45s. Rate: 9.8 symbols/min [2025-09-14T16:56:43.374871] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:56:43.386038] [DEBUG] [LOCAL ] AWR: Loaded 10174 existing records from primary storage. [2025-09-14T16:56:43.386203] [INFO ] [MAIN ] AWR: Loaded 10174 existing records. [2025-09-14T16:56:43.571250] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:56:43.571593] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-09-14T16:56:43.571679] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-09-14T16:56:43.572429] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-09-14T16:56:43.572745] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-09-14T16:56:43.782412] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-09-14T16:56:43.931735] [INFO ] [REMOTE ] AWR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:56:44.101350] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-14T16:56:44.217068] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T16:56:44.558840] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-09-14T16:56:44.898310] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-14T16:56:45.358880] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-09-14T16:56:46.158825] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-09-14T16:56:46.249532] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T16:56:46.321481] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-14T16:56:46.958854] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-09-14T16:56:47.504003] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T16:56:47.758805] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-09-14T16:56:48.068141] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-14T16:56:48.558851] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-09-14T16:56:48.981003] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-14T16:56:49.358796] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-09-14T16:56:49.627122] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-14T16:56:50.158828] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-09-14T16:56:50.958801] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-09-14T16:56:51.243276] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-14T16:56:51.491701] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-14T16:56:51.758872] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-09-14T16:56:51.772214] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-14T16:56:52.558822] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-09-14T16:56:52.878222] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-14T16:56:53.358817] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-09-14T16:56:53.618435] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-14T16:56:54.158835] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-09-14T16:56:54.542500] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-14T16:56:54.691770] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T16:56:54.694781] [INFO ] [REMOTE ] AWI: Full fetch complete (28505 records). [2025-09-14T16:56:54.694873] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-09-14T16:56:54.964030] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-09-14T16:56:55.070712] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-09-14T16:56:55.070857] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-09-14T16:56:55.071617] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-09-14T16:56:55.071701] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-09-14T16:56:55.072733] [DEBUG] [LOCAL ] AWI: Trimmed 28505 records to 19432 (keeping 150 days of data) [2025-09-14T16:56:55.208327] [DEBUG] [LOCAL ] AWI: Primary data saved (19432 records). [2025-09-14T16:56:55.208607] [INFO ] [MAIN ] AWI: Full history saved. [2025-09-14T16:56:55.208793] [INFO ] [MAIN ] Update Progress: 192/2370 symbols completed. AWI took 28.7s. Estimated remaining: 3h 43m 46s. Rate: 9.7 symbols/min [2025-09-14T16:56:55.383897] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:56:55.399014] [DEBUG] [LOCAL ] AX: Loaded 12263 existing records from primary storage. [2025-09-14T16:56:55.399252] [INFO ] [MAIN ] AX: Loaded 12263 existing records. [2025-09-14T16:56:55.586493] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:56:55.586893] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-09-14T16:56:55.586997] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-09-14T16:56:55.587921] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-09-14T16:56:55.587996] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-09-14T16:56:55.766807] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-09-14T16:56:55.957789] [INFO ] [REMOTE ] AX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:56:56.558877] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-09-14T16:56:56.782697] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T16:56:56.895776] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-14T16:56:57.358813] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-09-14T16:56:57.455555] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-14T16:56:58.158831] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-09-14T16:56:58.428751] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-14T16:56:58.958834] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-09-14T16:56:59.623478] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T16:56:59.758816] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-09-14T16:57:00.010257] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-14T16:57:00.558827] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-09-14T16:57:01.358849] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-09-14T16:57:01.800621] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-14T16:57:01.830949] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-14T16:57:02.007074] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T16:57:02.011175] [INFO ] [REMOTE ] AWP: Full fetch complete (23837 records). [2025-09-14T16:57:02.011462] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-09-14T16:57:02.164008] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-09-14T16:57:02.415813] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-09-14T16:57:02.415977] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-09-14T16:57:02.416485] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-09-14T16:57:02.416549] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-09-14T16:57:02.417820] [DEBUG] [LOCAL ] AWP: Trimmed 23837 records to 16752 (keeping 150 days of data) [2025-09-14T16:57:02.523885] [DEBUG] [LOCAL ] AWP: Primary data saved (16752 records). [2025-09-14T16:57:02.524201] [INFO ] [MAIN ] AWP: Full history saved. [2025-09-14T16:57:02.524373] [INFO ] [MAIN ] Update Progress: 193/2370 symbols completed. AWP took 20.4s. Estimated remaining: 3h 43m 52s. Rate: 9.7 symbols/min [2025-09-14T16:57:02.700612] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:57:02.723695] [DEBUG] [LOCAL ] AXL: Loaded 22482 existing records from primary storage. [2025-09-14T16:57:02.723908] [INFO ] [MAIN ] AXL: Loaded 22482 existing records. [2025-09-14T16:57:02.900241] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:57:02.900494] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-09-14T16:57:02.900555] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-09-14T16:57:02.901171] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-09-14T16:57:02.901236] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-09-14T16:57:02.963914] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-09-14T16:57:03.259187] [INFO ] [REMOTE ] AXL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:57:03.316338] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-14T16:57:03.630818] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T16:57:03.635870] [INFO ] [REMOTE ] AWK: Full fetch complete (53215 records). [2025-09-14T16:57:03.636000] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-09-14T16:57:03.763917] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-09-14T16:57:04.015660] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-09-14T16:57:04.015771] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-09-14T16:57:04.016369] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-09-14T16:57:04.016425] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-09-14T16:57:04.017605] [DEBUG] [LOCAL ] AWK: Trimmed 53215 records to 36312 (keeping 150 days of data) [2025-09-14T16:57:04.240094] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-14T16:57:04.246013] [INFO ] [REMOTE ] AWR: Full fetch complete (24158 records). [2025-09-14T16:57:04.248725] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-09-14T16:57:04.563973] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-09-14T16:57:04.635263] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-09-14T16:57:04.638273] [DEBUG] [LOCAL ] AWK: Primary data saved (36312 records). [2025-09-14T16:57:04.638315] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-09-14T16:57:04.639076] [INFO ] [MAIN ] AWK: Full history saved. [2025-09-14T16:57:04.639509] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-09-14T16:57:04.639606] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-09-14T16:57:04.639723] [INFO ] [MAIN ] Update Progress: 194/2370 symbols completed. AWK took 25.7s. Estimated remaining: 3h 43m 1s. Rate: 9.8 symbols/min [2025-09-14T16:57:04.737883] [DEBUG] [LOCAL ] AWR: Trimmed 24158 records to 16385 (keeping 150 days of data) [2025-09-14T16:57:04.886927] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:57:04.916320] [DEBUG] [LOCAL ] AXP: Loaded 23889 existing records from primary storage. [2025-09-14T16:57:04.917538] [INFO ] [MAIN ] AXP: Loaded 23889 existing records. [2025-09-14T16:57:05.108477] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:57:05.109946] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-09-14T16:57:05.110659] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-14T16:57:05.112720] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-09-14T16:57:05.113277] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-09-14T16:57:05.214223] [DEBUG] [LOCAL ] AWR: Primary data saved (16385 records). [2025-09-14T16:57:05.216485] [INFO ] [MAIN ] AWR: Full history saved. [2025-09-14T16:57:05.237866] [INFO ] [MAIN ] Update Progress: 195/2370 symbols completed. AWR took 22.0s. Estimated remaining: 3h 41m 53s. Rate: 9.8 symbols/min [2025-09-14T16:57:05.360803] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-09-14T16:57:05.620832] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:57:05.654881] [INFO ] [REMOTE ] AXP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:57:05.658559] [DEBUG] [LOCAL ] AXR: Loaded 1389 existing records from primary storage. [2025-09-14T16:57:05.658669] [INFO ] [MAIN ] AXR: Loaded 1389 existing records. [2025-09-14T16:57:05.859003] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:57:05.859292] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-09-14T16:57:05.859358] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-09-14T16:57:05.859605] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-09-14T16:57:05.859692] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-09-14T16:57:06.164042] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-09-14T16:57:06.259685] [INFO ] [REMOTE ] AXR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:57:06.290842] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T16:57:06.871039] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T16:57:06.958871] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-09-14T16:57:07.758801] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-09-14T16:57:08.194259] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-14T16:57:08.231328] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-14T16:57:08.326225] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-14T16:57:08.558859] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-09-14T16:57:08.975939] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-14T16:57:09.358886] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-09-14T16:57:09.989674] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-14T16:57:10.158897] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-09-14T16:57:10.958863] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-09-14T16:57:11.758840] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-09-14T16:57:12.136408] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-14T16:57:12.228076] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-14T16:57:12.299424] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-14T16:57:12.558828] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-09-14T16:57:13.282456] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-14T16:57:13.358924] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-09-14T16:57:14.158896] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-09-14T16:57:14.958950] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-09-14T16:57:15.138371] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-14T16:57:15.758849] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-09-14T16:57:15.879913] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-14T16:57:16.541463] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-14T16:57:16.560006] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-14T16:57:16.560094] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-09-14T16:57:17.110324] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-14T16:57:17.358916] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-09-14T16:57:18.158914] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-09-14T16:57:18.678581] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-14T16:57:18.958951] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-09-14T16:57:19.758895] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-09-14T16:57:20.239414] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-14T16:57:20.354007] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-14T16:57:20.558830] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-09-14T16:57:20.897330] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T16:57:21.358815] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-09-14T16:57:22.158827] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-09-14T16:57:22.553218] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T16:57:22.554891] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-14T16:57:22.566374] [INFO ] [REMOTE ] AXR: Full fetch complete (3328 records). [2025-09-14T16:57:22.566729] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-09-14T16:57:22.955894] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-14T16:57:22.956135] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-09-14T16:57:22.962037] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-09-14T16:57:22.962170] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-09-14T16:57:22.963959] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-09-14T16:57:22.964561] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-09-14T16:57:22.965146] [DEBUG] [LOCAL ] AXR: Trimmed 3328 records to 2176 (keeping 150 days of data) [2025-09-14T16:57:22.978615] [DEBUG] [LOCAL ] AXR: Primary data saved (2176 records). [2025-09-14T16:57:22.978722] [INFO ] [MAIN ] AXR: Full history saved. [2025-09-14T16:57:22.978835] [INFO ] [MAIN ] Update Progress: 196/2370 symbols completed. AXR took 17.7s. Estimated remaining: 3h 43m 55s. Rate: 9.7 symbols/min [2025-09-14T16:57:23.150349] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:57:23.167794] [DEBUG] [LOCAL ] AXS: Loaded 17155 existing records from primary storage. [2025-09-14T16:57:23.167957] [INFO ] [MAIN ] AXS: Loaded 17155 existing records. [2025-09-14T16:57:23.343355] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:57:23.343783] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-09-14T16:57:23.344052] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-09-14T16:57:23.344682] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-09-14T16:57:23.344748] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-09-14T16:57:23.698933] [INFO ] [REMOTE ] AXS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:57:23.758824] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-09-14T16:57:24.493134] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-14T16:57:24.558830] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-09-14T16:57:25.358868] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-09-14T16:57:26.003089] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-14T16:57:26.158815] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-09-14T16:57:26.385927] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T16:57:26.843860] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-14T16:57:26.958822] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-09-14T16:57:27.758840] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-09-14T16:57:28.277930] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-14T16:57:28.449970] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-14T16:57:28.558849] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-09-14T16:57:29.081000] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-14T16:57:29.358814] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-09-14T16:57:30.002419] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T16:57:30.008043] [INFO ] [REMOTE ] AXP: Full fetch complete (57853 records). [2025-09-14T16:57:30.008174] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-09-14T16:57:30.165241] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-09-14T16:57:30.393541] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-09-14T16:57:30.393784] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-09-14T16:57:30.394425] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-09-14T16:57:30.394516] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-09-14T16:57:30.422345] [DEBUG] [LOCAL ] AXP: Trimmed 57853 records to 40062 (keeping 150 days of data) [2025-09-14T16:57:30.424419] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T16:57:30.685581] [DEBUG] [LOCAL ] AXP: Primary data saved (40062 records). [2025-09-14T16:57:30.685779] [INFO ] [MAIN ] AXP: Full history saved. [2025-09-14T16:57:30.685885] [INFO ] [MAIN ] Update Progress: 197/2370 symbols completed. AXP took 26.0s. Estimated remaining: 3h 44m 6s. Rate: 9.7 symbols/min [2025-09-14T16:57:30.760089] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T16:57:30.763298] [INFO ] [REMOTE ] AX: Full fetch complete (31189 records). [2025-09-14T16:57:30.763412] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-09-14T16:57:30.968606] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-09-14T16:57:31.134141] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-09-14T16:57:31.134285] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-09-14T16:57:31.134736] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-09-14T16:57:31.134813] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-09-14T16:57:31.135828] [DEBUG] [LOCAL ] AX: Trimmed 31189 records to 20596 (keeping 150 days of data) [2025-09-14T16:57:31.260993] [DEBUG] [LOCAL ] AX: Primary data saved (20596 records). [2025-09-14T16:57:31.261175] [INFO ] [MAIN ] AX: Full history saved. [2025-09-14T16:57:31.261290] [INFO ] [MAIN ] Update Progress: 198/2370 symbols completed. AX took 36.1s. Estimated remaining: 3h 42m 58s. Rate: 9.7 symbols/min [2025-09-14T16:57:31.299710] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T16:57:31.304990] [INFO ] [REMOTE ] AXL: Full fetch complete (55021 records). [2025-09-14T16:57:31.305170] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-09-14T16:57:31.695771] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-09-14T16:57:31.696008] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-09-14T16:57:31.696633] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-09-14T16:57:31.696717] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-09-14T16:57:31.698042] [DEBUG] [LOCAL ] AXL: Trimmed 55021 records to 37892 (keeping 150 days of data) [2025-09-14T16:57:31.783321] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-09-14T16:57:31.926441] [DEBUG] [LOCAL ] AXL: Primary data saved (37892 records). [2025-09-14T16:57:31.926663] [INFO ] [MAIN ] AXL: Full history saved. [2025-09-14T16:57:31.926765] [INFO ] [MAIN ] Update Progress: 199/2370 symbols completed. AXL took 29.4s. Estimated remaining: 3h 41m 52s. Rate: 9.8 symbols/min [2025-09-14T16:57:33.376424] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-14T16:57:33.384525] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-09-14T16:57:34.639037] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-14T16:57:34.648163] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-09-14T16:57:36.143446] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T16:57:36.152457] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-09-14T16:57:37.545294] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T16:57:37.554017] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-09-14T16:57:38.475016] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-14T16:57:38.479076] [INFO ] [REMOTE ] AXS: Full fetch complete (41482 records). [2025-09-14T16:57:38.479204] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-09-14T16:57:38.855812] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-09-14T16:57:38.855926] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-09-14T16:57:38.856481] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-09-14T16:57:38.856549] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-09-14T16:57:38.857567] [DEBUG] [LOCAL ] AXS: Trimmed 41482 records to 28568 (keeping 150 days of data) [2025-09-14T16:57:39.042492] [DEBUG] [LOCAL ] AXS: Primary data saved (28568 records). [2025-09-14T16:57:39.042700] [INFO ] [MAIN ] AXS: Full history saved. [2025-09-14T16:57:39.042846] [INFO ] [MAIN ] Update Progress: 200/2370 symbols completed. AXS took 16.1s. Estimated remaining: 3h 41m 57s. Rate: 9.8 symbols/min [2025-09-14T16:57:39.648453] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:57:39.692965] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:57:39.752830] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:57:39.755243] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:57:39.776093] [DEBUG] [LOCAL ] AZZ: Loaded 10278 existing records from primary storage. [2025-09-14T16:57:39.775743] [DEBUG] [LOCAL ] AZO: Loaded 4712 existing records from primary storage. [2025-09-14T16:57:39.776408] [INFO ] [MAIN ] AZO: Loaded 4712 existing records. [2025-09-14T16:57:39.776458] [INFO ] [MAIN ] AZZ: Loaded 10278 existing records. [2025-09-14T16:57:39.780554] [DEBUG] [LOCAL ] AYI: Loaded 10549 existing records from primary storage. [2025-09-14T16:57:39.801754] [INFO ] [MAIN ] AYI: Loaded 10549 existing records. [2025-09-14T16:57:40.051016] [DEBUG] [LOCAL ] AXTA: Loaded 23295 existing records from primary storage. [2025-09-14T16:57:40.098912] [INFO ] [MAIN ] AXTA: Loaded 23295 existing records. [2025-09-14T16:57:40.242709] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:57:40.344776] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:57:40.420398] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-09-14T16:57:40.433715] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:57:40.420470] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-09-14T16:57:40.441319] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-09-14T16:57:40.444710] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-14T16:57:40.444767] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-09-14T16:57:40.445133] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-14T16:57:40.455486] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-09-14T16:57:40.455524] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-09-14T16:57:40.466118] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-09-14T16:57:40.466050] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-09-14T16:57:40.460683] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-09-14T16:57:40.599561] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-09-14T16:57:40.608122] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:57:40.739431] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-09-14T16:57:40.790987] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-14T16:57:40.831208] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-09-14T16:57:40.912523] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-09-14T16:57:41.561461] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:57:41.633025] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-09-14T16:57:41.760191] [INFO ] [REMOTE ] AYI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:57:41.832004] [INFO ] [REMOTE ] AZO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:57:41.882696] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-09-14T16:57:41.856599] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-09-14T16:57:41.983124] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:57:41.983470] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-09-14T16:57:42.743186] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T16:57:42.746145] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-09-14T16:57:42.892395] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-14T16:57:42.897583] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-09-14T16:57:42.948839] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-14T16:57:42.953749] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-09-14T16:57:43.358632] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-14T16:57:43.368784] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-09-14T16:57:43.535841] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-14T16:57:43.540370] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-09-14T16:57:43.716170] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-14T16:57:43.722078] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-09-14T16:57:44.196755] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-14T16:57:44.203883] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-09-14T16:57:44.580931] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-14T16:57:44.591975] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-09-14T16:57:44.612803] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-14T16:57:44.704916] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-14T16:57:45.358930] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-09-14T16:57:45.746087] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-14T16:57:46.046405] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-14T16:57:46.110806] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-14T16:57:46.158816] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-09-14T16:57:46.841039] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-14T16:57:46.958840] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-09-14T16:57:47.758828] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-09-14T16:57:47.866700] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T16:57:48.558797] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-09-14T16:57:48.911200] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-14T16:57:49.358857] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-09-14T16:57:50.154748] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-14T16:57:50.158917] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-09-14T16:57:50.432801] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T16:57:50.760423] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-14T16:57:50.958824] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-09-14T16:57:51.175045] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-09-14T16:57:51.176507] [INFO ] [REMOTE ] AZO: Full fetch complete (12142 records). [2025-09-14T16:57:51.176606] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-09-14T16:57:51.546186] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-09-14T16:57:51.546308] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-09-14T16:57:51.546610] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-09-14T16:57:51.546683] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-09-14T16:57:51.547184] [DEBUG] [LOCAL ] AZO: Trimmed 12142 records to 7902 (keeping 150 days of data) [2025-09-14T16:57:51.597807] [DEBUG] [LOCAL ] AZO: Primary data saved (7902 records). [2025-09-14T16:57:51.597976] [INFO ] [MAIN ] AZO: Full history saved. [2025-09-14T16:57:51.598098] [INFO ] [MAIN ] Update Progress: 201/2370 symbols completed. AZO took 12.6s. Estimated remaining: 3h 42m 60s. Rate: 9.7 symbols/min [2025-09-14T16:57:51.766627] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-09-14T16:57:51.770549] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:57:51.796322] [DEBUG] [LOCAL ] B: Loaded 24154 existing records from primary storage. [2025-09-14T16:57:51.796531] [INFO ] [MAIN ] B: Loaded 24154 existing records. [2025-09-14T16:57:51.974005] [WARN ] [MAIN ] B: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:57:51.974255] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-14T16:57:51.974326] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-14T16:57:51.975018] [DEBUG] [LOCAL ] B: Deleted primary data file. [2025-09-14T16:57:51.975083] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-14T16:57:52.329803] [INFO ] [REMOTE ] B: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:57:52.558826] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-14T16:57:52.800127] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:57:52.800418] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-14T16:57:53.037574] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-14T16:57:53.358872] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-09-14T16:57:54.158882] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-09-14T16:57:54.958860] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-09-14T16:57:55.073834] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-14T16:57:55.097374] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-14T16:57:55.758846] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-09-14T16:57:56.102185] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-14T16:57:56.558840] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-09-14T16:57:57.363901] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-09-14T16:57:57.383022] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-14T16:57:57.881670] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-14T16:57:58.158848] [INFO ] [REMOTE ] B: Fetching primary data for 2025-03. [2025-09-14T16:57:58.280921] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-14T16:57:58.403392] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:57:58.403737] [WARN ] [REMOTE ] B: No data returned for month 2025-03 [2025-09-14T16:57:58.958842] [INFO ] [REMOTE ] B: Fetching primary data for 2025-04. [2025-09-14T16:57:59.207215] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:57:59.207578] [WARN ] [REMOTE ] B: No data returned for month 2025-04 [2025-09-14T16:57:59.758827] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-09-14T16:58:00.293673] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T16:58:00.296236] [INFO ] [REMOTE ] AYI: Full fetch complete (27639 records). [2025-09-14T16:58:00.296374] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-09-14T16:58:00.564016] [INFO ] [REMOTE ] B: Fetching primary data for 2025-05. [2025-09-14T16:58:00.684820] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-09-14T16:58:00.684929] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-09-14T16:58:00.685381] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-09-14T16:58:00.685463] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-09-14T16:58:00.686231] [DEBUG] [LOCAL ] AYI: Trimmed 27639 records to 17957 (keeping 150 days of data) [2025-09-14T16:58:00.797991] [DEBUG] [LOCAL ] AYI: Primary data saved (17957 records). [2025-09-14T16:58:00.798186] [INFO ] [MAIN ] AYI: Full history saved. [2025-09-14T16:58:00.798328] [INFO ] [MAIN ] Update Progress: 202/2370 symbols completed. AYI took 21.8s. Estimated remaining: 3h 43m 26s. Rate: 9.7 symbols/min [2025-09-14T16:58:00.970513] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:58:00.994657] [DEBUG] [LOCAL ] BA: Loaded 24153 existing records from primary storage. [2025-09-14T16:58:00.994840] [INFO ] [MAIN ] BA: Loaded 24153 existing records. [2025-09-14T16:58:01.176511] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:58:01.176898] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-09-14T16:58:01.176972] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-09-14T16:58:01.177677] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-09-14T16:58:01.177755] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-09-14T16:58:01.365193] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-09-14T16:58:01.531709] [INFO ] [REMOTE ] BA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:58:02.158819] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-09-14T16:58:02.364675] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-14T16:58:02.545103] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T16:58:02.958869] [INFO ] [REMOTE ] B: Fetching primary data for 2025-06. [2025-09-14T16:58:03.688739] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-14T16:58:03.758843] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-09-14T16:58:04.392296] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T16:58:04.397967] [INFO ] [REMOTE ] AXTA: Full fetch complete (56579 records). [2025-09-14T16:58:04.398155] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-09-14T16:58:04.562250] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-09-14T16:58:04.788878] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-09-14T16:58:04.788990] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-09-14T16:58:04.789633] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-09-14T16:58:04.789720] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-09-14T16:58:04.791016] [DEBUG] [LOCAL ] AXTA: Trimmed 56579 records to 39189 (keeping 150 days of data) [2025-09-14T16:58:05.040722] [DEBUG] [LOCAL ] AXTA: Primary data saved (39189 records). [2025-09-14T16:58:05.040927] [INFO ] [MAIN ] AXTA: Full history saved. [2025-09-14T16:58:05.041112] [INFO ] [MAIN ] Update Progress: 203/2370 symbols completed. AXTA took 26.0s. Estimated remaining: 3h 42m 59s. Rate: 9.7 symbols/min [2025-09-14T16:58:05.178953] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T16:58:05.226226] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:58:05.230710] [INFO ] [REMOTE ] AZZ: Full fetch complete (24071 records). [2025-09-14T16:58:05.231108] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-09-14T16:58:05.339300] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-14T16:58:05.362207] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-09-14T16:58:05.560373] [DEBUG] [LOCAL ] BABA: Loaded 24180 existing records from primary storage. [2025-09-14T16:58:05.581881] [INFO ] [MAIN ] BABA: Loaded 24180 existing records. [2025-09-14T16:58:05.791486] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-09-14T16:58:05.815810] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-09-14T16:58:05.852329] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-09-14T16:58:05.852451] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:58:05.852558] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-09-14T16:58:05.852793] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-09-14T16:58:05.852973] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-09-14T16:58:05.853532] [DEBUG] [LOCAL ] AZZ: Trimmed 24071 records to 16871 (keeping 150 days of data) [2025-09-14T16:58:05.853953] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-09-14T16:58:05.854025] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-09-14T16:58:06.166980] [INFO ] [REMOTE ] B: Fetching primary data for 2025-07. [2025-09-14T16:58:06.298430] [INFO ] [REMOTE ] BABA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:58:06.313471] [DEBUG] [LOCAL ] AZZ: Primary data saved (16871 records). [2025-09-14T16:58:06.313591] [INFO ] [MAIN ] AZZ: Full history saved. [2025-09-14T16:58:06.313696] [INFO ] [MAIN ] Update Progress: 204/2370 symbols completed. AZZ took 27.3s. Estimated remaining: 3h 42m 1s. Rate: 9.8 symbols/min [2025-09-14T16:58:06.481113] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:58:06.505305] [DEBUG] [LOCAL ] BAC: Loaded 24168 existing records from primary storage. [2025-09-14T16:58:06.505470] [INFO ] [MAIN ] BAC: Loaded 24168 existing records. [2025-09-14T16:58:06.678679] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:58:06.678927] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-09-14T16:58:06.678985] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-09-14T16:58:06.679762] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-09-14T16:58:06.679825] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-09-14T16:58:06.963879] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-09-14T16:58:07.032420] [INFO ] [REMOTE ] BAC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:58:07.766011] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-09-14T16:58:07.768841] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-09-14T16:58:08.120597] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-14T16:58:08.558830] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-09-14T16:58:09.358829] [INFO ] [REMOTE ] B: Fetching primary data for 2025-08. [2025-09-14T16:58:09.622470] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-09-14T16:58:10.070622] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-14T16:58:10.158851] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-09-14T16:58:10.958817] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-09-14T16:58:11.136147] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-14T16:58:11.423269] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-14T16:58:11.758892] [INFO ] [REMOTE ] B: Fetching primary data for 2025-09. [2025-09-14T16:58:12.416366] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T16:58:12.421824] [INFO ] [REMOTE ] B: Full fetch complete (33850 records). [2025-09-14T16:58:12.421934] [DEBUG] [VALIDATOR ] B: Validating primary data. [2025-09-14T16:58:12.564045] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-09-14T16:58:12.611215] [WARN ] [VALIDATOR ] B: Validation failed - insufficient historical data. Have 87 unique days, need 150 days [2025-09-14T16:58:12.611723] [FATAL] [MAIN ] B: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:58:12.611794] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:58:12.612023] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-14T16:58:12.612307] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-14T16:58:12.612477] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-14T16:58:12.612587] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-14T16:58:12.612849] [INFO ] [MAIN ] Update Progress: 205/2370 symbols completed. B took 21.0s. Estimated remaining: 3h 41m 57s. Rate: 9.8 symbols/min [2025-09-14T16:58:12.788569] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:58:12.823329] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-09-14T16:58:12.850977] [DEBUG] [LOCAL ] BAH: Loaded 23012 existing records from primary storage. [2025-09-14T16:58:12.851139] [INFO ] [MAIN ] BAH: Loaded 23012 existing records. [2025-09-14T16:58:13.030701] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:58:13.031015] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-09-14T16:58:13.031077] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-14T16:58:13.031729] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-09-14T16:58:13.031793] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-09-14T16:58:13.365396] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-09-14T16:58:13.395350] [INFO ] [REMOTE ] BAH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:58:13.834582] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.88 seconds). [2025-09-14T16:58:14.158857] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-09-14T16:58:14.958876] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-09-14T16:58:15.232955] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-14T16:58:15.609999] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T16:58:15.758825] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-09-14T16:58:16.182217] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-09-14T16:58:16.558833] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-09-14T16:58:17.358830] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-09-14T16:58:17.668003] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T16:58:17.780760] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-09-14T16:58:18.158827] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-09-14T16:58:18.958871] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-09-14T16:58:19.072009] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-14T16:58:19.279723] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-14T16:58:19.711734] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T16:58:19.758777] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-09-14T16:58:20.558910] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-09-14T16:58:21.358875] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-09-14T16:58:21.474456] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-09-14T16:58:21.888617] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-14T16:58:22.158853] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-09-14T16:58:22.935301] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-14T16:58:22.958775] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-09-14T16:58:23.758887] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-09-14T16:58:24.359142] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (3.00 seconds). [2025-09-14T16:58:24.558881] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-09-14T16:58:25.277061] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-14T16:58:25.358814] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-09-14T16:58:25.461088] [DEBUG] [REMOTE ] BA: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-14T16:58:25.461448] [WARN ] [REMOTE ] BA: No data returned for month 2025-08 [2025-09-14T16:58:25.495464] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T16:58:25.598285] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (3.44 seconds). [2025-09-14T16:58:26.158836] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-09-14T16:58:26.958830] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-09-14T16:58:27.136784] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-14T16:58:27.758901] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-09-14T16:58:28.007870] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-14T16:58:28.558932] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-09-14T16:58:29.219023] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T16:58:29.224572] [INFO ] [REMOTE ] BA: Full fetch complete (50281 records). [2025-09-14T16:58:29.224716] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-09-14T16:58:29.378345] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-09-14T16:58:29.424057] [WARN ] [VALIDATOR ] BA: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-14T16:58:29.425242] [FATAL] [MAIN ] BA: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:58:29.425369] [WARN ] [MAIN ] BA: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:58:29.425535] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-09-14T16:58:29.425762] [DEBUG] [LOCAL ] BA: No primary data file found to delete. [2025-09-14T16:58:29.425878] [INFO ] [LOCAL ] BA: Starting deletion of derivative data. [2025-09-14T16:58:29.425996] [DEBUG] [LOCAL ] BA: No derivative data file found to delete. [2025-09-14T16:58:29.426278] [INFO ] [MAIN ] Update Progress: 206/2370 symbols completed. BA took 28.6s. Estimated remaining: 3h 43m 42s. Rate: 9.7 symbols/min [2025-09-14T16:58:29.624322] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:58:29.657121] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-14T16:58:29.680109] [DEBUG] [LOCAL ] BAK: Loaded 17696 existing records from primary storage. [2025-09-14T16:58:29.680274] [INFO ] [MAIN ] BAK: Loaded 17696 existing records. [2025-09-14T16:58:29.859982] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:58:29.860256] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-09-14T16:58:29.860320] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-14T16:58:29.860875] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-09-14T16:58:29.860939] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-09-14T16:58:30.167180] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-09-14T16:58:30.218533] [INFO ] [REMOTE ] BAK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:58:30.283949] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-14T16:58:30.787624] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-14T16:58:30.958884] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-09-14T16:58:31.758885] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-09-14T16:58:32.002299] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-14T16:58:32.396274] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T16:58:32.401819] [INFO ] [REMOTE ] BAC: Full fetch complete (58488 records). [2025-09-14T16:58:32.401959] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-09-14T16:58:32.574401] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-09-14T16:58:32.788242] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-09-14T16:58:32.788452] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-09-14T16:58:32.789226] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-09-14T16:58:32.789324] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-09-14T16:58:32.790931] [DEBUG] [LOCAL ] BAC: Trimmed 58488 records to 40548 (keeping 150 days of data) [2025-09-14T16:58:32.918076] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-09-14T16:58:33.093734] [DEBUG] [LOCAL ] BAC: Primary data saved (40548 records). [2025-09-14T16:58:33.093904] [INFO ] [MAIN ] BAC: Full history saved. [2025-09-14T16:58:33.094053] [INFO ] [MAIN ] Update Progress: 207/2370 symbols completed. BAC took 26.8s. Estimated remaining: 3h 43m 10s. Rate: 9.7 symbols/min [2025-09-14T16:58:33.271359] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:58:33.293961] [DEBUG] [LOCAL ] BALL: Loaded 22987 existing records from primary storage. [2025-09-14T16:58:33.294148] [INFO ] [MAIN ] BALL: Loaded 22987 existing records. [2025-09-14T16:58:33.363911] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-09-14T16:58:33.509791] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:58:33.510084] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-09-14T16:58:33.510148] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-09-14T16:58:33.510938] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-09-14T16:58:33.511018] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-09-14T16:58:33.863217] [INFO ] [REMOTE ] BALL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:58:34.066879] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-14T16:58:34.158818] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-09-14T16:58:34.958832] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-09-14T16:58:35.162324] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-14T16:58:35.167909] [INFO ] [REMOTE ] BAH: Full fetch complete (56406 records). [2025-09-14T16:58:35.168053] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-09-14T16:58:35.555188] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-09-14T16:58:35.555315] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-09-14T16:58:35.556005] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-09-14T16:58:35.556084] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-09-14T16:58:35.557595] [DEBUG] [LOCAL ] BAH: Trimmed 56406 records to 38796 (keeping 150 days of data) [2025-09-14T16:58:35.765358] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-09-14T16:58:35.837122] [DEBUG] [LOCAL ] BAH: Primary data saved (38796 records). [2025-09-14T16:58:35.837307] [INFO ] [MAIN ] BAH: Full history saved. [2025-09-14T16:58:35.837483] [INFO ] [MAIN ] Update Progress: 208/2370 symbols completed. BAH took 23.2s. Estimated remaining: 3h 42m 28s. Rate: 9.7 symbols/min [2025-09-14T16:58:36.012942] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:58:36.019344] [DEBUG] [LOCAL ] BALY: Loaded 3829 existing records from primary storage. [2025-09-14T16:58:36.019448] [INFO ] [MAIN ] BALY: Loaded 3829 existing records. [2025-09-14T16:58:36.195591] [WARN ] [MAIN ] BALY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:58:36.195900] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-14T16:58:36.195966] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-14T16:58:36.196241] [DEBUG] [LOCAL ] BALY: Deleted primary data file. [2025-09-14T16:58:36.196310] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-14T16:58:36.563740] [INFO ] [REMOTE ] BALY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:58:36.564599] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-14T16:58:36.591458] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T16:58:36.630064] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-09-14T16:58:37.276202] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-14T16:58:37.358793] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-14T16:58:38.014253] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-14T16:58:38.158845] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-09-14T16:58:38.179481] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-14T16:58:38.188352] [INFO ] [REMOTE ] BABA: Full fetch complete (58500 records). [2025-09-14T16:58:38.188529] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-09-14T16:58:38.568773] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-09-14T16:58:38.568904] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-09-14T16:58:38.569549] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-09-14T16:58:38.569609] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-09-14T16:58:38.571296] [DEBUG] [LOCAL ] BABA: Trimmed 58500 records to 40560 (keeping 150 days of data) [2025-09-14T16:58:38.844610] [DEBUG] [LOCAL ] BABA: Primary data saved (40560 records). [2025-09-14T16:58:38.844884] [INFO ] [MAIN ] BABA: Full history saved. [2025-09-14T16:58:38.845076] [INFO ] [MAIN ] Update Progress: 209/2370 symbols completed. BABA took 33.8s. Estimated remaining: 3h 41m 49s. Rate: 9.7 symbols/min [2025-09-14T16:58:38.964003] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-14T16:58:39.016834] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:58:39.040799] [DEBUG] [LOCAL ] BAM: Loaded 23159 existing records from primary storage. [2025-09-14T16:58:39.040958] [INFO ] [MAIN ] BAM: Loaded 23159 existing records. [2025-09-14T16:58:39.216598] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:58:39.216898] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-09-14T16:58:39.216971] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-14T16:58:39.217608] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-09-14T16:58:39.217696] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-09-14T16:58:39.580064] [INFO ] [REMOTE ] BAM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:58:39.759144] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-09-14T16:58:39.759415] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-14T16:58:39.932194] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T16:58:40.558878] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-09-14T16:58:40.928816] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-14T16:58:41.358850] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-14T16:58:42.158887] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-09-14T16:58:42.455996] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-14T16:58:42.473673] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-14T16:58:42.958882] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-09-14T16:58:43.342868] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-14T16:58:43.758873] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-14T16:58:44.558908] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-09-14T16:58:44.681966] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-14T16:58:44.867138] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T16:58:45.358912] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-09-14T16:58:46.158855] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-09-14T16:58:46.251575] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T16:58:46.958880] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-09-14T16:58:47.189729] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-14T16:58:47.627333] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-14T16:58:47.758824] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-09-14T16:58:48.025718] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-14T16:58:48.558871] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-14T16:58:49.358818] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-09-14T16:58:49.419403] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-14T16:58:49.546694] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T16:58:50.158863] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-14T16:58:50.852509] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-14T16:58:50.958845] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-09-14T16:58:51.102316] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T16:58:51.758882] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-09-14T16:58:52.038045] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-14T16:58:52.042279] [INFO ] [REMOTE ] BAK: Full fetch complete (42270 records). [2025-09-14T16:58:52.042458] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-09-14T16:58:52.446043] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-09-14T16:58:52.446187] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-09-14T16:58:52.447060] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-09-14T16:58:52.447143] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-09-14T16:58:52.448510] [DEBUG] [LOCAL ] BAK: Trimmed 42270 records to 29310 (keeping 150 days of data) [2025-09-14T16:58:52.559630] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-09-14T16:58:52.655164] [DEBUG] [LOCAL ] BAK: Primary data saved (29310 records). [2025-09-14T16:58:52.655417] [INFO ] [MAIN ] BAK: Full history saved. [2025-09-14T16:58:52.655564] [INFO ] [MAIN ] Update Progress: 210/2370 symbols completed. BAK took 23.2s. Estimated remaining: 3h 43m 1s. Rate: 9.7 symbols/min [2025-09-14T16:58:52.837116] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:58:52.863986] [DEBUG] [LOCAL ] BANC: Loaded 22950 existing records from primary storage. [2025-09-14T16:58:52.864265] [INFO ] [MAIN ] BANC: Loaded 22950 existing records. [2025-09-14T16:58:53.049911] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:58:53.050244] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-09-14T16:58:53.050306] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-09-14T16:58:53.050987] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-09-14T16:58:53.051055] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-09-14T16:58:53.364439] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-14T16:58:53.422516] [INFO ] [REMOTE ] BANC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:58:53.585321] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T16:58:54.027854] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-14T16:58:54.064819] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T16:58:54.066077] [INFO ] [REMOTE ] BALY: Full fetch complete (9022 records). [2025-09-14T16:58:54.066163] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-14T16:58:54.163915] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-09-14T16:58:54.256311] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-14T16:58:54.256687] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-09-14T16:58:54.256766] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-09-14T16:58:54.256822] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-14T16:58:54.256901] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-14T16:58:54.256952] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-09-14T16:58:54.257025] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-09-14T16:58:54.257137] [INFO ] [MAIN ] Update Progress: 211/2370 symbols completed. BALY took 18.4s. Estimated remaining: 3h 42m 8s. Rate: 9.7 symbols/min [2025-09-14T16:58:54.433729] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:58:54.449984] [DEBUG] [LOCAL ] BAP: Loaded 11635 existing records from primary storage. [2025-09-14T16:58:54.450189] [INFO ] [MAIN ] BAP: Loaded 11635 existing records. [2025-09-14T16:58:54.633237] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:58:54.647879] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-09-14T16:58:54.648058] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-09-14T16:58:54.649326] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-14T16:58:54.654398] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-09-14T16:58:54.654968] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-09-14T16:58:54.660575] [INFO ] [REMOTE ] BALL: Full fetch complete (56487 records). [2025-09-14T16:58:54.724216] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-09-14T16:58:54.961017] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-09-14T16:58:55.432794] [INFO ] [REMOTE ] BAP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:58:55.453529] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-09-14T16:58:55.453684] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-09-14T16:58:55.454586] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-09-14T16:58:55.454704] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-09-14T16:58:55.456582] [DEBUG] [LOCAL ] BALL: Trimmed 56487 records to 38898 (keeping 150 days of data) [2025-09-14T16:58:55.700083] [DEBUG] [LOCAL ] BALL: Primary data saved (38898 records). [2025-09-14T16:58:55.700269] [INFO ] [MAIN ] BALL: Full history saved. [2025-09-14T16:58:55.700396] [INFO ] [MAIN ] Update Progress: 212/2370 symbols completed. BALL took 22.6s. Estimated remaining: 3h 41m 14s. Rate: 9.8 symbols/min [2025-09-14T16:58:55.763990] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-09-14T16:58:55.874168] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:58:55.892309] [DEBUG] [LOCAL ] BARK: Loaded 17022 existing records from primary storage. [2025-09-14T16:58:55.892478] [INFO ] [MAIN ] BARK: Loaded 17022 existing records. [2025-09-14T16:58:56.066543] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:58:56.066870] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-09-14T16:58:56.066933] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-14T16:58:56.067474] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-09-14T16:58:56.067538] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-09-14T16:58:56.442331] [INFO ] [REMOTE ] BARK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:58:56.558886] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-09-14T16:58:56.972517] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-14T16:58:57.358854] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-09-14T16:58:57.447461] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T16:58:57.499880] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T16:58:58.158859] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-09-14T16:58:58.532074] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-14T16:58:58.958854] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-09-14T16:58:59.349251] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-14T16:58:59.758824] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-09-14T16:59:00.558861] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-09-14T16:59:00.933242] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-14T16:59:01.358887] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-09-14T16:59:01.411744] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-14T16:59:02.156704] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-14T16:59:02.164197] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-09-14T16:59:02.794749] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T16:59:02.958839] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-09-14T16:59:03.358389] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T16:59:03.758826] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-09-14T16:59:04.558909] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-09-14T16:59:04.646150] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-14T16:59:04.651867] [INFO ] [REMOTE ] BAM: Full fetch complete (56527 records). [2025-09-14T16:59:04.652070] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-09-14T16:59:05.051535] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-09-14T16:59:05.057280] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-09-14T16:59:05.067622] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-09-14T16:59:05.068911] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-14T16:59:05.068981] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-09-14T16:59:05.076486] [DEBUG] [LOCAL ] BAM: Trimmed 56527 records to 38990 (keeping 150 days of data) [2025-09-14T16:59:05.320814] [DEBUG] [LOCAL ] BAM: Primary data saved (38990 records). [2025-09-14T16:59:05.321008] [INFO ] [MAIN ] BAM: Full history saved. [2025-09-14T16:59:05.321114] [INFO ] [MAIN ] Update Progress: 213/2370 symbols completed. BAM took 26.5s. Estimated remaining: 3h 41m 43s. Rate: 9.7 symbols/min [2025-09-14T16:59:05.364514] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-09-14T16:59:05.501371] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:59:05.529402] [DEBUG] [LOCAL ] BAX: Loaded 23984 existing records from primary storage. [2025-09-14T16:59:05.529628] [INFO ] [MAIN ] BAX: Loaded 23984 existing records. [2025-09-14T16:59:05.713228] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:59:05.713503] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-09-14T16:59:05.713564] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-14T16:59:05.714239] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-09-14T16:59:05.714304] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-09-14T16:59:06.066563] [INFO ] [REMOTE ] BAX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:59:06.108739] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T16:59:06.158827] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-09-14T16:59:06.327018] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-14T16:59:06.958881] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-09-14T16:59:07.758895] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-09-14T16:59:07.957623] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-14T16:59:08.514902] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-14T16:59:08.558779] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-09-14T16:59:09.358822] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-09-14T16:59:09.559959] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T16:59:09.951519] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T16:59:10.158875] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-09-14T16:59:10.958863] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-09-14T16:59:11.267816] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T16:59:11.758881] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-09-14T16:59:11.920061] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-14T16:59:12.167794] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T16:59:12.558849] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-09-14T16:59:13.358819] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-09-14T16:59:13.583501] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T16:59:13.647516] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T16:59:14.158882] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-09-14T16:59:14.958804] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-09-14T16:59:15.348114] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-14T16:59:15.368192] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-14T16:59:15.371986] [INFO ] [REMOTE ] BAP: Full fetch complete (28661 records). [2025-09-14T16:59:15.372130] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-09-14T16:59:15.740910] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-09-14T16:59:15.741012] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-09-14T16:59:15.741380] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-09-14T16:59:15.741433] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-09-14T16:59:15.742148] [DEBUG] [LOCAL ] BAP: Trimmed 28661 records to 19263 (keeping 150 days of data) [2025-09-14T16:59:15.796395] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-09-14T16:59:15.863200] [DEBUG] [LOCAL ] BAP: Primary data saved (19263 records). [2025-09-14T16:59:15.863350] [INFO ] [MAIN ] BAP: Full history saved. [2025-09-14T16:59:15.863459] [INFO ] [MAIN ] Update Progress: 214/2370 symbols completed. BAP took 21.6s. Estimated remaining: 3h 42m 21s. Rate: 9.7 symbols/min [2025-09-14T16:59:16.030531] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:59:16.056364] [DEBUG] [LOCAL ] BB: Loaded 23724 existing records from primary storage. [2025-09-14T16:59:16.056584] [INFO ] [MAIN ] BB: Loaded 23724 existing records. [2025-09-14T16:59:16.266394] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:59:16.266715] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-09-14T16:59:16.266798] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-14T16:59:16.267557] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-09-14T16:59:16.267623] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-09-14T16:59:16.564069] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-09-14T16:59:16.619615] [INFO ] [REMOTE ] BB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:59:16.723183] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T16:59:17.184008] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T16:59:17.358811] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-09-14T16:59:18.158884] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-09-14T16:59:18.495964] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-14T16:59:18.958866] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-09-14T16:59:19.019566] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-14T16:59:19.257070] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-14T16:59:19.758884] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-09-14T16:59:20.558940] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-09-14T16:59:21.198561] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-14T16:59:21.358860] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-09-14T16:59:21.555318] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-14T16:59:22.036455] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T16:59:22.158848] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-09-14T16:59:22.958900] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-09-14T16:59:23.428877] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-14T16:59:23.598665] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T16:59:23.605691] [INFO ] [REMOTE ] BANC: Full fetch complete (55601 records). [2025-09-14T16:59:23.605983] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-09-14T16:59:23.764711] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-09-14T16:59:24.230720] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-09-14T16:59:24.259394] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-09-14T16:59:24.261569] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-09-14T16:59:24.267859] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-09-14T16:59:24.267691] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-14T16:59:24.289428] [DEBUG] [LOCAL ] BANC: Trimmed 55601 records to 38316 (keeping 150 days of data) [2025-09-14T16:59:24.559608] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-09-14T16:59:24.606567] [DEBUG] [LOCAL ] BANC: Primary data saved (38316 records). [2025-09-14T16:59:24.607111] [INFO ] [MAIN ] BANC: Full history saved. [2025-09-14T16:59:24.607328] [INFO ] [MAIN ] Update Progress: 215/2370 symbols completed. BANC took 32.0s. Estimated remaining: 3h 42m 40s. Rate: 9.7 symbols/min [2025-09-14T16:59:24.833658] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:59:24.860577] [DEBUG] [LOCAL ] BBAI: Loaded 24180 existing records from primary storage. [2025-09-14T16:59:24.860840] [INFO ] [MAIN ] BBAI: Loaded 24180 existing records. [2025-09-14T16:59:25.040058] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:59:25.040361] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-09-14T16:59:25.040428] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-09-14T16:59:25.041217] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-09-14T16:59:25.041289] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-09-14T16:59:25.366893] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-09-14T16:59:25.395792] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:59:25.788708] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-14T16:59:25.792808] [INFO ] [REMOTE ] BARK: Full fetch complete (42174 records). [2025-09-14T16:59:25.792960] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-09-14T16:59:26.160578] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-09-14T16:59:26.195748] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-09-14T16:59:26.195938] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-09-14T16:59:26.196751] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-09-14T16:59:26.196871] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-09-14T16:59:26.211860] [DEBUG] [LOCAL ] BARK: Trimmed 42174 records to 28961 (keeping 150 days of data) [2025-09-14T16:59:26.241694] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-14T16:59:26.434085] [DEBUG] [LOCAL ] BARK: Primary data saved (28961 records). [2025-09-14T16:59:26.434320] [INFO ] [MAIN ] BARK: Full history saved. [2025-09-14T16:59:26.434497] [INFO ] [MAIN ] Update Progress: 216/2370 symbols completed. BARK took 30.7s. Estimated remaining: 3h 41m 50s. Rate: 9.7 symbols/min [2025-09-14T16:59:26.619688] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:59:26.641967] [DEBUG] [LOCAL ] BBAR: Loaded 18473 existing records from primary storage. [2025-09-14T16:59:26.642223] [INFO ] [MAIN ] BBAR: Loaded 18473 existing records. [2025-09-14T16:59:26.833411] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:59:26.833746] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-09-14T16:59:26.833811] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-09-14T16:59:26.834458] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-09-14T16:59:26.834523] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-09-14T16:59:26.963889] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-09-14T16:59:27.214154] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:59:27.254482] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T16:59:27.758885] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-09-14T16:59:28.338129] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-14T16:59:28.390386] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T16:59:28.396530] [INFO ] [REMOTE ] BAX: Full fetch complete (58155 records). [2025-09-14T16:59:28.396751] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-09-14T16:59:28.563956] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-09-14T16:59:28.828436] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-09-14T16:59:28.828606] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-09-14T16:59:28.829548] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-09-14T16:59:28.829634] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-09-14T16:59:28.831534] [DEBUG] [LOCAL ] BAX: Trimmed 58155 records to 40292 (keeping 150 days of data) [2025-09-14T16:59:29.153682] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-14T16:59:29.206311] [DEBUG] [LOCAL ] BAX: Primary data saved (40292 records). [2025-09-14T16:59:29.206495] [INFO ] [MAIN ] BAX: Full history saved. [2025-09-14T16:59:29.206601] [INFO ] [MAIN ] Update Progress: 217/2370 symbols completed. BAX took 23.9s. Estimated remaining: 3h 41m 10s. Rate: 9.7 symbols/min [2025-09-14T16:59:29.361092] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-09-14T16:59:29.385411] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:59:29.410679] [DEBUG] [LOCAL ] BBD: Loaded 23923 existing records from primary storage. [2025-09-14T16:59:29.410867] [INFO ] [MAIN ] BBD: Loaded 23923 existing records. [2025-09-14T16:59:29.586555] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:59:29.586878] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-09-14T16:59:29.586945] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-09-14T16:59:29.587754] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-09-14T16:59:29.587820] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-09-14T16:59:29.936155] [INFO ] [REMOTE ] BBD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:59:30.158846] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-09-14T16:59:30.271128] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T16:59:30.958824] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-09-14T16:59:31.758889] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-09-14T16:59:31.816804] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-14T16:59:31.857373] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-14T16:59:32.558794] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-09-14T16:59:32.619854] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-14T16:59:33.080080] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-14T16:59:33.358815] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-09-14T16:59:34.158840] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-09-14T16:59:34.958899] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-09-14T16:59:35.044594] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-14T16:59:35.290766] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-09-14T16:59:35.758797] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-09-14T16:59:35.933377] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T16:59:36.113809] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-14T16:59:36.558889] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-09-14T16:59:37.358813] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-09-14T16:59:38.158819] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-09-14T16:59:38.191467] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-09-14T16:59:38.260628] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T16:59:38.972994] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-09-14T16:59:39.007059] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-14T16:59:39.758846] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-09-14T16:59:39.851502] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T16:59:40.137150] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-14T16:59:40.558852] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-09-14T16:59:41.358820] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-09-14T16:59:41.649761] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-14T16:59:42.158821] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-09-14T16:59:42.568089] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.81 seconds). [2025-09-14T16:59:42.731340] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-14T16:59:42.958863] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-09-14T16:59:43.579851] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-14T16:59:43.585365] [INFO ] [REMOTE ] BB: Full fetch complete (57617 records). [2025-09-14T16:59:43.585518] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-09-14T16:59:43.760721] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-09-14T16:59:43.973003] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-09-14T16:59:43.973127] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-09-14T16:59:43.973896] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-09-14T16:59:43.973960] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-09-14T16:59:43.975232] [DEBUG] [LOCAL ] BB: Trimmed 57617 records to 39734 (keeping 150 days of data) [2025-09-14T16:59:44.212924] [DEBUG] [LOCAL ] BB: Primary data saved (39734 records). [2025-09-14T16:59:44.213112] [INFO ] [MAIN ] BB: Full history saved. [2025-09-14T16:59:44.213220] [INFO ] [MAIN ] Update Progress: 218/2370 symbols completed. BB took 28.3s. Estimated remaining: 3h 42m 32s. Rate: 9.7 symbols/min [2025-09-14T16:59:44.382688] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:59:44.398562] [DEBUG] [LOCAL ] BBDC: Loaded 13500 existing records from primary storage. [2025-09-14T16:59:44.398758] [INFO ] [MAIN ] BBDC: Loaded 13500 existing records. [2025-09-14T16:59:44.562241] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-09-14T16:59:44.582226] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:59:44.584135] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-09-14T16:59:44.584217] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-14T16:59:44.584702] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-09-14T16:59:44.584772] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-09-14T16:59:44.951826] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:59:44.978714] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-14T16:59:45.358852] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-09-14T16:59:45.479893] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T16:59:46.158875] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-09-14T16:59:46.249187] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T16:59:46.958852] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-09-14T16:59:47.712603] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (3.15 seconds). [2025-09-14T16:59:47.739082] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-14T16:59:47.744283] [INFO ] [REMOTE ] BBAR: Full fetch complete (44690 records). [2025-09-14T16:59:47.744464] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-09-14T16:59:47.766283] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-09-14T16:59:48.125588] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-09-14T16:59:48.125742] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-09-14T16:59:48.126354] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-09-14T16:59:48.126417] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-09-14T16:59:48.127633] [DEBUG] [LOCAL ] BBAR: Trimmed 44690 records to 31093 (keeping 150 days of data) [2025-09-14T16:59:48.326518] [DEBUG] [LOCAL ] BBAR: Primary data saved (31093 records). [2025-09-14T16:59:48.326815] [INFO ] [MAIN ] BBAR: Full history saved. [2025-09-14T16:59:48.326969] [INFO ] [MAIN ] Update Progress: 219/2370 symbols completed. BBAR took 21.9s. Estimated remaining: 3h 42m 5s. Rate: 9.7 symbols/min [2025-09-14T16:59:48.499857] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:59:48.503420] [DEBUG] [LOCAL ] BBDO: Loaded 1647 existing records from primary storage. [2025-09-14T16:59:48.503554] [INFO ] [MAIN ] BBDO: Loaded 1647 existing records. [2025-09-14T16:59:48.566314] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-09-14T16:59:48.687720] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:59:48.688135] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-09-14T16:59:48.688236] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-09-14T16:59:48.688536] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-09-14T16:59:48.688634] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-09-14T16:59:48.820172] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T16:59:49.088329] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:59:49.358831] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-09-14T16:59:49.684100] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-14T16:59:50.158903] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-09-14T16:59:50.936989] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T16:59:50.958789] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-09-14T16:59:51.353593] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-09-14T16:59:51.404496] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T16:59:51.758851] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-09-14T16:59:52.018215] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-14T16:59:52.440414] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-14T16:59:52.558825] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-09-14T16:59:52.996930] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-14T16:59:53.358829] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-09-14T16:59:54.158850] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-09-14T16:59:54.871783] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T16:59:54.958860] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-09-14T16:59:55.745544] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-14T16:59:55.758792] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-09-14T16:59:56.019101] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-14T16:59:56.024633] [INFO ] [REMOTE ] BBAI: Full fetch complete (58500 records). [2025-09-14T16:59:56.024775] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-09-14T16:59:56.409320] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-09-14T16:59:56.409452] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-09-14T16:59:56.410190] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-09-14T16:59:56.410253] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-09-14T16:59:56.411542] [DEBUG] [LOCAL ] BBAI: Trimmed 58500 records to 40560 (keeping 150 days of data) [2025-09-14T16:59:56.579590] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-09-14T16:59:56.655698] [DEBUG] [LOCAL ] BBAI: Primary data saved (40560 records). [2025-09-14T16:59:56.655866] [INFO ] [MAIN ] BBAI: Full history saved. [2025-09-14T16:59:56.655970] [INFO ] [MAIN ] Update Progress: 220/2370 symbols completed. BBAI took 32.0s. Estimated remaining: 3h 42m 19s. Rate: 9.7 symbols/min [2025-09-14T16:59:56.830326] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:59:56.841187] [DEBUG] [LOCAL ] BBN: Loaded 8529 existing records from primary storage. [2025-09-14T16:59:56.841367] [INFO ] [MAIN ] BBN: Loaded 8529 existing records. [2025-09-14T16:59:57.026832] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:59:57.027991] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-09-14T16:59:57.028052] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-09-14T16:59:57.028475] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-09-14T16:59:57.028536] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-09-14T16:59:57.322733] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-14T16:59:57.363431] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-09-14T16:59:57.397608] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-14T16:59:57.416916] [INFO ] [REMOTE ] BBN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:59:57.423491] [INFO ] [REMOTE ] BBD: Full fetch complete (57836 records). [2025-09-14T16:59:57.423699] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-09-14T16:59:57.799820] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-09-14T16:59:57.799931] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-09-14T16:59:57.800686] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-09-14T16:59:57.800755] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-09-14T16:59:57.801948] [DEBUG] [LOCAL ] BBD: Trimmed 57836 records to 40069 (keeping 150 days of data) [2025-09-14T16:59:57.907486] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-14T16:59:58.072800] [DEBUG] [LOCAL ] BBD: Primary data saved (40069 records). [2025-09-14T16:59:58.073029] [INFO ] [MAIN ] BBD: Full history saved. [2025-09-14T16:59:58.073169] [INFO ] [MAIN ] Update Progress: 221/2370 symbols completed. BBD took 28.9s. Estimated remaining: 3h 41m 27s. Rate: 9.7 symbols/min [2025-09-14T16:59:58.164016] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-09-14T16:59:58.252558] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T16:59:58.257864] [DEBUG] [LOCAL ] BBT: Loaded 2749 existing records from primary storage. [2025-09-14T16:59:58.258037] [INFO ] [MAIN ] BBT: Loaded 2749 existing records. [2025-09-14T16:59:58.441041] [WARN ] [MAIN ] BBT: Insufficient historical data. Have data from 2025-09-02, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T16:59:58.441354] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-14T16:59:58.441460] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-14T16:59:58.441829] [DEBUG] [LOCAL ] BBT: Deleted primary data file. [2025-09-14T16:59:58.441895] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-14T16:59:58.734892] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-14T16:59:58.816076] [INFO ] [REMOTE ] BBT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T16:59:58.958882] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-02. [2025-09-14T16:59:59.208123] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T16:59:59.208615] [WARN ] [REMOTE ] BBT: No data returned for month 2025-02 [2025-09-14T16:59:59.758885] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-09-14T17:00:00.558825] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-09-14T17:00:00.720938] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-14T17:00:01.358867] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-09-14T17:00:02.043466] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-14T17:00:02.071068] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-14T17:00:02.158943] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-03. [2025-09-14T17:00:02.958951] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-09-14T17:00:03.759000] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-09-14T17:00:04.027534] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:00:04.028278] [WARN ] [REMOTE ] BBT: No data returned for month 2025-03 [2025-09-14T17:00:04.558940] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-04. [2025-09-14T17:00:05.358956] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-09-14T17:00:05.498113] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:00:05.498491] [WARN ] [REMOTE ] BBT: No data returned for month 2025-04 [2025-09-14T17:00:06.009788] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T17:00:06.011265] [INFO ] [REMOTE ] BBDO: Full fetch complete (5516 records). [2025-09-14T17:00:06.011542] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-09-14T17:00:06.125600] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-14T17:00:06.167036] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-05. [2025-09-14T17:00:06.435836] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (3.48 seconds). [2025-09-14T17:00:06.458672] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-09-14T17:00:06.469495] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-09-14T17:00:06.470189] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-09-14T17:00:06.470324] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-09-14T17:00:06.472091] [DEBUG] [LOCAL ] BBDO: Trimmed 5516 records to 3603 (keeping 150 days of data) [2025-09-14T17:00:06.495238] [DEBUG] [LOCAL ] BBDO: Primary data saved (3603 records). [2025-09-14T17:00:06.495461] [INFO ] [MAIN ] BBDO: Full history saved. [2025-09-14T17:00:06.495594] [INFO ] [MAIN ] Update Progress: 222/2370 symbols completed. BBDO took 18.2s. Estimated remaining: 3h 41m 42s. Rate: 9.7 symbols/min [2025-09-14T17:00:06.573047] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:00:06.602045] [WARN ] [REMOTE ] BBT: No data returned for month 2025-05 [2025-09-14T17:00:06.683866] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:00:06.688562] [DEBUG] [LOCAL ] BBU: Loaded 2518 existing records from primary storage. [2025-09-14T17:00:06.688702] [INFO ] [MAIN ] BBU: Loaded 2518 existing records. [2025-09-14T17:00:06.868766] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:00:06.869067] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-09-14T17:00:06.869142] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-14T17:00:06.869439] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-09-14T17:00:06.869501] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-09-14T17:00:06.963993] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-06. [2025-09-14T17:00:07.242720] [INFO ] [REMOTE ] BBU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:00:07.325549] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:00:07.325914] [WARN ] [REMOTE ] BBT: No data returned for month 2025-06 [2025-09-14T17:00:07.758875] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-07. [2025-09-14T17:00:08.053289] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:00:08.053636] [WARN ] [REMOTE ] BBT: No data returned for month 2025-07 [2025-09-14T17:00:08.558838] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-09-14T17:00:09.358870] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-08. [2025-09-14T17:00:09.608859] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:00:09.609214] [WARN ] [REMOTE ] BBT: No data returned for month 2025-08 [2025-09-14T17:00:09.775350] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-14T17:00:10.158853] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-09-14T17:00:10.958852] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-09. [2025-09-14T17:00:11.005724] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-14T17:00:11.009745] [INFO ] [REMOTE ] BBDC: Full fetch complete (36816 records). [2025-09-14T17:00:11.009865] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-09-14T17:00:11.413586] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-09-14T17:00:11.413732] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-09-14T17:00:11.414206] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-09-14T17:00:11.414260] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-09-14T17:00:11.415310] [DEBUG] [LOCAL ] BBDC: Trimmed 36816 records to 23732 (keeping 150 days of data) [2025-09-14T17:00:11.559362] [DEBUG] [LOCAL ] BBDC: Primary data saved (23732 records). [2025-09-14T17:00:11.559527] [INFO ] [MAIN ] BBDC: Full history saved. [2025-09-14T17:00:11.559623] [INFO ] [MAIN ] Update Progress: 223/2370 symbols completed. BBDC took 27.3s. Estimated remaining: 3h 41m 25s. Rate: 9.7 symbols/min [2025-09-14T17:00:11.733204] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:00:11.739750] [DEBUG] [LOCAL ] BBUC: Loaded 5443 existing records from primary storage. [2025-09-14T17:00:11.739865] [INFO ] [MAIN ] BBUC: Loaded 5443 existing records. [2025-09-14T17:00:11.769867] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-09-14T17:00:11.925098] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:00:11.925374] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-09-14T17:00:11.925437] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-14T17:00:11.925757] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-09-14T17:00:11.925818] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-09-14T17:00:12.213200] [INFO ] [REMOTE ] BBT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-14T17:00:12.243345] [INFO ] [REMOTE ] BBT: Full fetch complete (2749 records). [2025-09-14T17:00:12.290662] [DEBUG] [VALIDATOR ] BBT: Validating primary data. [2025-09-14T17:00:12.295001] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:00:12.479540] [WARN ] [VALIDATOR ] BBT: Validation failed - insufficient historical data. Have 9 unique days, need 150 days [2025-09-14T17:00:12.479806] [FATAL] [MAIN ] BBT: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:00:12.479865] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:00:12.479909] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-14T17:00:12.479986] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-14T17:00:12.480043] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-14T17:00:12.480101] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-14T17:00:12.480187] [INFO ] [MAIN ] Update Progress: 224/2370 symbols completed. BBT took 14.4s. Estimated remaining: 3h 40m 28s. Rate: 9.7 symbols/min [2025-09-14T17:00:12.563935] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-09-14T17:00:12.655755] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:00:12.678756] [DEBUG] [LOCAL ] BBVA: Loaded 21936 existing records from primary storage. [2025-09-14T17:00:12.678927] [INFO ] [MAIN ] BBVA: Loaded 21936 existing records. [2025-09-14T17:00:12.856851] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:00:12.857136] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-09-14T17:00:12.857197] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-09-14T17:00:12.857769] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-09-14T17:00:12.857830] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-09-14T17:00:13.221294] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:00:13.255979] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-14T17:00:13.358833] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-09-14T17:00:14.054708] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T17:00:14.158848] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-09-14T17:00:14.602183] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-14T17:00:14.958881] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-09-14T17:00:14.997388] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T17:00:15.758868] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-09-14T17:00:16.568825] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-09-14T17:00:16.616982] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T17:00:16.934415] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-14T17:00:17.195615] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-14T17:00:17.358891] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-09-14T17:00:17.851535] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-14T17:00:18.158922] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-09-14T17:00:18.958864] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-09-14T17:00:19.279022] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T17:00:19.486999] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-14T17:00:19.758861] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-09-14T17:00:20.232083] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-14T17:00:20.558809] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-09-14T17:00:21.358820] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-09-14T17:00:21.584713] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-14T17:00:21.587301] [INFO ] [REMOTE ] BBN: Full fetch complete (19424 records). [2025-09-14T17:00:21.587422] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-09-14T17:00:21.976273] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-09-14T17:00:21.976383] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-09-14T17:00:21.976802] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-09-14T17:00:21.976878] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-09-14T17:00:21.977981] [DEBUG] [LOCAL ] BBN: Trimmed 19424 records to 13604 (keeping 150 days of data) [2025-09-14T17:00:22.067149] [DEBUG] [LOCAL ] BBN: Primary data saved (13604 records). [2025-09-14T17:00:22.067338] [INFO ] [MAIN ] BBN: Full history saved. [2025-09-14T17:00:22.067464] [INFO ] [MAIN ] Update Progress: 225/2370 symbols completed. BBN took 25.4s. Estimated remaining: 3h 40m 55s. Rate: 9.7 symbols/min [2025-09-14T17:00:22.169149] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-09-14T17:00:22.247829] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:00:22.263870] [DEBUG] [LOCAL ] BBW: Loaded 11155 existing records from primary storage. [2025-09-14T17:00:22.264090] [INFO ] [MAIN ] BBW: Loaded 11155 existing records. [2025-09-14T17:00:22.459544] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:00:22.470330] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-09-14T17:00:22.471026] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-09-14T17:00:22.471352] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-14T17:00:22.474865] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-09-14T17:00:22.475662] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-09-14T17:00:22.851565] [INFO ] [REMOTE ] BBW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:00:22.958816] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-09-14T17:00:23.758887] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-09-14T17:00:23.931842] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-14T17:00:24.558890] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-09-14T17:00:24.692809] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T17:00:24.701241] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-09-14T17:00:25.358804] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-09-14T17:00:25.805806] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-14T17:00:26.050198] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-14T17:00:26.158896] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-09-14T17:00:26.947800] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-14T17:00:26.958791] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-09-14T17:00:27.758858] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-09-14T17:00:28.013561] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-14T17:00:28.558850] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-09-14T17:00:29.326651] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T17:00:29.358805] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-09-14T17:00:30.048929] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-14T17:00:30.158905] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-09-14T17:00:30.958824] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-09-14T17:00:31.139470] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T17:00:31.472749] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T17:00:31.473564] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-14T17:00:31.480385] [INFO ] [REMOTE ] BBU: Full fetch complete (4401 records). [2025-09-14T17:00:31.480849] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-09-14T17:00:31.760355] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-09-14T17:00:31.843053] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-09-14T17:00:31.843156] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-09-14T17:00:31.843345] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-09-14T17:00:31.843412] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-09-14T17:00:31.843840] [DEBUG] [LOCAL ] BBU: Trimmed 4401 records to 3202 (keeping 150 days of data) [2025-09-14T17:00:31.864114] [DEBUG] [LOCAL ] BBU: Primary data saved (3202 records). [2025-09-14T17:00:31.864250] [INFO ] [MAIN ] BBU: Full history saved. [2025-09-14T17:00:31.864405] [INFO ] [MAIN ] Update Progress: 226/2370 symbols completed. BBU took 25.4s. Estimated remaining: 3h 41m 23s. Rate: 9.7 symbols/min [2025-09-14T17:00:32.036551] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:00:32.064992] [DEBUG] [LOCAL ] BBWI: Loaded 24036 existing records from primary storage. [2025-09-14T17:00:32.065180] [INFO ] [MAIN ] BBWI: Loaded 24036 existing records. [2025-09-14T17:00:32.245967] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:00:32.246306] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-09-14T17:00:32.246383] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-09-14T17:00:32.247183] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-09-14T17:00:32.247258] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-09-14T17:00:32.563929] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-09-14T17:00:32.621523] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:00:32.983588] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T17:00:33.358823] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-09-14T17:00:34.158833] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-09-14T17:00:34.452346] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-14T17:00:34.493604] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-14T17:00:34.712574] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-14T17:00:34.958837] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-09-14T17:00:35.758806] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-09-14T17:00:36.127456] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-14T17:00:36.558838] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-09-14T17:00:36.766559] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T17:00:37.358870] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-09-14T17:00:37.652195] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-14T17:00:37.656044] [INFO ] [REMOTE ] BBW: Full fetch complete (28438 records). [2025-09-14T17:00:37.656178] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-09-14T17:00:38.020869] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-09-14T17:00:38.020979] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-09-14T17:00:38.021411] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-09-14T17:00:38.021463] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-09-14T17:00:38.022210] [DEBUG] [LOCAL ] BBW: Trimmed 28438 records to 19034 (keeping 150 days of data) [2025-09-14T17:00:38.135323] [DEBUG] [LOCAL ] BBW: Primary data saved (19034 records). [2025-09-14T17:00:38.135489] [INFO ] [MAIN ] BBW: Full history saved. [2025-09-14T17:00:38.135583] [INFO ] [MAIN ] Update Progress: 227/2370 symbols completed. BBW took 16.1s. Estimated remaining: 3h 41m 18s. Rate: 9.7 symbols/min [2025-09-14T17:00:38.166458] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-09-14T17:00:38.312639] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:00:38.337683] [DEBUG] [LOCAL ] BBY: Loaded 23942 existing records from primary storage. [2025-09-14T17:00:38.337845] [INFO ] [MAIN ] BBY: Loaded 23942 existing records. [2025-09-14T17:00:38.512779] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:00:38.513068] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-09-14T17:00:38.513130] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-09-14T17:00:38.513749] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-09-14T17:00:38.513812] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-09-14T17:00:38.861326] [INFO ] [REMOTE ] BBY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:00:38.958815] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-09-14T17:00:39.245972] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-14T17:00:39.267214] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-14T17:00:39.758841] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-09-14T17:00:40.558831] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-09-14T17:00:40.608581] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-14T17:00:40.634751] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T17:00:40.636616] [INFO ] [REMOTE ] BBUC: Full fetch complete (14102 records). [2025-09-14T17:00:40.636727] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-09-14T17:00:40.996727] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-09-14T17:00:40.996908] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-09-14T17:00:40.997193] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-09-14T17:00:40.997274] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-09-14T17:00:40.997811] [DEBUG] [LOCAL ] BBUC: Trimmed 14102 records to 9469 (keeping 150 days of data) [2025-09-14T17:00:41.060679] [DEBUG] [LOCAL ] BBUC: Primary data saved (9469 records). [2025-09-14T17:00:41.060839] [INFO ] [MAIN ] BBUC: Full history saved. [2025-09-14T17:00:41.060933] [INFO ] [MAIN ] Update Progress: 228/2370 symbols completed. BBUC took 29.5s. Estimated remaining: 3h 40m 41s. Rate: 9.7 symbols/min [2025-09-14T17:00:41.230692] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:00:41.250132] [DEBUG] [LOCAL ] BC: Loaded 18992 existing records from primary storage. [2025-09-14T17:00:41.250290] [INFO ] [MAIN ] BC: Loaded 18992 existing records. [2025-09-14T17:00:41.364008] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-09-14T17:00:41.428910] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:00:41.429189] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-09-14T17:00:41.429252] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-09-14T17:00:41.429926] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-09-14T17:00:41.429993] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-09-14T17:00:41.782051] [INFO ] [REMOTE ] BC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:00:42.158831] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-09-14T17:00:42.372617] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-14T17:00:42.958796] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-09-14T17:00:43.426496] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-14T17:00:43.758859] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-09-14T17:00:44.032980] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T17:00:44.558840] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-09-14T17:00:44.953626] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-14T17:00:45.027895] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-14T17:00:45.358902] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-09-14T17:00:46.158877] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-09-14T17:00:46.216172] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T17:00:46.960776] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-09-14T17:00:46.966731] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T17:00:47.758835] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-09-14T17:00:48.076793] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T17:00:48.558796] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-09-14T17:00:48.607590] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-14T17:00:49.366382] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-09-14T17:00:49.385957] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T17:00:50.078561] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-14T17:00:50.085608] [INFO ] [REMOTE ] BBVA: Full fetch complete (53883 records). [2025-09-14T17:00:50.085853] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-09-14T17:00:50.164767] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-09-14T17:00:50.477227] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-09-14T17:00:50.477341] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-09-14T17:00:50.477956] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-09-14T17:00:50.478016] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-09-14T17:00:50.479635] [DEBUG] [LOCAL ] BBVA: Trimmed 53883 records to 36749 (keeping 150 days of data) [2025-09-14T17:00:50.712890] [DEBUG] [LOCAL ] BBVA: Primary data saved (36749 records). [2025-09-14T17:00:50.713081] [INFO ] [MAIN ] BBVA: Full history saved. [2025-09-14T17:00:50.713186] [INFO ] [MAIN ] Update Progress: 229/2370 symbols completed. BBVA took 38.2s. Estimated remaining: 3h 41m 7s. Rate: 9.7 symbols/min [2025-09-14T17:00:50.883819] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:00:50.900634] [DEBUG] [LOCAL ] BCAT: Loaded 15256 existing records from primary storage. [2025-09-14T17:00:50.900806] [INFO ] [MAIN ] BCAT: Loaded 15256 existing records. [2025-09-14T17:00:50.968787] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-09-14T17:00:51.087703] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:00:51.087948] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-09-14T17:00:51.088011] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-14T17:00:51.088533] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-09-14T17:00:51.088594] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-09-14T17:00:51.450991] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:00:51.499273] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-14T17:00:51.694443] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-14T17:00:51.758796] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-09-14T17:00:52.484176] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-14T17:00:52.558807] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-09-14T17:00:53.026127] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-14T17:00:53.358861] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-09-14T17:00:54.158852] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-09-14T17:00:54.359286] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T17:00:54.382382] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T17:00:54.958828] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-09-14T17:00:55.607576] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-14T17:00:55.758793] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-09-14T17:00:56.113134] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-14T17:00:56.558823] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-09-14T17:00:57.358831] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-09-14T17:00:57.665153] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-14T17:00:57.871215] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-14T17:00:58.158908] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-09-14T17:00:58.788888] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T17:00:58.793777] [INFO ] [REMOTE ] BC: Full fetch complete (48563 records). [2025-09-14T17:00:58.793926] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-09-14T17:00:58.967446] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-09-14T17:00:59.183601] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-09-14T17:00:59.183762] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-09-14T17:00:59.184482] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-09-14T17:00:59.184621] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-09-14T17:00:59.186040] [DEBUG] [LOCAL ] BC: Trimmed 48563 records to 33445 (keeping 150 days of data) [2025-09-14T17:00:59.317795] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-14T17:00:59.445383] [DEBUG] [LOCAL ] BC: Primary data saved (33445 records). [2025-09-14T17:00:59.445552] [INFO ] [MAIN ] BC: Full history saved. [2025-09-14T17:00:59.445665] [INFO ] [MAIN ] Update Progress: 230/2370 symbols completed. BC took 18.4s. Estimated remaining: 3h 41m 24s. Rate: 9.7 symbols/min [2025-09-14T17:00:59.614218] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:00:59.627183] [DEBUG] [LOCAL ] BCC: Loaded 12802 existing records from primary storage. [2025-09-14T17:00:59.627338] [INFO ] [MAIN ] BCC: Loaded 12802 existing records. [2025-09-14T17:00:59.767830] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-09-14T17:00:59.804619] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:00:59.804873] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-09-14T17:00:59.804930] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-09-14T17:00:59.805489] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-09-14T17:00:59.805552] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-09-14T17:01:00.175708] [INFO ] [REMOTE ] BCC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:01:00.558824] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-09-14T17:01:00.978351] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T17:01:01.271970] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-14T17:01:01.358831] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-09-14T17:01:01.581961] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T17:01:02.023992] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T17:01:02.029516] [INFO ] [REMOTE ] BBY: Full fetch complete (58083 records). [2025-09-14T17:01:02.029700] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-09-14T17:01:02.174764] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-09-14T17:01:02.451762] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-09-14T17:01:02.451977] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-09-14T17:01:02.452845] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-09-14T17:01:02.452906] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-09-14T17:01:02.454344] [DEBUG] [LOCAL ] BBY: Trimmed 58083 records to 40251 (keeping 150 days of data) [2025-09-14T17:01:02.705171] [DEBUG] [LOCAL ] BBY: Primary data saved (40251 records). [2025-09-14T17:01:02.705352] [INFO ] [MAIN ] BBY: Full history saved. [2025-09-14T17:01:02.705462] [INFO ] [MAIN ] Update Progress: 231/2370 symbols completed. BBY took 24.6s. Estimated remaining: 3h 40m 51s. Rate: 9.7 symbols/min [2025-09-14T17:01:02.871926] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:01:02.894997] [DEBUG] [LOCAL ] BCE: Loaded 23359 existing records from primary storage. [2025-09-14T17:01:02.895224] [INFO ] [MAIN ] BCE: Loaded 23359 existing records. [2025-09-14T17:01:02.967758] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-09-14T17:01:03.070739] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:01:03.071014] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-09-14T17:01:03.071072] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-09-14T17:01:03.071719] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-09-14T17:01:03.071782] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-09-14T17:01:03.436209] [INFO ] [REMOTE ] BCE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:01:03.598991] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-14T17:01:03.758883] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-09-14T17:01:04.507161] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-14T17:01:04.558815] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-09-14T17:01:05.121263] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-14T17:01:05.358919] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-09-14T17:01:06.146824] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T17:01:06.158836] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-09-14T17:01:06.515970] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T17:01:06.958835] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-09-14T17:01:07.758859] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-09-14T17:01:07.977386] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-14T17:01:08.336498] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-14T17:01:08.558905] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-09-14T17:01:09.323886] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T17:01:09.358897] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-09-14T17:01:09.902488] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-14T17:01:09.907717] [INFO ] [REMOTE ] BCAT: Full fetch complete (37537 records). [2025-09-14T17:01:09.907874] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-09-14T17:01:10.167450] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-09-14T17:01:10.328889] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-09-14T17:01:10.328991] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-09-14T17:01:10.329455] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-09-14T17:01:10.329509] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-09-14T17:01:10.330351] [DEBUG] [LOCAL ] BCAT: Trimmed 37537 records to 25422 (keeping 150 days of data) [2025-09-14T17:01:10.482588] [DEBUG] [LOCAL ] BCAT: Primary data saved (25422 records). [2025-09-14T17:01:10.482766] [INFO ] [MAIN ] BCAT: Full history saved. [2025-09-14T17:01:10.482866] [INFO ] [MAIN ] Update Progress: 232/2370 symbols completed. BCAT took 19.8s. Estimated remaining: 3h 40m 59s. Rate: 9.7 symbols/min [2025-09-14T17:01:10.651964] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:01:10.665672] [DEBUG] [LOCAL ] BCH: Loaded 13126 existing records from primary storage. [2025-09-14T17:01:10.665814] [INFO ] [MAIN ] BCH: Loaded 13126 existing records. [2025-09-14T17:01:10.838199] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-14T17:01:10.862687] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:01:10.863631] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-09-14T17:01:10.863716] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-14T17:01:10.864118] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-09-14T17:01:10.864176] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-09-14T17:01:10.961784] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-09-14T17:01:11.211282] [INFO ] [REMOTE ] BCH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:01:11.758834] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-09-14T17:01:12.146238] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-14T17:01:12.208942] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-14T17:01:12.451041] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T17:01:12.456715] [INFO ] [REMOTE ] BBWI: Full fetch complete (58228 records). [2025-09-14T17:01:12.456855] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-09-14T17:01:12.558805] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-09-14T17:01:12.844985] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-09-14T17:01:12.845093] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-09-14T17:01:12.846390] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-09-14T17:01:12.846461] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-09-14T17:01:12.847724] [DEBUG] [LOCAL ] BBWI: Trimmed 58228 records to 40331 (keeping 150 days of data) [2025-09-14T17:01:13.115091] [DEBUG] [LOCAL ] BBWI: Primary data saved (40331 records). [2025-09-14T17:01:13.115429] [INFO ] [MAIN ] BBWI: Full history saved. [2025-09-14T17:01:13.115531] [INFO ] [MAIN ] Update Progress: 233/2370 symbols completed. BBWI took 41.3s. Estimated remaining: 3h 40m 20s. Rate: 9.7 symbols/min [2025-09-14T17:01:13.285813] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:01:13.297675] [DEBUG] [LOCAL ] BCO: Loaded 11066 existing records from primary storage. [2025-09-14T17:01:13.297819] [INFO ] [MAIN ] BCO: Loaded 11066 existing records. [2025-09-14T17:01:13.364007] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-09-14T17:01:13.475175] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:01:13.475408] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-09-14T17:01:13.475478] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-09-14T17:01:13.476258] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-09-14T17:01:13.476326] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-09-14T17:01:13.820293] [INFO ] [REMOTE ] BCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:01:14.011495] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-14T17:01:14.158842] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-09-14T17:01:14.703407] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T17:01:14.958863] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-09-14T17:01:15.547259] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T17:01:15.758852] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-09-14T17:01:16.312288] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T17:01:16.316783] [INFO ] [REMOTE ] BCC: Full fetch complete (30971 records). [2025-09-14T17:01:16.316943] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-09-14T17:01:16.563961] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-09-14T17:01:16.755002] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-09-14T17:01:16.755237] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-09-14T17:01:16.755901] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-09-14T17:01:16.756032] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-09-14T17:01:16.757230] [DEBUG] [LOCAL ] BCC: Trimmed 30971 records to 20555 (keeping 150 days of data) [2025-09-14T17:01:16.899175] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T17:01:16.930188] [DEBUG] [LOCAL ] BCC: Primary data saved (20555 records). [2025-09-14T17:01:16.930348] [INFO ] [MAIN ] BCC: Full history saved. [2025-09-14T17:01:16.930446] [INFO ] [MAIN ] Update Progress: 234/2370 symbols completed. BCC took 17.5s. Estimated remaining: 3h 39m 52s. Rate: 9.7 symbols/min [2025-09-14T17:01:17.102709] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:01:17.125753] [DEBUG] [LOCAL ] BCS: Loaded 23935 existing records from primary storage. [2025-09-14T17:01:17.125895] [INFO ] [MAIN ] BCS: Loaded 23935 existing records. [2025-09-14T17:01:17.304814] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:01:17.305071] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-09-14T17:01:17.305130] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-14T17:01:17.305930] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-09-14T17:01:17.305998] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-09-14T17:01:17.369448] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-09-14T17:01:17.664950] [INFO ] [REMOTE ] BCS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:01:17.903466] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T17:01:18.158883] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-09-14T17:01:18.778159] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-14T17:01:18.958823] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-09-14T17:01:19.407906] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-14T17:01:19.758824] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-09-14T17:01:20.191202] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T17:01:20.558828] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-09-14T17:01:21.283735] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-14T17:01:21.358798] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-09-14T17:01:22.158849] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-09-14T17:01:22.319657] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-14T17:01:22.380803] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T17:01:22.958842] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-09-14T17:01:23.391757] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-14T17:01:23.758822] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-09-14T17:01:24.558851] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-09-14T17:01:24.618059] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T17:01:24.675812] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T17:01:25.358826] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-09-14T17:01:25.718295] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-14T17:01:26.158831] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-09-14T17:01:26.958910] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-09-14T17:01:27.104545] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-14T17:01:27.567453] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-14T17:01:27.758909] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-09-14T17:01:28.555355] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-14T17:01:28.564788] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-09-14T17:01:29.358866] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-09-14T17:01:29.438960] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-14T17:01:29.587431] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T17:01:30.158912] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-09-14T17:01:30.958837] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-09-14T17:01:31.234887] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-14T17:01:31.605141] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-14T17:01:31.610573] [INFO ] [REMOTE ] BCE: Full fetch complete (57019 records). [2025-09-14T17:01:31.610743] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-09-14T17:01:31.763913] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-09-14T17:01:32.007480] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-09-14T17:01:32.007678] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-09-14T17:01:32.008503] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-09-14T17:01:32.008590] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-09-14T17:01:32.026863] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-14T17:01:32.033245] [DEBUG] [LOCAL ] BCE: Trimmed 57019 records to 39338 (keeping 150 days of data) [2025-09-14T17:01:32.277949] [DEBUG] [LOCAL ] BCE: Primary data saved (39338 records). [2025-09-14T17:01:32.278140] [INFO ] [MAIN ] BCE: Full history saved. [2025-09-14T17:01:32.278246] [INFO ] [MAIN ] Update Progress: 235/2370 symbols completed. BCE took 29.6s. Estimated remaining: 3h 41m 10s. Rate: 9.7 symbols/min [2025-09-14T17:01:32.449692] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:01:32.462790] [DEBUG] [LOCAL ] BCSF: Loaded 11633 existing records from primary storage. [2025-09-14T17:01:32.462952] [INFO ] [MAIN ] BCSF: Loaded 11633 existing records. [2025-09-14T17:01:32.561065] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-09-14T17:01:32.641984] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:01:32.642230] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-09-14T17:01:32.642306] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-09-14T17:01:32.642854] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-09-14T17:01:32.642916] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-09-14T17:01:33.010898] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:01:33.358846] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-09-14T17:01:33.888657] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-14T17:01:33.911780] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T17:01:33.915072] [INFO ] [REMOTE ] BCO: Full fetch complete (28737 records). [2025-09-14T17:01:33.923854] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-09-14T17:01:33.967756] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-14T17:01:34.163930] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-09-14T17:01:34.326834] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-09-14T17:01:34.326957] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-09-14T17:01:34.327440] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-09-14T17:01:34.327500] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-09-14T17:01:34.328441] [DEBUG] [LOCAL ] BCO: Trimmed 28737 records to 19472 (keeping 150 days of data) [2025-09-14T17:01:34.448147] [DEBUG] [LOCAL ] BCO: Primary data saved (19472 records). [2025-09-14T17:01:34.448335] [INFO ] [MAIN ] BCO: Full history saved. [2025-09-14T17:01:34.448455] [INFO ] [MAIN ] Update Progress: 236/2370 symbols completed. BCO took 21.3s. Estimated remaining: 3h 40m 27s. Rate: 9.7 symbols/min [2025-09-14T17:01:34.618951] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:01:34.629606] [DEBUG] [LOCAL ] BCX: Loaded 9193 existing records from primary storage. [2025-09-14T17:01:34.629792] [INFO ] [MAIN ] BCX: Loaded 9193 existing records. [2025-09-14T17:01:34.806445] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:01:34.806753] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-09-14T17:01:34.806824] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-09-14T17:01:34.807232] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-09-14T17:01:34.807311] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-09-14T17:01:34.967479] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-09-14T17:01:35.178552] [INFO ] [REMOTE ] BCX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:01:35.341791] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T17:01:35.758834] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-09-14T17:01:36.558821] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-09-14T17:01:36.824571] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T17:01:37.011771] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-14T17:01:37.358820] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-09-14T17:01:37.661383] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-14T17:01:38.158838] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-09-14T17:01:38.524807] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T17:01:38.958841] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-09-14T17:01:39.091545] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-14T17:01:39.095999] [INFO ] [REMOTE ] BCH: Full fetch complete (31815 records). [2025-09-14T17:01:39.096188] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-09-14T17:01:39.489220] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-09-14T17:01:39.489358] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-09-14T17:01:39.489888] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-09-14T17:01:39.489981] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-09-14T17:01:39.491301] [DEBUG] [LOCAL ] BCH: Trimmed 31815 records to 21766 (keeping 150 days of data) [2025-09-14T17:01:39.621768] [DEBUG] [LOCAL ] BCH: Primary data saved (21766 records). [2025-09-14T17:01:39.621961] [INFO ] [MAIN ] BCH: Full history saved. [2025-09-14T17:01:39.622121] [INFO ] [MAIN ] Update Progress: 237/2370 symbols completed. BCH took 29.1s. Estimated remaining: 3h 40m 11s. Rate: 9.7 symbols/min [2025-09-14T17:01:39.758836] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-09-14T17:01:40.558863] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-09-14T17:01:40.957754] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-14T17:01:41.176864] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-14T17:01:41.358856] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-09-14T17:01:41.447108] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-14T17:01:42.158847] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-09-14T17:01:42.403940] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-14T17:01:42.958825] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-09-14T17:01:43.758901] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-09-14T17:01:43.868342] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T17:01:43.989427] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T17:01:44.558866] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-09-14T17:01:44.843902] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-14T17:01:45.358840] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-09-14T17:01:46.158851] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-09-14T17:01:46.479699] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-14T17:01:46.518974] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-14T17:01:46.958839] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-09-14T17:01:47.436377] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-14T17:01:47.758845] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-09-14T17:01:48.226812] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-14T17:01:48.232318] [INFO ] [REMOTE ] BCS: Full fetch complete (58127 records). [2025-09-14T17:01:48.232458] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-09-14T17:01:48.564019] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-09-14T17:01:48.649481] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-09-14T17:01:48.649797] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-09-14T17:01:48.650718] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-09-14T17:01:48.650963] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-09-14T17:01:48.670325] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-14T17:01:48.677357] [DEBUG] [LOCAL ] BCS: Trimmed 58127 records to 40235 (keeping 150 days of data) [2025-09-14T17:01:48.959740] [DEBUG] [LOCAL ] BCS: Primary data saved (40235 records). [2025-09-14T17:01:48.959965] [INFO ] [MAIN ] BCS: Full history saved. [2025-09-14T17:01:48.960123] [INFO ] [MAIN ] Update Progress: 238/2370 symbols completed. BCS took 32.0s. Estimated remaining: 3h 40m 33s. Rate: 9.7 symbols/min [2025-09-14T17:01:49.358835] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-09-14T17:01:49.828630] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T17:01:50.065992] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:01:50.069117] [INFO ] [REMOTE ] BCSF: Full fetch complete (29482 records). [2025-09-14T17:01:50.069257] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-09-14T17:01:50.164911] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-09-14T17:01:50.456605] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-09-14T17:01:50.456733] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-09-14T17:01:50.457192] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-09-14T17:01:50.457249] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-09-14T17:01:50.458021] [DEBUG] [LOCAL ] BCSF: Trimmed 29482 records to 19447 (keeping 150 days of data) [2025-09-14T17:01:50.575315] [DEBUG] [LOCAL ] BCSF: Primary data saved (19447 records). [2025-09-14T17:01:50.575493] [INFO ] [MAIN ] BCSF: Full history saved. [2025-09-14T17:01:50.575604] [INFO ] [MAIN ] Update Progress: 239/2370 symbols completed. BCSF took 18.3s. Estimated remaining: 3h 39m 46s. Rate: 9.7 symbols/min [2025-09-14T17:01:50.928608] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-14T17:01:50.958816] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-09-14T17:01:51.634501] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:01:51.636881] [INFO ] [REMOTE ] BCX: Full fetch complete (24186 records). [2025-09-14T17:01:51.636975] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-09-14T17:01:52.016991] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-09-14T17:01:52.017103] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-09-14T17:01:52.017457] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-09-14T17:01:52.017507] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-09-14T17:01:52.018195] [DEBUG] [LOCAL ] BCX: Trimmed 24186 records to 15656 (keeping 150 days of data) [2025-09-14T17:01:52.114484] [DEBUG] [LOCAL ] BCX: Primary data saved (15656 records). [2025-09-14T17:01:52.114700] [INFO ] [MAIN ] BCX: Full history saved. [2025-09-14T17:01:52.114808] [INFO ] [MAIN ] Update Progress: 240/2370 symbols completed. BCX took 17.7s. Estimated remaining: 3h 38m 59s. Rate: 9.7 symbols/min [2025-09-14T17:01:52.736731] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:01:52.781698] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:01:52.818790] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:01:52.837703] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:01:52.871615] [DEBUG] [LOCAL ] BDC: Loaded 10970 existing records from primary storage. [2025-09-14T17:01:52.872102] [DEBUG] [LOCAL ] BDJ: Loaded 13207 existing records from primary storage. [2025-09-14T17:01:52.872541] [INFO ] [MAIN ] BDJ: Loaded 13207 existing records. [2025-09-14T17:01:52.872635] [INFO ] [MAIN ] BDC: Loaded 10970 existing records. [2025-09-14T17:01:53.133953] [DEBUG] [LOCAL ] BDX: Loaded 23585 existing records from primary storage. [2025-09-14T17:01:53.100793] [DEBUG] [LOCAL ] BDN: Loaded 21311 existing records from primary storage. [2025-09-14T17:01:53.162891] [INFO ] [MAIN ] BDN: Loaded 21311 existing records. [2025-09-14T17:01:53.187590] [INFO ] [MAIN ] BDX: Loaded 23585 existing records. [2025-09-14T17:01:53.216394] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:01:53.258097] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-09-14T17:01:53.435176] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:01:53.416047] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-14T17:01:53.470273] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-09-14T17:01:53.465140] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-09-14T17:01:53.528438] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-09-14T17:01:53.527128] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-09-14T17:01:53.549602] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-09-14T17:01:53.631137] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-09-14T17:01:53.745344] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:01:53.867936] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-09-14T17:01:53.846923] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:01:53.888804] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-14T17:01:53.909851] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-09-14T17:01:53.925884] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-09-14T17:01:54.015854] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-09-14T17:01:53.983952] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-09-14T17:01:54.171188] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-09-14T17:01:54.319733] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-09-14T17:01:54.745125] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:01:54.759753] [INFO ] [REMOTE ] BDC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:01:54.803620] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-09-14T17:01:54.835977] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-09-14T17:01:55.130145] [INFO ] [REMOTE ] BDN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:01:55.173273] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-09-14T17:01:55.194930] [INFO ] [REMOTE ] BDX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:01:55.195304] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-09-14T17:01:56.258057] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T17:01:56.264572] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-09-14T17:01:56.325921] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T17:01:56.331560] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-09-14T17:01:56.412251] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-14T17:01:56.558826] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-09-14T17:01:56.908766] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T17:01:57.358810] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-09-14T17:01:57.572076] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-14T17:01:57.697563] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T17:01:58.136818] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-14T17:01:58.158783] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-09-14T17:01:58.731788] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-14T17:01:58.958866] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-09-14T17:01:59.548853] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-14T17:01:59.758841] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-09-14T17:02:00.558833] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-09-14T17:02:00.939606] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T17:02:01.049117] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-14T17:02:01.358869] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-09-14T17:02:02.127858] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T17:02:02.158784] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-09-14T17:02:02.316390] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-14T17:02:02.958855] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-09-14T17:02:03.547413] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T17:02:03.758850] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-09-14T17:02:04.558832] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-09-14T17:02:05.082775] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-14T17:02:05.330232] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-14T17:02:05.358776] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-09-14T17:02:05.416162] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T17:02:06.158842] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-09-14T17:02:06.796059] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T17:02:06.958851] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-09-14T17:02:07.577459] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T17:02:07.758802] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-09-14T17:02:08.187230] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-14T17:02:08.558851] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-09-14T17:02:09.358833] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-09-14T17:02:09.433145] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-14T17:02:09.919216] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-14T17:02:10.158877] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-09-14T17:02:10.683868] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T17:02:10.687269] [INFO ] [REMOTE ] BDC: Full fetch complete (27418 records). [2025-09-14T17:02:10.687463] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-09-14T17:02:10.962581] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-09-14T17:02:11.052108] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T17:02:11.119476] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-09-14T17:02:11.120109] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-09-14T17:02:11.120995] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-09-14T17:02:11.121092] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-09-14T17:02:11.122129] [DEBUG] [LOCAL ] BDC: Trimmed 27418 records to 17994 (keeping 150 days of data) [2025-09-14T17:02:11.246035] [DEBUG] [LOCAL ] BDC: Primary data saved (17994 records). [2025-09-14T17:02:11.246255] [INFO ] [MAIN ] BDC: Full history saved. [2025-09-14T17:02:11.246387] [INFO ] [MAIN ] Update Progress: 241/2370 symbols completed. BDC took 19.1s. Estimated remaining: 3h 40m 47s. Rate: 9.6 symbols/min [2025-09-14T17:02:11.443793] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:02:11.469341] [DEBUG] [LOCAL ] BE: Loaded 24049 existing records from primary storage. [2025-09-14T17:02:11.469552] [INFO ] [MAIN ] BE: Loaded 24049 existing records. [2025-09-14T17:02:11.660542] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:02:11.660911] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-09-14T17:02:11.661008] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-14T17:02:11.661896] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-09-14T17:02:11.661992] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-09-14T17:02:11.765603] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-09-14T17:02:12.043808] [INFO ] [REMOTE ] BE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:02:12.558833] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-09-14T17:02:12.696200] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T17:02:12.738313] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-14T17:02:12.741451] [INFO ] [REMOTE ] BDJ: Full fetch complete (31880 records). [2025-09-14T17:02:12.741551] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-09-14T17:02:13.118982] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-09-14T17:02:13.119136] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-09-14T17:02:13.119611] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-09-14T17:02:13.119686] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-09-14T17:02:13.120574] [DEBUG] [LOCAL ] BDJ: Trimmed 31880 records to 21798 (keeping 150 days of data) [2025-09-14T17:02:13.252412] [DEBUG] [LOCAL ] BDJ: Primary data saved (21798 records). [2025-09-14T17:02:13.252571] [INFO ] [MAIN ] BDJ: Full history saved. [2025-09-14T17:02:13.252697] [INFO ] [MAIN ] Update Progress: 242/2370 symbols completed. BDJ took 21.1s. Estimated remaining: 3h 40m 4s. Rate: 9.7 symbols/min [2025-09-14T17:02:13.363961] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-09-14T17:02:13.432134] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:02:13.434311] [DEBUG] [LOCAL ] BEDU: Loaded 178 existing records from primary storage. [2025-09-14T17:02:13.434397] [INFO ] [MAIN ] BEDU: Loaded 178 existing records. [2025-09-14T17:02:13.615606] [WARN ] [MAIN ] BEDU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:02:13.615889] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-14T17:02:13.615949] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-14T17:02:13.616154] [DEBUG] [LOCAL ] BEDU: Deleted primary data file. [2025-09-14T17:02:13.616211] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-14T17:02:13.998999] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:02:14.069808] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T17:02:14.158861] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-14T17:02:14.533227] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-14T17:02:14.958865] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-09-14T17:02:15.176548] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T17:02:15.758861] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-09-14T17:02:16.305776] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T17:02:16.427138] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T17:02:16.432888] [INFO ] [REMOTE ] BDX: Full fetch complete (56927 records). [2025-09-14T17:02:16.433033] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-09-14T17:02:16.564022] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-14T17:02:16.836074] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-09-14T17:02:16.836250] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-09-14T17:02:16.836980] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-09-14T17:02:16.837048] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-09-14T17:02:16.839756] [DEBUG] [LOCAL ] BDX: Trimmed 56927 records to 39715 (keeping 150 days of data) [2025-09-14T17:02:17.110749] [DEBUG] [LOCAL ] BDX: Primary data saved (39715 records). [2025-09-14T17:02:17.110941] [INFO ] [MAIN ] BDX: Full history saved. [2025-09-14T17:02:17.111085] [INFO ] [MAIN ] Update Progress: 243/2370 symbols completed. BDX took 25.0s. Estimated remaining: 3h 39m 37s. Rate: 9.7 symbols/min [2025-09-14T17:02:17.207669] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-14T17:02:17.290069] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:02:17.315247] [DEBUG] [LOCAL ] BEKE: Loaded 23755 existing records from primary storage. [2025-09-14T17:02:17.315456] [INFO ] [MAIN ] BEKE: Loaded 23755 existing records. [2025-09-14T17:02:17.368482] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-14T17:02:17.504185] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:02:17.504541] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-09-14T17:02:17.504613] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-14T17:02:17.505347] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-09-14T17:02:17.505438] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-09-14T17:02:17.879730] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:02:17.893011] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-14T17:02:18.158855] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-09-14T17:02:18.958825] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-14T17:02:19.356909] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-14T17:02:19.758866] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-09-14T17:02:19.992729] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-14T17:02:20.558918] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-09-14T17:02:21.358889] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-09-14T17:02:21.783868] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-14T17:02:21.853664] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-14T17:02:22.158867] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-09-14T17:02:22.958823] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-09-14T17:02:23.343676] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-14T17:02:23.758894] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-14T17:02:24.017679] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T17:02:24.052961] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-14T17:02:24.160702] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-14T17:02:24.558838] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-09-14T17:02:24.894126] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-14T17:02:24.899310] [INFO ] [REMOTE ] BDN: Full fetch complete (51753 records). [2025-09-14T17:02:24.899458] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-09-14T17:02:25.298673] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-09-14T17:02:25.298789] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-09-14T17:02:25.299408] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-09-14T17:02:25.299477] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-09-14T17:02:25.300664] [DEBUG] [LOCAL ] BDN: Trimmed 51753 records to 35556 (keeping 150 days of data) [2025-09-14T17:02:25.364512] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-09-14T17:02:25.519950] [DEBUG] [LOCAL ] BDN: Primary data saved (35556 records). [2025-09-14T17:02:25.520135] [INFO ] [MAIN ] BDN: Full history saved. [2025-09-14T17:02:25.520271] [INFO ] [MAIN ] Update Progress: 244/2370 symbols completed. BDN took 33.4s. Estimated remaining: 3h 39m 50s. Rate: 9.7 symbols/min [2025-09-14T17:02:25.697517] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:02:25.722303] [DEBUG] [LOCAL ] BEN: Loaded 23709 existing records from primary storage. [2025-09-14T17:02:25.722499] [INFO ] [MAIN ] BEN: Loaded 23709 existing records. [2025-09-14T17:02:25.905357] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:02:25.905639] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-09-14T17:02:25.905716] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-09-14T17:02:25.906483] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-09-14T17:02:25.906558] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-09-14T17:02:26.163998] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-14T17:02:26.268709] [INFO ] [REMOTE ] BEN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:02:26.531350] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-14T17:02:26.958873] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-09-14T17:02:27.299597] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T17:02:27.758880] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-14T17:02:28.024203] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-09-14T17:02:28.558863] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-09-14T17:02:28.633786] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T17:02:29.358860] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-14T17:02:29.671284] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T17:02:29.672062] [INFO ] [REMOTE ] BEDU: Full fetch complete (911 records). [2025-09-14T17:02:29.672155] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-14T17:02:29.848285] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 122 unique days, need 150 days [2025-09-14T17:02:29.848462] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:02:29.848513] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:02:29.848583] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-14T17:02:29.848689] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-14T17:02:29.848746] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-14T17:02:29.848816] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-14T17:02:29.848904] [INFO ] [MAIN ] Update Progress: 245/2370 symbols completed. BEDU took 16.6s. Estimated remaining: 3h 39m 28s. Rate: 9.7 symbols/min [2025-09-14T17:02:30.017245] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:02:30.037263] [DEBUG] [LOCAL ] BEP: Loaded 16629 existing records from primary storage. [2025-09-14T17:02:30.037416] [INFO ] [MAIN ] BEP: Loaded 16629 existing records. [2025-09-14T17:02:30.163977] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-09-14T17:02:30.224062] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:02:30.224410] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-09-14T17:02:30.224480] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-14T17:02:30.225102] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-09-14T17:02:30.225173] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-09-14T17:02:30.620491] [INFO ] [REMOTE ] BEP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:02:30.657125] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-14T17:02:30.958831] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-09-14T17:02:31.758889] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-09-14T17:02:32.042975] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-14T17:02:32.248275] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-14T17:02:32.558839] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-09-14T17:02:33.144452] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T17:02:33.358836] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-09-14T17:02:34.158832] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-09-14T17:02:34.341317] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-14T17:02:34.878188] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T17:02:34.958863] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-09-14T17:02:35.758905] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-09-14T17:02:36.075997] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T17:02:36.558893] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-09-14T17:02:36.612527] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T17:02:37.358827] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-09-14T17:02:37.715614] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-14T17:02:38.158823] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-09-14T17:02:38.503876] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-14T17:02:38.920115] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-14T17:02:38.958786] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-09-14T17:02:39.625504] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-14T17:02:39.758830] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-09-14T17:02:40.224093] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-14T17:02:40.558832] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-09-14T17:02:41.358838] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-09-14T17:02:42.158853] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-09-14T17:02:42.234580] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-09-14T17:02:42.363215] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-14T17:02:42.405706] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-14T17:02:42.958837] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-09-14T17:02:43.758841] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-09-14T17:02:44.002240] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-14T17:02:44.108714] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T17:02:44.558839] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-09-14T17:02:45.358902] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-09-14T17:02:45.514860] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-14T17:02:46.158863] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-09-14T17:02:46.368713] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T17:02:46.619754] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T17:02:46.793947] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:02:46.799598] [INFO ] [REMOTE ] BEN: Full fetch complete (57721 records). [2025-09-14T17:02:46.799807] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-09-14T17:02:46.972172] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-09-14T17:02:47.187087] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-09-14T17:02:47.187197] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-09-14T17:02:47.187889] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-09-14T17:02:47.187950] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-09-14T17:02:47.189169] [DEBUG] [LOCAL ] BEN: Trimmed 57721 records to 39969 (keeping 150 days of data) [2025-09-14T17:02:47.432448] [DEBUG] [LOCAL ] BEN: Primary data saved (39969 records). [2025-09-14T17:02:47.432619] [INFO ] [MAIN ] BEN: Full history saved. [2025-09-14T17:02:47.432740] [INFO ] [MAIN ] Update Progress: 246/2370 symbols completed. BEN took 21.9s. Estimated remaining: 3h 40m 60s. Rate: 9.6 symbols/min [2025-09-14T17:02:47.601575] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:02:47.621504] [DEBUG] [LOCAL ] BEPC: Loaded 20434 existing records from primary storage. [2025-09-14T17:02:47.621678] [INFO ] [MAIN ] BEPC: Loaded 20434 existing records. [2025-09-14T17:02:47.763901] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-09-14T17:02:47.799046] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:02:47.799276] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-09-14T17:02:47.799335] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-09-14T17:02:47.800049] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-09-14T17:02:47.800114] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-09-14T17:02:48.152871] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:02:48.170312] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-14T17:02:48.174222] [INFO ] [REMOTE ] BEP: Full fetch complete (42848 records). [2025-09-14T17:02:48.174334] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-09-14T17:02:48.540809] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-09-14T17:02:48.540912] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-09-14T17:02:48.541447] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-09-14T17:02:48.541529] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-09-14T17:02:48.542477] [DEBUG] [LOCAL ] BEP: Trimmed 42848 records to 28134 (keeping 150 days of data) [2025-09-14T17:02:48.602462] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-09-14T17:02:48.722825] [DEBUG] [LOCAL ] BEP: Primary data saved (28134 records). [2025-09-14T17:02:48.722984] [INFO ] [MAIN ] BEP: Full history saved. [2025-09-14T17:02:48.723082] [INFO ] [MAIN ] Update Progress: 247/2370 symbols completed. BEP took 18.9s. Estimated remaining: 3h 40m 11s. Rate: 9.6 symbols/min [2025-09-14T17:02:48.895682] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:02:48.899721] [DEBUG] [LOCAL ] BEPH: Loaded 2172 existing records from primary storage. [2025-09-14T17:02:48.899828] [INFO ] [MAIN ] BEPH: Loaded 2172 existing records. [2025-09-14T17:02:49.081209] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:02:49.081491] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-09-14T17:02:49.081554] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-09-14T17:02:49.081778] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-09-14T17:02:49.081837] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-09-14T17:02:49.358943] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-09-14T17:02:49.437220] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:02:49.569317] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-14T17:02:49.574858] [INFO ] [REMOTE ] BEKE: Full fetch complete (57952 records). [2025-09-14T17:02:49.574994] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-09-14T17:02:49.961437] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-09-14T17:02:49.961597] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-09-14T17:02:49.962713] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-09-14T17:02:49.962801] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-09-14T17:02:49.964853] [DEBUG] [LOCAL ] BEKE: Trimmed 57952 records to 40023 (keeping 150 days of data) [2025-09-14T17:02:50.171433] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-09-14T17:02:50.214629] [DEBUG] [LOCAL ] BEKE: Primary data saved (40023 records). [2025-09-14T17:02:50.215056] [INFO ] [MAIN ] BEKE: Full history saved. [2025-09-14T17:02:50.215190] [INFO ] [MAIN ] Update Progress: 248/2370 symbols completed. BEKE took 33.1s. Estimated remaining: 3h 39m 24s. Rate: 9.7 symbols/min [2025-09-14T17:02:50.390191] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:02:50.416373] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T17:02:50.418247] [DEBUG] [LOCAL ] BEPI: Loaded 1359 existing records from primary storage. [2025-09-14T17:02:50.427683] [INFO ] [MAIN ] BEPI: Loaded 1359 existing records. [2025-09-14T17:02:50.600449] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:02:50.600787] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-09-14T17:02:50.600888] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-09-14T17:02:50.601134] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-09-14T17:02:50.601201] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-09-14T17:02:50.709044] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-14T17:02:50.957528] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:02:50.963874] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-09-14T17:02:50.972681] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-14T17:02:50.978795] [INFO ] [REMOTE ] BE: Full fetch complete (58322 records). [2025-09-14T17:02:50.978914] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-09-14T17:02:51.364887] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-09-14T17:02:51.365006] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-09-14T17:02:51.365686] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-09-14T17:02:51.365748] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-09-14T17:02:51.368242] [DEBUG] [LOCAL ] BE: Trimmed 58322 records to 40401 (keeping 150 days of data) [2025-09-14T17:02:51.554823] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-14T17:02:51.618230] [DEBUG] [LOCAL ] BE: Primary data saved (40401 records). [2025-09-14T17:02:51.618381] [INFO ] [MAIN ] BE: Full history saved. [2025-09-14T17:02:51.618474] [INFO ] [MAIN ] Update Progress: 249/2370 symbols completed. BE took 40.4s. Estimated remaining: 3h 38m 37s. Rate: 9.7 symbols/min [2025-09-14T17:02:51.763948] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-09-14T17:02:51.788049] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:02:51.792768] [DEBUG] [LOCAL ] BEPJ: Loaded 1797 existing records from primary storage. [2025-09-14T17:02:51.792873] [INFO ] [MAIN ] BEPJ: Loaded 1797 existing records. [2025-09-14T17:02:51.969886] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:02:51.970183] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-09-14T17:02:51.970262] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-09-14T17:02:51.970596] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-09-14T17:02:51.970694] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-09-14T17:02:52.328320] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:02:52.334808] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-14T17:02:52.558872] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-09-14T17:02:53.358840] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-09-14T17:02:53.805097] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-14T17:02:54.158839] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-09-14T17:02:54.394628] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-14T17:02:54.838207] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-14T17:02:54.958826] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-09-14T17:02:55.619767] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-14T17:02:55.758845] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-09-14T17:02:56.558856] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-09-14T17:02:57.032816] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-14T17:02:57.358829] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-09-14T17:02:57.441846] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T17:02:57.870968] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-14T17:02:58.158855] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-09-14T17:02:58.600221] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-14T17:02:58.958804] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-09-14T17:02:59.544592] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-14T17:02:59.758857] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-09-14T17:03:00.265061] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-14T17:03:00.558811] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-09-14T17:03:01.136822] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-14T17:03:01.358853] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-09-14T17:03:02.158869] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-09-14T17:03:02.958888] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-09-14T17:03:03.412281] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-14T17:03:03.413185] [INFO ] [REMOTE ] BEPI: Full fetch complete (3684 records). [2025-09-14T17:03:03.413269] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-09-14T17:03:03.765456] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-09-14T17:03:03.771206] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-09-14T17:03:03.772081] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-09-14T17:03:03.772259] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-09-14T17:03:03.772332] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-09-14T17:03:03.773105] [DEBUG] [LOCAL ] BEPI: Trimmed 3684 records to 2735 (keeping 150 days of data) [2025-09-14T17:03:03.791842] [DEBUG] [LOCAL ] BEPI: Primary data saved (2735 records). [2025-09-14T17:03:03.791962] [INFO ] [MAIN ] BEPI: Full history saved. [2025-09-14T17:03:03.792104] [INFO ] [MAIN ] Update Progress: 250/2370 symbols completed. BEPI took 13.6s. Estimated remaining: 3h 39m 22s. Rate: 9.7 symbols/min [2025-09-14T17:03:03.968248] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:03:03.976458] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-14T17:03:03.995417] [DEBUG] [LOCAL ] BFAM: Loaded 15271 existing records from primary storage. [2025-09-14T17:03:03.995600] [INFO ] [MAIN ] BFAM: Loaded 15271 existing records. [2025-09-14T17:03:04.179014] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:03:04.179374] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-09-14T17:03:04.179454] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-09-14T17:03:04.180153] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-09-14T17:03:04.180237] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-09-14T17:03:04.465794] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T17:03:04.542661] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:03:04.558766] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-09-14T17:03:05.358841] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-09-14T17:03:05.906709] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-14T17:03:05.972695] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T17:03:06.038528] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-14T17:03:06.158827] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-09-14T17:03:06.958881] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-09-14T17:03:07.431054] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T17:03:07.632143] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-14T17:03:07.758825] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-09-14T17:03:08.204974] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-14T17:03:08.558856] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-09-14T17:03:08.920161] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-14T17:03:09.358840] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-09-14T17:03:09.703983] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-14T17:03:09.704862] [INFO ] [REMOTE ] BEPJ: Full fetch complete (3520 records). [2025-09-14T17:03:09.704949] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-09-14T17:03:10.071930] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-09-14T17:03:10.072042] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-09-14T17:03:10.072178] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-09-14T17:03:10.072230] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-09-14T17:03:10.072682] [DEBUG] [LOCAL ] BEPJ: Trimmed 3520 records to 2618 (keeping 150 days of data) [2025-09-14T17:03:10.089333] [DEBUG] [LOCAL ] BEPJ: Primary data saved (2618 records). [2025-09-14T17:03:10.089441] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-09-14T17:03:10.089531] [INFO ] [MAIN ] Update Progress: 251/2370 symbols completed. BEPJ took 18.5s. Estimated remaining: 3h 39m 16s. Rate: 9.7 symbols/min [2025-09-14T17:03:10.163909] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-09-14T17:03:10.263794] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:03:10.282004] [DEBUG] [LOCAL ] BFH: Loaded 17286 existing records from primary storage. [2025-09-14T17:03:10.282221] [INFO ] [MAIN ] BFH: Loaded 17286 existing records. [2025-09-14T17:03:10.471268] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:03:10.471588] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-09-14T17:03:10.471666] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-09-14T17:03:10.472259] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-09-14T17:03:10.472329] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-09-14T17:03:10.829715] [INFO ] [REMOTE ] BFH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:03:10.874753] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-14T17:03:10.958898] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-09-14T17:03:11.758844] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-09-14T17:03:12.439409] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-14T17:03:12.558832] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-09-14T17:03:13.358921] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-09-14T17:03:13.406532] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-14T17:03:14.158919] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-09-14T17:03:14.528682] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-14T17:03:14.958868] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-09-14T17:03:15.014533] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-09-14T17:03:15.758961] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-09-14T17:03:15.791456] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T17:03:16.043301] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T17:03:16.558871] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-09-14T17:03:17.358858] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-09-14T17:03:17.424630] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T17:03:18.158932] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-09-14T17:03:18.263891] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T17:03:18.701742] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T17:03:18.958839] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-09-14T17:03:19.610184] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-14T17:03:19.758923] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-09-14T17:03:20.391633] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-14T17:03:20.406744] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-14T17:03:20.558849] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-09-14T17:03:21.117140] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T17:03:21.118222] [INFO ] [REMOTE ] BEPH: Full fetch complete (5748 records). [2025-09-14T17:03:21.118321] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-09-14T17:03:21.363915] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-09-14T17:03:21.473157] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-09-14T17:03:21.473255] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-09-14T17:03:21.473445] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-09-14T17:03:21.473516] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-09-14T17:03:21.473960] [DEBUG] [LOCAL ] BEPH: Trimmed 5748 records to 3539 (keeping 150 days of data) [2025-09-14T17:03:21.495826] [DEBUG] [LOCAL ] BEPH: Primary data saved (3539 records). [2025-09-14T17:03:21.495918] [INFO ] [MAIN ] BEPH: Full history saved. [2025-09-14T17:03:21.496004] [INFO ] [MAIN ] Update Progress: 252/2370 symbols completed. BEPH took 32.8s. Estimated remaining: 3h 39m 54s. Rate: 9.6 symbols/min [2025-09-14T17:03:21.668482] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:03:21.675490] [DEBUG] [LOCAL ] BFK: Loaded 5499 existing records from primary storage. [2025-09-14T17:03:21.675626] [INFO ] [MAIN ] BFK: Loaded 5499 existing records. [2025-09-14T17:03:21.865359] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:03:21.865803] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-09-14T17:03:21.865875] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-09-14T17:03:21.866204] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-09-14T17:03:21.866263] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-09-14T17:03:22.163927] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-09-14T17:03:22.228902] [INFO ] [REMOTE ] BFK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:03:22.565120] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-14T17:03:22.570080] [INFO ] [REMOTE ] BEPC: Full fetch complete (51011 records). [2025-09-14T17:03:22.570235] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-09-14T17:03:22.959491] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-09-14T17:03:22.960844] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-09-14T17:03:22.960973] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-09-14T17:03:22.961571] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-09-14T17:03:22.961728] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-09-14T17:03:22.962965] [DEBUG] [LOCAL ] BEPC: Trimmed 51011 records to 34353 (keeping 150 days of data) [2025-09-14T17:03:23.177925] [DEBUG] [LOCAL ] BEPC: Primary data saved (34353 records). [2025-09-14T17:03:23.178100] [INFO ] [MAIN ] BEPC: Full history saved. [2025-09-14T17:03:23.178201] [INFO ] [MAIN ] Update Progress: 253/2370 symbols completed. BEPC took 35.7s. Estimated remaining: 3h 39m 10s. Rate: 9.7 symbols/min [2025-09-14T17:03:23.346001] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:03:23.368972] [DEBUG] [LOCAL ] BFLY: Loaded 23140 existing records from primary storage. [2025-09-14T17:03:23.369129] [INFO ] [MAIN ] BFLY: Loaded 23140 existing records. [2025-09-14T17:03:23.560328] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:03:23.560629] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-09-14T17:03:23.560710] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-09-14T17:03:23.561426] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-09-14T17:03:23.561495] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-09-14T17:03:23.759973] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-09-14T17:03:23.948934] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:03:23.976591] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T17:03:24.372324] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-14T17:03:24.558828] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-09-14T17:03:24.601789] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-14T17:03:25.358828] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-09-14T17:03:26.121440] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-14T17:03:26.152440] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-14T17:03:26.158777] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-09-14T17:03:26.958874] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-09-14T17:03:27.265016] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-14T17:03:27.758862] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-09-14T17:03:28.558824] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-09-14T17:03:28.602141] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-14T17:03:28.656052] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T17:03:29.358834] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-09-14T17:03:30.110528] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T17:03:30.157405] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-14T17:03:30.160577] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-09-14T17:03:30.958854] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-09-14T17:03:31.486139] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-14T17:03:31.490192] [INFO ] [REMOTE ] BFAM: Full fetch complete (35521 records). [2025-09-14T17:03:31.490359] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-09-14T17:03:31.768806] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-09-14T17:03:31.912328] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-14T17:03:31.912463] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-09-14T17:03:31.916049] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-09-14T17:03:31.917358] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-09-14T17:03:31.917440] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-09-14T17:03:31.919068] [DEBUG] [LOCAL ] BFAM: Trimmed 35521 records to 24802 (keeping 150 days of data) [2025-09-14T17:03:32.079987] [DEBUG] [LOCAL ] BFAM: Primary data saved (24802 records). [2025-09-14T17:03:32.080209] [INFO ] [MAIN ] BFAM: Full history saved. [2025-09-14T17:03:32.080331] [INFO ] [MAIN ] Update Progress: 254/2370 symbols completed. BFAM took 28.3s. Estimated remaining: 3h 39m 26s. Rate: 9.6 symbols/min [2025-09-14T17:03:32.255035] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:03:32.262947] [DEBUG] [LOCAL ] BFS: Loaded 4384 existing records from primary storage. [2025-09-14T17:03:32.263151] [INFO ] [MAIN ] BFS: Loaded 4384 existing records. [2025-09-14T17:03:32.448624] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:03:32.448901] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-09-14T17:03:32.448962] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-09-14T17:03:32.449350] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-09-14T17:03:32.449410] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-09-14T17:03:32.563999] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-09-14T17:03:32.804233] [INFO ] [REMOTE ] BFS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:03:33.095999] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T17:03:33.358899] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-09-14T17:03:34.100400] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-14T17:03:34.158862] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-09-14T17:03:34.776251] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T17:03:34.780762] [INFO ] [REMOTE ] BFH: Full fetch complete (45399 records). [2025-09-14T17:03:34.780883] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-09-14T17:03:34.967781] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-09-14T17:03:35.184038] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-09-14T17:03:35.184245] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-09-14T17:03:35.184977] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-09-14T17:03:35.185133] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-09-14T17:03:35.187121] [DEBUG] [LOCAL ] BFH: Trimmed 45399 records to 30776 (keeping 150 days of data) [2025-09-14T17:03:35.224130] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T17:03:35.435769] [DEBUG] [LOCAL ] BFH: Primary data saved (30776 records). [2025-09-14T17:03:35.436022] [INFO ] [MAIN ] BFH: Full history saved. [2025-09-14T17:03:35.436175] [INFO ] [MAIN ] Update Progress: 255/2370 symbols completed. BFH took 25.3s. Estimated remaining: 3h 38m 56s. Rate: 9.7 symbols/min [2025-09-14T17:03:35.615528] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:03:35.623754] [DEBUG] [LOCAL ] BFZ: Loaded 5111 existing records from primary storage. [2025-09-14T17:03:35.623992] [INFO ] [MAIN ] BFZ: Loaded 5111 existing records. [2025-09-14T17:03:35.773800] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-09-14T17:03:35.817832] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:03:35.818233] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-09-14T17:03:35.818311] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-09-14T17:03:35.818699] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-09-14T17:03:35.818767] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-09-14T17:03:35.943229] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-14T17:03:36.205851] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:03:36.558863] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-09-14T17:03:37.358839] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-09-14T17:03:37.440917] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T17:03:37.661112] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-14T17:03:38.158895] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-09-14T17:03:38.371898] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-14T17:03:38.958884] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-09-14T17:03:39.074688] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-14T17:03:39.751518] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-14T17:03:39.758759] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-09-14T17:03:40.558827] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-09-14T17:03:40.590046] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-14T17:03:40.592906] [INFO ] [REMOTE ] BFK: Full fetch complete (14521 records). [2025-09-14T17:03:40.593022] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-09-14T17:03:40.969352] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-09-14T17:03:40.969512] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-09-14T17:03:40.970090] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-09-14T17:03:40.970161] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-09-14T17:03:40.970832] [DEBUG] [LOCAL ] BFK: Trimmed 14521 records to 10011 (keeping 150 days of data) [2025-09-14T17:03:41.040372] [DEBUG] [LOCAL ] BFK: Primary data saved (10011 records). [2025-09-14T17:03:41.040626] [INFO ] [MAIN ] BFK: Full history saved. [2025-09-14T17:03:41.040789] [INFO ] [MAIN ] Update Progress: 256/2370 symbols completed. BFK took 19.5s. Estimated remaining: 3h 38m 45s. Rate: 9.7 symbols/min [2025-09-14T17:03:41.228084] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:03:41.251967] [DEBUG] [LOCAL ] BG: Loaded 22942 existing records from primary storage. [2025-09-14T17:03:41.252213] [INFO ] [MAIN ] BG: Loaded 22942 existing records. [2025-09-14T17:03:41.363263] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-09-14T17:03:41.447850] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:03:41.448815] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-09-14T17:03:41.449779] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-09-14T17:03:41.449264] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T17:03:41.453400] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-09-14T17:03:41.453918] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-09-14T17:03:41.834961] [INFO ] [REMOTE ] BG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:03:42.158845] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-09-14T17:03:42.958837] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-09-14T17:03:42.981182] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-14T17:03:43.284542] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T17:03:43.495697] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-14T17:03:43.758823] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-09-14T17:03:44.522788] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-14T17:03:44.558835] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-09-14T17:03:45.358831] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-09-14T17:03:46.158814] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-09-14T17:03:46.188447] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T17:03:46.231412] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T17:03:46.960738] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-09-14T17:03:46.963583] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-14T17:03:47.758842] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-09-14T17:03:48.558823] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-09-14T17:03:48.724836] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T17:03:48.745073] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T17:03:49.119713] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-14T17:03:49.358851] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-09-14T17:03:50.058249] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-14T17:03:50.158881] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-09-14T17:03:50.371380] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.21 seconds). [2025-09-14T17:03:50.373088] [INFO ] [REMOTE ] BFS: Full fetch complete (9609 records). [2025-09-14T17:03:50.373173] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-09-14T17:03:50.726488] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-09-14T17:03:50.726593] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-09-14T17:03:50.726855] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-09-14T17:03:50.726910] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-09-14T17:03:50.727345] [DEBUG] [LOCAL ] BFS: Trimmed 9609 records to 6805 (keeping 150 days of data) [2025-09-14T17:03:50.769967] [DEBUG] [LOCAL ] BFS: Primary data saved (6805 records). [2025-09-14T17:03:50.770122] [INFO ] [MAIN ] BFS: Full history saved. [2025-09-14T17:03:50.770221] [INFO ] [MAIN ] Update Progress: 257/2370 symbols completed. BFS took 18.7s. Estimated remaining: 3h 39m 7s. Rate: 9.6 symbols/min [2025-09-14T17:03:50.942507] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:03:50.951429] [DEBUG] [LOCAL ] BGB: Loaded 7128 existing records from primary storage. [2025-09-14T17:03:50.951573] [INFO ] [MAIN ] BGB: Loaded 7128 existing records. [2025-09-14T17:03:50.963957] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-09-14T17:03:51.130151] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:03:51.130444] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-09-14T17:03:51.130505] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-09-14T17:03:51.130867] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-09-14T17:03:51.130930] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-09-14T17:03:51.482206] [INFO ] [REMOTE ] BGB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:03:51.758826] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-09-14T17:03:52.558850] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-09-14T17:03:52.902403] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T17:03:53.067113] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-14T17:03:53.358844] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-09-14T17:03:54.060574] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-14T17:03:54.158832] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-09-14T17:03:54.958867] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-09-14T17:03:55.311714] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-14T17:03:55.333449] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T17:03:55.758836] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-09-14T17:03:56.558852] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-09-14T17:03:56.740006] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T17:03:56.798470] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-14T17:03:57.358923] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-09-14T17:03:58.028972] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-14T17:03:58.045795] [INFO ] [REMOTE ] BFLY: Full fetch complete (56476 records). [2025-09-14T17:03:58.046827] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-14T17:03:58.046967] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-09-14T17:03:58.163890] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-09-14T17:03:58.436276] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-09-14T17:03:58.436420] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-09-14T17:03:58.437253] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-09-14T17:03:58.437331] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-09-14T17:03:58.438735] [DEBUG] [LOCAL ] BFLY: Trimmed 56476 records to 38899 (keeping 150 days of data) [2025-09-14T17:03:58.662626] [DEBUG] [LOCAL ] BFLY: Primary data saved (38899 records). [2025-09-14T17:03:58.662821] [INFO ] [MAIN ] BFLY: Full history saved. [2025-09-14T17:03:58.662933] [INFO ] [MAIN ] Update Progress: 258/2370 symbols completed. BFLY took 35.5s. Estimated remaining: 3h 39m 15s. Rate: 9.6 symbols/min [2025-09-14T17:03:58.849879] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:03:58.860027] [DEBUG] [LOCAL ] BGH: Loaded 7452 existing records from primary storage. [2025-09-14T17:03:58.860210] [INFO ] [MAIN ] BGH: Loaded 7452 existing records. [2025-09-14T17:03:58.960511] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-09-14T17:03:59.040471] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:03:59.040785] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-09-14T17:03:59.040844] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-09-14T17:03:59.041141] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-09-14T17:03:59.041199] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-09-14T17:03:59.378681] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-14T17:03:59.416603] [INFO ] [REMOTE ] BGH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:03:59.758872] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-09-14T17:04:00.539319] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-14T17:04:00.541211] [INFO ] [REMOTE ] BFZ: Full fetch complete (12560 records). [2025-09-14T17:04:00.541295] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-09-14T17:04:00.563972] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-09-14T17:04:00.919678] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-09-14T17:04:00.919852] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-09-14T17:04:00.920316] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-09-14T17:04:00.920442] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-09-14T17:04:00.921333] [DEBUG] [LOCAL ] BFZ: Trimmed 12560 records to 8286 (keeping 150 days of data) [2025-09-14T17:04:00.997958] [DEBUG] [LOCAL ] BFZ: Primary data saved (8286 records). [2025-09-14T17:04:01.001025] [INFO ] [MAIN ] BFZ: Full history saved. [2025-09-14T17:04:01.001158] [INFO ] [MAIN ] Update Progress: 259/2370 symbols completed. BFZ took 25.6s. Estimated remaining: 3h 38m 37s. Rate: 9.7 symbols/min [2025-09-14T17:04:01.070259] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-14T17:04:01.193192] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:04:01.200671] [DEBUG] [LOCAL ] BGR: Loaded 5526 existing records from primary storage. [2025-09-14T17:04:01.200821] [INFO ] [MAIN ] BGR: Loaded 5526 existing records. [2025-09-14T17:04:01.363003] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-09-14T17:04:01.384581] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:04:01.385049] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-09-14T17:04:01.385133] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-14T17:04:01.385433] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-09-14T17:04:01.385495] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-09-14T17:04:01.579143] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-14T17:04:01.762076] [INFO ] [REMOTE ] BGR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:04:02.158832] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-09-14T17:04:02.958891] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-09-14T17:04:03.237631] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-14T17:04:03.587502] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-14T17:04:03.758841] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-09-14T17:04:04.078688] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T17:04:04.558837] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-09-14T17:04:05.358925] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-09-14T17:04:05.544118] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T17:04:05.568461] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-14T17:04:06.158918] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-09-14T17:04:06.235997] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T17:04:06.517374] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-14T17:04:06.524185] [INFO ] [REMOTE ] BG: Full fetch complete (54786 records). [2025-09-14T17:04:06.524485] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-09-14T17:04:06.917611] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-09-14T17:04:06.917763] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-09-14T17:04:06.918399] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-09-14T17:04:06.918459] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-09-14T17:04:06.919812] [DEBUG] [LOCAL ] BG: Trimmed 54786 records to 37983 (keeping 150 days of data) [2025-09-14T17:04:06.978236] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-09-14T17:04:07.170507] [DEBUG] [LOCAL ] BG: Primary data saved (37983 records). [2025-09-14T17:04:07.170711] [INFO ] [MAIN ] BG: Full history saved. [2025-09-14T17:04:07.170815] [INFO ] [MAIN ] Update Progress: 260/2370 symbols completed. BG took 26.1s. Estimated remaining: 3h 38m 30s. Rate: 9.7 symbols/min [2025-09-14T17:04:07.339720] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:04:07.361998] [DEBUG] [LOCAL ] BGS: Loaded 22630 existing records from primary storage. [2025-09-14T17:04:07.362183] [INFO ] [MAIN ] BGS: Loaded 22630 existing records. [2025-09-14T17:04:07.542082] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:04:07.542434] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-09-14T17:04:07.542517] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-09-14T17:04:07.543273] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-09-14T17:04:07.543363] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-09-14T17:04:07.763975] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-09-14T17:04:07.907401] [INFO ] [REMOTE ] BGS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:04:08.044145] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-14T17:04:08.558841] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-09-14T17:04:08.767358] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T17:04:08.769512] [INFO ] [REMOTE ] BGB: Full fetch complete (19747 records). [2025-09-14T17:04:08.769610] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-09-14T17:04:09.143144] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-09-14T17:04:09.143280] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-09-14T17:04:09.143699] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-09-14T17:04:09.143792] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-09-14T17:04:09.144846] [DEBUG] [LOCAL ] BGB: Trimmed 19747 records to 12790 (keeping 150 days of data) [2025-09-14T17:04:09.226450] [DEBUG] [LOCAL ] BGB: Primary data saved (12790 records). [2025-09-14T17:04:09.226664] [INFO ] [MAIN ] BGB: Full history saved. [2025-09-14T17:04:09.226800] [INFO ] [MAIN ] Update Progress: 261/2370 symbols completed. BGB took 18.5s. Estimated remaining: 3h 37m 50s. Rate: 9.7 symbols/min [2025-09-14T17:04:09.363904] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-09-14T17:04:09.410023] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:04:09.415539] [DEBUG] [LOCAL ] BGSF: Loaded 3583 existing records from primary storage. [2025-09-14T17:04:09.415678] [INFO ] [MAIN ] BGSF: Loaded 3583 existing records. [2025-09-14T17:04:09.590835] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:04:09.591093] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-09-14T17:04:09.591171] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-14T17:04:09.591426] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-09-14T17:04:09.591491] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-09-14T17:04:09.958068] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:04:10.158800] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-09-14T17:04:10.159983] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-14T17:04:10.559898] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-14T17:04:10.642333] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-14T17:04:10.958943] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-09-14T17:04:11.439949] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-14T17:04:11.758894] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-09-14T17:04:12.558910] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-09-14T17:04:13.089305] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-14T17:04:13.358850] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-09-14T17:04:13.527402] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T17:04:13.877430] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-14T17:04:14.158833] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-09-14T17:04:14.958836] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-09-14T17:04:14.979180] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T17:04:15.758865] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-09-14T17:04:16.008276] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T17:04:16.558854] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-09-14T17:04:16.591734] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-14T17:04:17.355284] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-14T17:04:17.359043] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-09-14T17:04:18.158843] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-09-14T17:04:18.547978] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T17:04:18.826632] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-14T17:04:18.958841] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-09-14T17:04:19.659502] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T17:04:19.661082] [INFO ] [REMOTE ] BGSF: Full fetch complete (5427 records). [2025-09-14T17:04:19.661190] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-09-14T17:04:19.766390] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-09-14T17:04:20.029628] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-09-14T17:04:20.029775] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-09-14T17:04:20.029988] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-09-14T17:04:20.030066] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-09-14T17:04:20.030490] [DEBUG] [LOCAL ] BGSF: Trimmed 5427 records to 4332 (keeping 150 days of data) [2025-09-14T17:04:20.058371] [DEBUG] [LOCAL ] BGSF: Primary data saved (4332 records). [2025-09-14T17:04:20.058599] [INFO ] [MAIN ] BGSF: Full history saved. [2025-09-14T17:04:20.058760] [INFO ] [MAIN ] Update Progress: 262/2370 symbols completed. BGSF took 10.8s. Estimated remaining: 3h 38m 22s. Rate: 9.7 symbols/min [2025-09-14T17:04:20.234363] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:04:20.250284] [DEBUG] [LOCAL ] BGT: Loaded 7998 existing records from primary storage. [2025-09-14T17:04:20.250509] [INFO ] [MAIN ] BGT: Loaded 7998 existing records. [2025-09-14T17:04:20.433720] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:04:20.434086] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-09-14T17:04:20.434155] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-09-14T17:04:20.434672] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-09-14T17:04:20.434745] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-09-14T17:04:20.564063] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-09-14T17:04:20.808777] [INFO ] [REMOTE ] BGT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:04:21.358844] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-09-14T17:04:21.531708] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T17:04:21.651545] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T17:04:22.158889] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-09-14T17:04:22.425224] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-14T17:04:22.958840] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-09-14T17:04:23.620836] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-14T17:04:23.758888] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-09-14T17:04:24.060544] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-14T17:04:24.558874] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-09-14T17:04:24.655557] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-14T17:04:25.206605] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-14T17:04:25.358906] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-09-14T17:04:26.158841] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-09-14T17:04:26.350089] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T17:04:26.958841] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-09-14T17:04:27.283156] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T17:04:27.672362] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-14T17:04:27.758790] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-09-14T17:04:28.421517] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-14T17:04:28.558823] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-09-14T17:04:29.358853] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-09-14T17:04:30.154775] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T17:04:30.156760] [INFO ] [REMOTE ] BGR: Full fetch complete (14914 records). [2025-09-14T17:04:30.156875] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-09-14T17:04:30.168661] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-09-14T17:04:30.536450] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-09-14T17:04:30.536834] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-09-14T17:04:30.537409] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-09-14T17:04:30.537607] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-09-14T17:04:30.538693] [DEBUG] [LOCAL ] BGR: Trimmed 14914 records to 9858 (keeping 150 days of data) [2025-09-14T17:04:30.620342] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-14T17:04:30.645575] [DEBUG] [LOCAL ] BGR: Primary data saved (9858 records). [2025-09-14T17:04:30.645754] [INFO ] [MAIN ] BGR: Full history saved. [2025-09-14T17:04:30.645863] [INFO ] [MAIN ] Update Progress: 263/2370 symbols completed. BGR took 29.6s. Estimated remaining: 3h 38m 50s. Rate: 9.6 symbols/min [2025-09-14T17:04:30.816706] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:04:30.824165] [DEBUG] [LOCAL ] BGX: Loaded 4984 existing records from primary storage. [2025-09-14T17:04:30.824332] [INFO ] [MAIN ] BGX: Loaded 4984 existing records. [2025-09-14T17:04:30.964026] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-09-14T17:04:31.007006] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:04:31.007438] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-09-14T17:04:31.007506] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-09-14T17:04:31.007814] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-09-14T17:04:31.007884] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-09-14T17:04:31.311237] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T17:04:31.391976] [INFO ] [REMOTE ] BGX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:04:31.758807] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-09-14T17:04:32.021792] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-14T17:04:32.525175] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-14T17:04:32.558785] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-09-14T17:04:33.358850] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-09-14T17:04:33.410068] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-14T17:04:34.158875] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-09-14T17:04:34.958916] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-09-14T17:04:35.319041] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-14T17:04:35.331186] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-14T17:04:35.334990] [INFO ] [REMOTE ] BGH: Full fetch complete (17353 records). [2025-09-14T17:04:35.335146] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-09-14T17:04:35.731623] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-09-14T17:04:35.731813] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-09-14T17:04:35.732318] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-09-14T17:04:35.732377] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-09-14T17:04:35.733141] [DEBUG] [LOCAL ] BGH: Trimmed 17353 records to 12346 (keeping 150 days of data) [2025-09-14T17:04:35.770360] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-09-14T17:04:35.830673] [DEBUG] [LOCAL ] BGH: Primary data saved (12346 records). [2025-09-14T17:04:35.831587] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-14T17:04:35.831786] [INFO ] [MAIN ] BGH: Full history saved. [2025-09-14T17:04:35.834771] [INFO ] [MAIN ] Update Progress: 264/2370 symbols completed. BGH took 37.2s. Estimated remaining: 3h 38m 36s. Rate: 9.6 symbols/min [2025-09-14T17:04:36.011245] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:04:36.022670] [DEBUG] [LOCAL ] BGY: Loaded 10023 existing records from primary storage. [2025-09-14T17:04:36.022842] [INFO ] [MAIN ] BGY: Loaded 10023 existing records. [2025-09-14T17:04:36.200589] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:04:36.200903] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-09-14T17:04:36.200971] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-09-14T17:04:36.201409] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-09-14T17:04:36.201476] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-09-14T17:04:36.550115] [INFO ] [REMOTE ] BGY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:04:36.558782] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-09-14T17:04:37.358907] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-09-14T17:04:37.563024] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T17:04:37.725212] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-14T17:04:38.083420] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-14T17:04:38.158806] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-09-14T17:04:38.958845] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-09-14T17:04:39.112536] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-14T17:04:39.758843] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-09-14T17:04:40.387693] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T17:04:40.558820] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-09-14T17:04:40.784618] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-14T17:04:41.358833] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-09-14T17:04:41.941731] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T17:04:42.121999] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T17:04:42.124167] [INFO ] [REMOTE ] BGT: Full fetch complete (17951 records). [2025-09-14T17:04:42.124278] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-09-14T17:04:42.163943] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-09-14T17:04:42.511502] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-09-14T17:04:42.511622] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-09-14T17:04:42.512078] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-09-14T17:04:42.512163] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-09-14T17:04:42.512942] [DEBUG] [LOCAL ] BGT: Trimmed 17951 records to 12374 (keeping 150 days of data) [2025-09-14T17:04:42.592735] [DEBUG] [LOCAL ] BGT: Primary data saved (12374 records). [2025-09-14T17:04:42.592962] [INFO ] [MAIN ] BGT: Full history saved. [2025-09-14T17:04:42.593140] [INFO ] [MAIN ] Update Progress: 265/2370 symbols completed. BGT took 22.5s. Estimated remaining: 3h 38m 34s. Rate: 9.6 symbols/min [2025-09-14T17:04:42.770960] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:04:42.782282] [DEBUG] [LOCAL ] BH: Loaded 9282 existing records from primary storage. [2025-09-14T17:04:42.782442] [INFO ] [MAIN ] BH: Loaded 9282 existing records. [2025-09-14T17:04:42.966227] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-09-14T17:04:42.972114] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:04:42.973877] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-09-14T17:04:42.973964] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-14T17:04:42.974428] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-09-14T17:04:42.985604] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-09-14T17:04:43.036063] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T17:04:43.120955] [INFO ] [REMOTE ] BGS: Full fetch complete (54810 records). [2025-09-14T17:04:43.165329] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-09-14T17:04:43.630775] [INFO ] [REMOTE ] BH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:04:43.767024] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-09-14T17:04:43.863774] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-09-14T17:04:43.863904] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-09-14T17:04:43.864637] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-09-14T17:04:43.864783] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-09-14T17:04:43.878900] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-14T17:04:43.883692] [DEBUG] [LOCAL ] BGS: Trimmed 54810 records to 37999 (keeping 150 days of data) [2025-09-14T17:04:44.115844] [DEBUG] [LOCAL ] BGS: Primary data saved (37999 records). [2025-09-14T17:04:44.116017] [INFO ] [MAIN ] BGS: Full history saved. [2025-09-14T17:04:44.116119] [INFO ] [MAIN ] Update Progress: 266/2370 symbols completed. BGS took 36.9s. Estimated remaining: 3h 37m 50s. Rate: 9.7 symbols/min [2025-09-14T17:04:44.295472] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:04:44.316554] [DEBUG] [LOCAL ] BHC: Loaded 21105 existing records from primary storage. [2025-09-14T17:04:44.316738] [INFO ] [MAIN ] BHC: Loaded 21105 existing records. [2025-09-14T17:04:44.483462] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-14T17:04:44.515813] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:04:44.516596] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-09-14T17:04:44.516680] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-09-14T17:04:44.517235] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-09-14T17:04:44.517298] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-09-14T17:04:44.563921] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-09-14T17:04:44.891899] [INFO ] [REMOTE ] BHC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:04:45.358828] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-09-14T17:04:45.465204] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-14T17:04:46.158835] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-09-14T17:04:46.923806] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T17:04:46.958813] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-09-14T17:04:46.977108] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-14T17:04:47.758824] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-09-14T17:04:48.511019] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-14T17:04:48.558792] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-09-14T17:04:49.105790] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-14T17:04:49.358848] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-09-14T17:04:49.642896] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T17:04:50.018702] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-14T17:04:50.158885] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-09-14T17:04:50.958798] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-09-14T17:04:51.362133] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T17:04:51.758819] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-09-14T17:04:51.762262] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-14T17:04:52.558847] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-09-14T17:04:53.103047] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-14T17:04:53.308461] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T17:04:53.358815] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-09-14T17:04:54.158860] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-09-14T17:04:54.589021] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-14T17:04:54.958875] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-09-14T17:04:55.148420] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T17:04:55.690287] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T17:04:55.692811] [INFO ] [REMOTE ] BGY: Full fetch complete (25398 records). [2025-09-14T17:04:55.692919] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-09-14T17:04:55.764105] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-09-14T17:04:56.088140] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-09-14T17:04:56.088289] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-09-14T17:04:56.088734] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-09-14T17:04:56.088800] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-09-14T17:04:56.089744] [DEBUG] [LOCAL ] BGY: Trimmed 25398 records to 16485 (keeping 150 days of data) [2025-09-14T17:04:56.195792] [DEBUG] [LOCAL ] BGY: Primary data saved (16485 records). [2025-09-14T17:04:56.196005] [INFO ] [MAIN ] BGY: Full history saved. [2025-09-14T17:04:56.196117] [INFO ] [MAIN ] Update Progress: 267/2370 symbols completed. BGY took 20.4s. Estimated remaining: 3h 38m 30s. Rate: 9.6 symbols/min [2025-09-14T17:04:56.384558] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:04:56.396767] [DEBUG] [LOCAL ] BHE: Loaded 10306 existing records from primary storage. [2025-09-14T17:04:56.396957] [INFO ] [MAIN ] BHE: Loaded 10306 existing records. [2025-09-14T17:04:56.575428] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-09-14T17:04:56.581431] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:04:56.582849] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-09-14T17:04:56.582950] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-14T17:04:56.583468] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-09-14T17:04:56.583571] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-09-14T17:04:56.946605] [INFO ] [REMOTE ] BHE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:04:57.358863] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-09-14T17:04:57.426977] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T17:04:57.456559] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T17:04:57.458921] [INFO ] [REMOTE ] BGX: Full fetch complete (12004 records). [2025-09-14T17:04:57.459043] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-09-14T17:04:57.826845] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-09-14T17:04:57.826987] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-09-14T17:04:57.827383] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-09-14T17:04:57.827464] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-09-14T17:04:57.828125] [DEBUG] [LOCAL ] BGX: Trimmed 12004 records to 7740 (keeping 150 days of data) [2025-09-14T17:04:57.881211] [DEBUG] [LOCAL ] BGX: Primary data saved (7740 records). [2025-09-14T17:04:57.881414] [INFO ] [MAIN ] BGX: Full history saved. [2025-09-14T17:04:57.881560] [INFO ] [MAIN ] Update Progress: 268/2370 symbols completed. BGX took 27.2s. Estimated remaining: 3h 37m 48s. Rate: 9.7 symbols/min [2025-09-14T17:04:58.087446] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:04:58.108216] [DEBUG] [LOCAL ] BHK: Loaded 12388 existing records from primary storage. [2025-09-14T17:04:58.108519] [INFO ] [MAIN ] BHK: Loaded 12388 existing records. [2025-09-14T17:04:58.164092] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-09-14T17:04:58.430975] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:04:58.431633] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-09-14T17:04:58.431894] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-09-14T17:04:58.432691] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-09-14T17:04:58.432786] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-09-14T17:04:58.618612] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-14T17:04:58.964017] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-09-14T17:04:59.028233] [INFO ] [REMOTE ] BHK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:04:59.758853] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-09-14T17:04:59.837769] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T17:05:00.467885] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T17:05:00.558886] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-09-14T17:05:00.839327] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-14T17:05:01.358851] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-09-14T17:05:01.902285] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T17:05:02.158870] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-09-14T17:05:02.432817] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-14T17:05:02.958882] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-09-14T17:05:03.246403] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T17:05:03.758818] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-09-14T17:05:03.787148] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T17:05:04.558846] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-09-14T17:05:04.934557] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-14T17:05:05.358881] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-09-14T17:05:05.419544] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T17:05:06.158882] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-09-14T17:05:06.958791] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-09-14T17:05:07.148892] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T17:05:07.315515] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T17:05:07.553051] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-14T17:05:07.758845] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-09-14T17:05:08.558806] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-09-14T17:05:08.724684] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-14T17:05:08.727222] [INFO ] [REMOTE ] BH: Full fetch complete (15478 records). [2025-09-14T17:05:08.727313] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-09-14T17:05:09.091808] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-09-14T17:05:09.091915] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-09-14T17:05:09.092222] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-09-14T17:05:09.092276] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-09-14T17:05:09.092859] [DEBUG] [LOCAL ] BH: Trimmed 15478 records to 13143 (keeping 150 days of data) [2025-09-14T17:05:09.172686] [DEBUG] [LOCAL ] BH: Primary data saved (13143 records). [2025-09-14T17:05:09.172863] [INFO ] [MAIN ] BH: Full history saved. [2025-09-14T17:05:09.172962] [INFO ] [MAIN ] Update Progress: 269/2370 symbols completed. BH took 26.6s. Estimated remaining: 3h 38m 22s. Rate: 9.6 symbols/min [2025-09-14T17:05:09.347812] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:05:09.361929] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-09-14T17:05:09.373333] [DEBUG] [LOCAL ] BHP: Loaded 23912 existing records from primary storage. [2025-09-14T17:05:09.373502] [INFO ] [MAIN ] BHP: Loaded 23912 existing records. [2025-09-14T17:05:09.549008] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:05:09.549276] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-09-14T17:05:09.549339] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-09-14T17:05:09.550020] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-09-14T17:05:09.550088] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-09-14T17:05:09.907727] [INFO ] [REMOTE ] BHP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:05:09.951398] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-14T17:05:09.956787] [INFO ] [REMOTE ] BHC: Full fetch complete (50950 records). [2025-09-14T17:05:09.956996] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-09-14T17:05:10.165336] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-09-14T17:05:10.349188] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-09-14T17:05:10.349309] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-09-14T17:05:10.349930] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-09-14T17:05:10.349992] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-09-14T17:05:10.351304] [DEBUG] [LOCAL ] BHC: Trimmed 50950 records to 34955 (keeping 150 days of data) [2025-09-14T17:05:10.555401] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-14T17:05:10.580679] [DEBUG] [LOCAL ] BHC: Primary data saved (34955 records). [2025-09-14T17:05:10.580880] [INFO ] [MAIN ] BHC: Full history saved. [2025-09-14T17:05:10.580989] [INFO ] [MAIN ] Update Progress: 270/2370 symbols completed. BHC took 26.5s. Estimated remaining: 3h 37m 38s. Rate: 9.6 symbols/min [2025-09-14T17:05:10.753395] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:05:10.763900] [DEBUG] [LOCAL ] BHR: Loaded 9096 existing records from primary storage. [2025-09-14T17:05:10.764083] [INFO ] [MAIN ] BHR: Loaded 9096 existing records. [2025-09-14T17:05:10.945111] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:05:10.945435] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-09-14T17:05:10.945502] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-09-14T17:05:10.945903] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-09-14T17:05:10.945969] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-09-14T17:05:10.967150] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-09-14T17:05:11.313025] [INFO ] [REMOTE ] BHR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:05:11.758794] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-09-14T17:05:12.015154] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-14T17:05:12.074969] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-14T17:05:12.558881] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-09-14T17:05:13.001942] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-14T17:05:13.358857] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-09-14T17:05:13.640441] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-14T17:05:14.158868] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-09-14T17:05:14.685556] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T17:05:14.688233] [INFO ] [REMOTE ] BHE: Full fetch complete (27966 records). [2025-09-14T17:05:14.688344] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-09-14T17:05:14.963952] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-09-14T17:05:15.073271] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-09-14T17:05:15.073385] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-09-14T17:05:15.073896] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-09-14T17:05:15.073959] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-09-14T17:05:15.074765] [DEBUG] [LOCAL ] BHE: Trimmed 27966 records to 17884 (keeping 150 days of data) [2025-09-14T17:05:15.217222] [DEBUG] [LOCAL ] BHE: Primary data saved (17884 records). [2025-09-14T17:05:15.217463] [INFO ] [MAIN ] BHE: Full history saved. [2025-09-14T17:05:15.217586] [INFO ] [MAIN ] Update Progress: 271/2370 symbols completed. BHE took 19.0s. Estimated remaining: 3h 37m 20s. Rate: 9.7 symbols/min [2025-09-14T17:05:15.220430] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T17:05:15.405915] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:05:15.408290] [DEBUG] [LOCAL ] BHV: Loaded 485 existing records from primary storage. [2025-09-14T17:05:15.408383] [INFO ] [MAIN ] BHV: Loaded 485 existing records. [2025-09-14T17:05:15.584529] [WARN ] [MAIN ] BHV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:05:15.584914] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-14T17:05:15.584980] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-14T17:05:15.585170] [DEBUG] [LOCAL ] BHV: Deleted primary data file. [2025-09-14T17:05:15.585230] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-14T17:05:15.769974] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-09-14T17:05:15.936675] [INFO ] [REMOTE ] BHV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:05:16.169668] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-14T17:05:16.558849] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-14T17:05:16.937112] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-14T17:05:17.104227] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T17:05:17.358877] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-14T17:05:17.778402] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-14T17:05:18.158879] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-09-14T17:05:18.958805] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-09-14T17:05:19.415238] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T17:05:19.758793] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-14T17:05:19.830767] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-14T17:05:20.088957] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-14T17:05:20.558832] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-09-14T17:05:21.358857] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-09-14T17:05:21.739263] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-14T17:05:22.158848] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-09-14T17:05:22.837206] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-14T17:05:22.898726] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-14T17:05:22.958837] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-09-14T17:05:23.758843] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-09-14T17:05:24.259259] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-14T17:05:24.558836] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-09-14T17:05:25.358802] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-14T17:05:25.673823] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-14T17:05:25.809895] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-14T17:05:25.839948] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-14T17:05:26.158872] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-09-14T17:05:26.958843] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-09-14T17:05:27.758800] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-09-14T17:05:27.904184] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T17:05:27.923191] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-14T17:05:27.927075] [INFO ] [REMOTE ] BHK: Full fetch complete (23611 records). [2025-09-14T17:05:27.927177] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-09-14T17:05:28.289853] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-09-14T17:05:28.289985] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-09-14T17:05:28.290458] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-09-14T17:05:28.290520] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-09-14T17:05:28.291291] [DEBUG] [LOCAL ] BHK: Trimmed 23611 records to 18380 (keeping 150 days of data) [2025-09-14T17:05:28.412704] [DEBUG] [LOCAL ] BHK: Primary data saved (18380 records). [2025-09-14T17:05:28.412897] [INFO ] [MAIN ] BHK: Full history saved. [2025-09-14T17:05:28.413008] [INFO ] [MAIN ] Update Progress: 272/2370 symbols completed. BHK took 30.5s. Estimated remaining: 3h 38m 7s. Rate: 9.6 symbols/min [2025-09-14T17:05:28.560617] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-09-14T17:05:28.594004] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:05:28.617104] [DEBUG] [LOCAL ] BHVN: Loaded 22469 existing records from primary storage. [2025-09-14T17:05:28.617306] [INFO ] [MAIN ] BHVN: Loaded 22469 existing records. [2025-09-14T17:05:28.797494] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:05:28.797915] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-09-14T17:05:28.798017] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-09-14T17:05:28.803911] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-09-14T17:05:28.804008] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-09-14T17:05:28.883073] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T17:05:29.188586] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:05:29.358817] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-09-14T17:05:30.158822] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-09-14T17:05:30.295597] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-14T17:05:30.585534] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-14T17:05:30.958869] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-09-14T17:05:31.211876] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T17:05:31.700056] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T17:05:31.703390] [INFO ] [REMOTE ] BHR: Full fetch complete (22520 records). [2025-09-14T17:05:31.703480] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-09-14T17:05:31.764773] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-09-14T17:05:32.086535] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-09-14T17:05:32.086700] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-09-14T17:05:32.087230] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-09-14T17:05:32.087288] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-09-14T17:05:32.088116] [DEBUG] [LOCAL ] BHR: Trimmed 22520 records to 15557 (keeping 150 days of data) [2025-09-14T17:05:32.189190] [DEBUG] [LOCAL ] BHR: Primary data saved (15557 records). [2025-09-14T17:05:32.189567] [INFO ] [MAIN ] BHR: Full history saved. [2025-09-14T17:05:32.189698] [INFO ] [MAIN ] Update Progress: 273/2370 symbols completed. BHR took 21.6s. Estimated remaining: 3h 37m 42s. Rate: 9.6 symbols/min [2025-09-14T17:05:32.365357] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:05:32.388999] [DEBUG] [LOCAL ] BILL: Loaded 23669 existing records from primary storage. [2025-09-14T17:05:32.389231] [INFO ] [MAIN ] BILL: Loaded 23669 existing records. [2025-09-14T17:05:32.567223] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-09-14T17:05:32.571800] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:05:32.573018] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-09-14T17:05:32.573081] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-14T17:05:32.573912] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-09-14T17:05:32.573982] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-09-14T17:05:32.931493] [INFO ] [REMOTE ] BILL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:05:33.358842] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-09-14T17:05:33.711196] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-14T17:05:34.015665] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-14T17:05:34.158836] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-09-14T17:05:34.849984] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T17:05:34.958858] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-14T17:05:35.339884] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-14T17:05:35.569920] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-14T17:05:35.575704] [INFO ] [REMOTE ] BHP: Full fetch complete (58045 records). [2025-09-14T17:05:35.575880] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-09-14T17:05:35.771000] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-14T17:05:35.983869] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-09-14T17:05:35.984006] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-09-14T17:05:35.984769] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-09-14T17:05:35.984834] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-09-14T17:05:35.986220] [DEBUG] [LOCAL ] BHP: Trimmed 58045 records to 40153 (keeping 150 days of data) [2025-09-14T17:05:36.245861] [DEBUG] [LOCAL ] BHP: Primary data saved (40153 records). [2025-09-14T17:05:36.246022] [INFO ] [MAIN ] BHP: Full history saved. [2025-09-14T17:05:36.246138] [INFO ] [MAIN ] Update Progress: 274/2370 symbols completed. BHP took 27.1s. Estimated remaining: 3h 37m 19s. Rate: 9.6 symbols/min [2025-09-14T17:05:36.342760] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-14T17:05:36.423942] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:05:36.436368] [DEBUG] [LOCAL ] BIO: Loaded 10800 existing records from primary storage. [2025-09-14T17:05:36.436523] [INFO ] [MAIN ] BIO: Loaded 10800 existing records. [2025-09-14T17:05:36.563902] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-09-14T17:05:36.615550] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:05:36.615796] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-09-14T17:05:36.615865] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-09-14T17:05:36.616279] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-09-14T17:05:36.616339] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-09-14T17:05:36.972482] [INFO ] [REMOTE ] BIO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:05:37.358837] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-14T17:05:37.930665] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-14T17:05:38.158849] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-09-14T17:05:38.354896] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T17:05:38.958848] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-14T17:05:39.288297] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T17:05:39.289239] [INFO ] [REMOTE ] BHV: Full fetch complete (1056 records). [2025-09-14T17:05:39.289335] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-14T17:05:39.472631] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-14T17:05:39.473005] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:05:39.473076] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:05:39.473185] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-14T17:05:39.473268] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-14T17:05:39.473421] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-14T17:05:39.473501] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-14T17:05:39.473696] [INFO ] [MAIN ] Update Progress: 275/2370 symbols completed. BHV took 24.3s. Estimated remaining: 3h 36m 50s. Rate: 9.7 symbols/min [2025-09-14T17:05:39.487845] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T17:05:39.663781] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:05:39.683011] [DEBUG] [LOCAL ] BIP: Loaded 17501 existing records from primary storage. [2025-09-14T17:05:39.683183] [INFO ] [MAIN ] BIP: Loaded 17501 existing records. [2025-09-14T17:05:39.764068] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-09-14T17:05:39.867425] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:05:39.868049] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-09-14T17:05:39.868115] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-09-14T17:05:39.868993] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-09-14T17:05:39.869058] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-09-14T17:05:40.217361] [INFO ] [REMOTE ] BIP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:05:40.558837] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-09-14T17:05:41.090877] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T17:05:41.358883] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-09-14T17:05:42.070355] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T17:05:42.158816] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-09-14T17:05:42.618550] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-14T17:05:42.958879] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-09-14T17:05:43.754066] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-14T17:05:43.764014] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-09-14T17:05:44.397430] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T17:05:44.558949] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-09-14T17:05:45.358891] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-09-14T17:05:45.505515] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-14T17:05:45.982756] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-14T17:05:46.158836] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-09-14T17:05:46.910291] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T17:05:46.958824] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-09-14T17:05:47.758835] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-09-14T17:05:48.083067] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T17:05:48.324321] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-14T17:05:48.558881] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-09-14T17:05:49.127401] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-14T17:05:49.358817] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-09-14T17:05:49.717539] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T17:05:50.158826] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-09-14T17:05:50.958839] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-09-14T17:05:51.004379] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-14T17:05:51.635598] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T17:05:51.758841] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-09-14T17:05:52.558857] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-09-14T17:05:52.854125] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-14T17:05:53.106446] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T17:05:53.358869] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-09-14T17:05:53.418157] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T17:05:54.158835] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-09-14T17:05:54.879362] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-14T17:05:54.958861] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-09-14T17:05:55.464215] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T17:05:55.758844] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-09-14T17:05:55.952238] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-14T17:05:55.956559] [INFO ] [REMOTE ] BIP: Full fetch complete (43416 records). [2025-09-14T17:05:55.956730] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-09-14T17:05:56.332124] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-09-14T17:05:56.332234] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-09-14T17:05:56.333139] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-09-14T17:05:56.333499] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-09-14T17:05:56.335267] [DEBUG] [LOCAL ] BIP: Trimmed 43416 records to 28380 (keeping 150 days of data) [2025-09-14T17:05:56.544424] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-14T17:05:56.553102] [DEBUG] [LOCAL ] BIP: Primary data saved (28380 records). [2025-09-14T17:05:56.554149] [INFO ] [MAIN ] BIP: Full history saved. [2025-09-14T17:05:56.554304] [INFO ] [MAIN ] Update Progress: 276/2370 symbols completed. BIP took 17.1s. Estimated remaining: 3h 38m 6s. Rate: 9.6 symbols/min [2025-09-14T17:05:56.566423] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-09-14T17:05:56.728075] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:05:56.745890] [DEBUG] [LOCAL ] BIPC: Loaded 17774 existing records from primary storage. [2025-09-14T17:05:56.746081] [INFO ] [MAIN ] BIPC: Loaded 17774 existing records. [2025-09-14T17:05:56.920524] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:05:56.920824] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-09-14T17:05:56.920885] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-09-14T17:05:56.921607] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-09-14T17:05:56.921692] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-09-14T17:05:57.270184] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:05:57.358795] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-09-14T17:05:58.158843] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-09-14T17:05:58.186078] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-14T17:05:58.191426] [INFO ] [REMOTE ] BHVN: Full fetch complete (53176 records). [2025-09-14T17:05:58.191539] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-09-14T17:05:58.570273] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-09-14T17:05:58.570389] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-09-14T17:05:58.571006] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-09-14T17:05:58.571064] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-09-14T17:05:58.572402] [DEBUG] [LOCAL ] BHVN: Trimmed 53176 records to 37833 (keeping 150 days of data) [2025-09-14T17:05:58.685959] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T17:05:58.698952] [INFO ] [REMOTE ] BIO: Full fetch complete (28335 records). [2025-09-14T17:05:58.703788] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-09-14T17:05:58.977824] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-09-14T17:05:59.117692] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T17:05:59.184669] [DEBUG] [LOCAL ] BHVN: Primary data saved (37833 records). [2025-09-14T17:05:59.218540] [INFO ] [MAIN ] BHVN: Full history saved. [2025-09-14T17:05:59.220272] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-09-14T17:05:59.220498] [INFO ] [MAIN ] Update Progress: 277/2370 symbols completed. BHVN took 30.8s. Estimated remaining: 3h 37m 33s. Rate: 9.6 symbols/min [2025-09-14T17:05:59.220778] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-09-14T17:05:59.221404] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-09-14T17:05:59.221467] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-09-14T17:05:59.222279] [DEBUG] [LOCAL ] BIO: Trimmed 28335 records to 18672 (keeping 150 days of data) [2025-09-14T17:05:59.347578] [DEBUG] [LOCAL ] BIO: Primary data saved (18672 records). [2025-09-14T17:05:59.347809] [INFO ] [MAIN ] BIO: Full history saved. [2025-09-14T17:05:59.347917] [INFO ] [MAIN ] Update Progress: 278/2370 symbols completed. BIO took 23.1s. Estimated remaining: 3h 36m 41s. Rate: 9.7 symbols/min [2025-09-14T17:05:59.758925] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-09-14T17:06:00.690361] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-14T17:06:00.701511] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-09-14T17:06:01.288026] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-14T17:06:01.358827] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-09-14T17:06:02.844281] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-14T17:06:02.856216] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-09-14T17:06:04.040522] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-14T17:06:04.051087] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-09-14T17:06:05.505096] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-14T17:06:05.516338] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-09-14T17:06:05.839311] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (2.98 seconds). [2025-09-14T17:06:05.853244] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-09-14T17:06:06.530127] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:06:06.536003] [INFO ] [REMOTE ] BILL: Full fetch complete (56990 records). [2025-09-14T17:06:06.536176] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-09-14T17:06:06.954028] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-09-14T17:06:06.954184] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-09-14T17:06:06.955044] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-09-14T17:06:06.955221] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-09-14T17:06:06.957263] [DEBUG] [LOCAL ] BILL: Trimmed 56990 records to 39323 (keeping 150 days of data) [2025-09-14T17:06:07.073893] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-14T17:06:07.106439] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-09-14T17:06:07.246437] [DEBUG] [LOCAL ] BILL: Primary data saved (39323 records). [2025-09-14T17:06:07.246721] [INFO ] [MAIN ] BILL: Full history saved. [2025-09-14T17:06:07.246896] [INFO ] [MAIN ] Update Progress: 279/2370 symbols completed. BILL took 35.1s. Estimated remaining: 3h 36m 47s. Rate: 9.6 symbols/min [2025-09-14T17:06:08.531987] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-14T17:06:08.545149] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-09-14T17:06:10.031352] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T17:06:10.047088] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-09-14T17:06:11.281353] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-14T17:06:11.285900] [INFO ] [REMOTE ] BIPC: Full fetch complete (45552 records). [2025-09-14T17:06:11.286032] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-09-14T17:06:11.696330] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-09-14T17:06:11.696493] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-09-14T17:06:11.697255] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-09-14T17:06:11.697317] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-09-14T17:06:11.698687] [DEBUG] [LOCAL ] BIPC: Trimmed 45552 records to 30547 (keeping 150 days of data) [2025-09-14T17:06:11.902745] [DEBUG] [LOCAL ] BIPC: Primary data saved (30547 records). [2025-09-14T17:06:11.903001] [INFO ] [MAIN ] BIPC: Full history saved. [2025-09-14T17:06:11.903127] [INFO ] [MAIN ] Update Progress: 280/2370 symbols completed. BIPC took 15.3s. Estimated remaining: 3h 36m 29s. Rate: 9.7 symbols/min [2025-09-14T17:06:12.674086] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:06:12.685276] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:06:12.683975] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:06:12.719911] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:06:12.725216] [DEBUG] [LOCAL ] BIPH: Loaded 1011 existing records from primary storage. [2025-09-14T17:06:12.726769] [INFO ] [MAIN ] BIPH: Loaded 1011 existing records. [2025-09-14T17:06:12.764024] [DEBUG] [LOCAL ] BIPJ: Loaded 1309 existing records from primary storage. [2025-09-14T17:06:12.764886] [INFO ] [MAIN ] BIPJ: Loaded 1309 existing records. [2025-09-14T17:06:12.789399] [DEBUG] [LOCAL ] BIPI: Loaded 1435 existing records from primary storage. [2025-09-14T17:06:12.873367] [INFO ] [MAIN ] BIPI: Loaded 1435 existing records. [2025-09-14T17:06:13.025273] [DEBUG] [LOCAL ] BIRK: Loaded 22767 existing records from primary storage. [2025-09-14T17:06:13.160339] [INFO ] [MAIN ] BIRK: Loaded 22767 existing records. [2025-09-14T17:06:13.262993] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:06:13.353395] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:06:13.378264] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-09-14T17:06:13.432531] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-09-14T17:06:13.481458] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:06:13.481590] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-09-14T17:06:13.482121] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-09-14T17:06:13.482306] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-09-14T17:06:13.487941] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-09-14T17:06:13.498735] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-09-14T17:06:13.509141] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-09-14T17:06:13.524655] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-09-14T17:06:13.562450] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-09-14T17:06:13.562389] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:06:13.584698] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-09-14T17:06:13.584794] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-09-14T17:06:13.639124] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-09-14T17:06:13.716538] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-09-14T17:06:13.716691] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-09-14T17:06:13.748742] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-09-14T17:06:14.789484] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:06:14.828437] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-09-14T17:06:14.910686] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:06:14.930093] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-09-14T17:06:15.014235] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:06:15.011080] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:06:15.014973] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-09-14T17:06:15.015238] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-09-14T17:06:15.281908] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-14T17:06:15.283198] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-09-14T17:06:15.404325] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-14T17:06:15.405451] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-09-14T17:06:15.520828] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-14T17:06:15.522109] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-09-14T17:06:15.787961] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-14T17:06:15.789256] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-09-14T17:06:15.938698] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-14T17:06:15.940151] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-09-14T17:06:15.980249] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-14T17:06:15.982214] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-09-14T17:06:16.332606] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-14T17:06:16.334246] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-09-14T17:06:16.500769] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-14T17:06:16.558938] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-09-14T17:06:16.725629] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-14T17:06:16.899368] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T17:06:17.015853] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-14T17:06:17.358835] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-09-14T17:06:17.570061] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-14T17:06:18.158909] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-09-14T17:06:18.748941] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-14T17:06:18.958877] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-09-14T17:06:19.387797] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-14T17:06:19.438511] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-14T17:06:19.758836] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-09-14T17:06:20.102194] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-14T17:06:20.558837] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-09-14T17:06:21.050746] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-14T17:06:21.358831] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-09-14T17:06:21.849562] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-14T17:06:22.158834] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-09-14T17:06:22.726304] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-14T17:06:22.958835] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-09-14T17:06:23.439011] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-14T17:06:23.758859] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-09-14T17:06:24.166338] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T17:06:24.167630] [INFO ] [REMOTE ] BIPH: Full fetch complete (2789 records). [2025-09-14T17:06:24.167762] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-09-14T17:06:24.543673] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-09-14T17:06:24.543779] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-09-14T17:06:24.543919] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-09-14T17:06:24.543985] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-09-14T17:06:24.544357] [DEBUG] [LOCAL ] BIPH: Trimmed 2789 records to 1599 (keeping 150 days of data) [2025-09-14T17:06:24.554723] [DEBUG] [LOCAL ] BIPH: Primary data saved (1599 records). [2025-09-14T17:06:24.554848] [INFO ] [MAIN ] BIPH: Full history saved. [2025-09-14T17:06:24.554955] [INFO ] [MAIN ] Update Progress: 281/2370 symbols completed. BIPH took 12.7s. Estimated remaining: 3h 37m 11s. Rate: 9.6 symbols/min [2025-09-14T17:06:24.566086] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-09-14T17:06:24.732934] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:06:24.746109] [DEBUG] [LOCAL ] BIT: Loaded 11860 existing records from primary storage. [2025-09-14T17:06:24.746251] [INFO ] [MAIN ] BIT: Loaded 11860 existing records. [2025-09-14T17:06:24.919391] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:06:24.919664] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-09-14T17:06:24.919734] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-09-14T17:06:24.920167] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-09-14T17:06:24.920229] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-09-14T17:06:25.274817] [INFO ] [REMOTE ] BIT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:06:25.358834] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-09-14T17:06:26.158804] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-09-14T17:06:26.332871] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T17:06:26.356690] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-14T17:06:26.590749] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-14T17:06:26.958870] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-09-14T17:06:27.545360] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T17:06:27.546712] [INFO ] [REMOTE ] BIPI: Full fetch complete (3610 records). [2025-09-14T17:06:27.546819] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-09-14T17:06:27.764066] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-09-14T17:06:27.937116] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-09-14T17:06:27.937226] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-09-14T17:06:27.937381] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-09-14T17:06:27.937435] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-09-14T17:06:27.937832] [DEBUG] [LOCAL ] BIPI: Trimmed 3610 records to 2075 (keeping 150 days of data) [2025-09-14T17:06:27.950751] [DEBUG] [LOCAL ] BIPI: Primary data saved (2075 records). [2025-09-14T17:06:27.950829] [INFO ] [MAIN ] BIPI: Full history saved. [2025-09-14T17:06:27.950935] [INFO ] [MAIN ] Update Progress: 282/2370 symbols completed. BIPI took 16.0s. Estimated remaining: 3h 36m 44s. Rate: 9.6 symbols/min [2025-09-14T17:06:28.118092] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:06:28.141782] [DEBUG] [LOCAL ] BJ: Loaded 23005 existing records from primary storage. [2025-09-14T17:06:28.141961] [INFO ] [MAIN ] BJ: Loaded 23005 existing records. [2025-09-14T17:06:28.318953] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:06:28.319226] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-09-14T17:06:28.319287] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-09-14T17:06:28.319999] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-09-14T17:06:28.320064] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-09-14T17:06:28.564029] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-09-14T17:06:28.674208] [INFO ] [REMOTE ] BJ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:06:29.358801] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-09-14T17:06:29.526551] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-14T17:06:29.700023] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-14T17:06:29.719771] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-14T17:06:30.158858] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-09-14T17:06:30.499631] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-14T17:06:30.958836] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-09-14T17:06:31.483291] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T17:06:31.484257] [INFO ] [REMOTE ] BIPJ: Full fetch complete (3034 records). [2025-09-14T17:06:31.484342] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-09-14T17:06:31.764109] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-09-14T17:06:31.879879] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-09-14T17:06:31.880013] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-09-14T17:06:31.880195] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-09-14T17:06:31.880265] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-09-14T17:06:31.880697] [DEBUG] [LOCAL ] BIPJ: Trimmed 3034 records to 2122 (keeping 150 days of data) [2025-09-14T17:06:31.893807] [DEBUG] [LOCAL ] BIPJ: Primary data saved (2122 records). [2025-09-14T17:06:31.893891] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-09-14T17:06:31.893997] [INFO ] [MAIN ] Update Progress: 283/2370 symbols completed. BIPJ took 20.0s. Estimated remaining: 3h 36m 21s. Rate: 9.6 symbols/min [2025-09-14T17:06:32.104427] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:06:32.133504] [DEBUG] [LOCAL ] BK: Loaded 23984 existing records from primary storage. [2025-09-14T17:06:32.133740] [INFO ] [MAIN ] BK: Loaded 23984 existing records. [2025-09-14T17:06:32.309704] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:06:32.310001] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-09-14T17:06:32.310063] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-09-14T17:06:32.310730] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-09-14T17:06:32.310801] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-09-14T17:06:32.563945] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-09-14T17:06:32.679659] [INFO ] [REMOTE ] BK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:06:33.356320] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T17:06:33.366534] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-09-14T17:06:33.665599] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T17:06:34.158859] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-09-14T17:06:34.964003] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-09-14T17:06:34.987094] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-14T17:06:35.486999] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-14T17:06:35.744732] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-14T17:06:35.758837] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-09-14T17:06:36.558849] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-09-14T17:06:37.358868] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-09-14T17:06:37.436571] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-14T17:06:38.054824] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T17:06:38.158841] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-09-14T17:06:38.958891] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-09-14T17:06:39.115085] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T17:06:39.758831] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-09-14T17:06:40.558830] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-09-14T17:06:40.581188] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-14T17:06:40.586553] [INFO ] [REMOTE ] BIRK: Full fetch complete (55217 records). [2025-09-14T17:06:40.586702] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-09-14T17:06:40.970994] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-09-14T17:06:40.971199] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-09-14T17:06:40.971933] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-09-14T17:06:40.972053] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-09-14T17:06:41.000014] [DEBUG] [LOCAL ] BIRK: Trimmed 55217 records to 38281 (keeping 150 days of data) [2025-09-14T17:06:41.002885] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (2.84 seconds). [2025-09-14T17:06:41.245905] [DEBUG] [LOCAL ] BIRK: Primary data saved (38281 records). [2025-09-14T17:06:41.246203] [INFO ] [MAIN ] BIRK: Full history saved. [2025-09-14T17:06:41.246443] [INFO ] [MAIN ] Update Progress: 284/2370 symbols completed. BIRK took 29.3s. Estimated remaining: 3h 36m 38s. Rate: 9.6 symbols/min [2025-09-14T17:06:41.358802] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-09-14T17:06:41.422288] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:06:41.455734] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T17:06:41.488832] [DEBUG] [LOCAL ] BKD: Loaded 22535 existing records from primary storage. [2025-09-14T17:06:41.489099] [INFO ] [MAIN ] BKD: Loaded 22535 existing records. [2025-09-14T17:06:41.649966] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T17:06:41.695716] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:06:41.696751] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-09-14T17:06:41.696838] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-09-14T17:06:41.697424] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-09-14T17:06:41.697490] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-09-14T17:06:42.052908] [INFO ] [REMOTE ] BKD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:06:42.158832] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-09-14T17:06:42.958843] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-09-14T17:06:43.228100] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T17:06:43.301703] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T17:06:43.758854] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-09-14T17:06:44.028225] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-14T17:06:44.558908] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-09-14T17:06:45.366484] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-09-14T17:06:45.371663] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T17:06:46.158841] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-09-14T17:06:46.436812] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T17:06:46.471377] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-14T17:06:46.958841] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-09-14T17:06:47.642454] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T17:06:47.758826] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-09-14T17:06:48.261327] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-14T17:06:48.558833] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-09-14T17:06:49.358915] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-09-14T17:06:49.455362] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T17:06:50.158870] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-09-14T17:06:50.342052] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-14T17:06:50.577523] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-14T17:06:50.581715] [INFO ] [REMOTE ] BIT: Full fetch complete (23333 records). [2025-09-14T17:06:50.581849] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-09-14T17:06:50.959516] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-09-14T17:06:50.979794] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T17:06:50.977789] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-09-14T17:06:50.986134] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-09-14T17:06:50.987577] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-09-14T17:06:50.987868] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-09-14T17:06:50.988285] [INFO ] [REMOTE ] BJ: Full fetch complete (55894 records). [2025-09-14T17:06:50.989085] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-09-14T17:06:50.989797] [DEBUG] [LOCAL ] BIT: Trimmed 23333 records to 16547 (keeping 150 days of data) [2025-09-14T17:06:51.507599] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-09-14T17:06:51.509012] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-09-14T17:06:51.512714] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-09-14T17:06:51.513542] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-09-14T17:06:51.519979] [DEBUG] [LOCAL ] BIT: Primary data saved (16547 records). [2025-09-14T17:06:51.520458] [INFO ] [MAIN ] BIT: Full history saved. [2025-09-14T17:06:51.520609] [INFO ] [MAIN ] Update Progress: 285/2370 symbols completed. BIT took 27.0s. Estimated remaining: 3h 37m 1s. Rate: 9.6 symbols/min [2025-09-14T17:06:51.521204] [DEBUG] [LOCAL ] BJ: Trimmed 55894 records to 38619 (keeping 150 days of data) [2025-09-14T17:06:51.771702] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-09-14T17:06:51.809865] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:06:51.913238] [DEBUG] [LOCAL ] BKE: Loaded 14987 existing records from primary storage. [2025-09-14T17:06:51.923290] [INFO ] [MAIN ] BKE: Loaded 14987 existing records. [2025-09-14T17:06:52.156161] [DEBUG] [LOCAL ] BJ: Primary data saved (38619 records). [2025-09-14T17:06:52.175920] [INFO ] [MAIN ] BJ: Full history saved. [2025-09-14T17:06:52.175798] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:06:52.176551] [INFO ] [MAIN ] Update Progress: 286/2370 symbols completed. BJ took 24.2s. Estimated remaining: 3h 36m 14s. Rate: 9.6 symbols/min [2025-09-14T17:06:52.177402] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-09-14T17:06:52.177732] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-14T17:06:52.259252] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-09-14T17:06:52.291215] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-09-14T17:06:52.488975] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:06:52.713342] [DEBUG] [LOCAL ] BKH: Loaded 17885 existing records from primary storage. [2025-09-14T17:06:52.741042] [INFO ] [MAIN ] BKH: Loaded 17885 existing records. [2025-09-14T17:06:52.782834] [INFO ] [REMOTE ] BKE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:06:52.816334] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-09-14T17:06:52.978353] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:06:52.979305] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-09-14T17:06:52.979491] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-09-14T17:06:52.980176] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-09-14T17:06:52.980253] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-09-14T17:06:53.118108] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-14T17:06:53.363939] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-09-14T17:06:53.425080] [INFO ] [REMOTE ] BKH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:06:53.467003] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-14T17:06:54.158854] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-09-14T17:06:54.202208] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T17:06:54.958904] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-09-14T17:06:55.300011] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-14T17:06:55.553776] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T17:06:55.758901] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-09-14T17:06:56.384572] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T17:06:56.558878] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-09-14T17:06:57.358911] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-09-14T17:06:57.443218] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-14T17:06:58.078254] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-14T17:06:58.158803] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-09-14T17:06:58.631095] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T17:06:58.958889] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-09-14T17:06:59.562198] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-14T17:06:59.758864] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-09-14T17:07:00.242340] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T17:07:00.558880] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-09-14T17:07:00.962233] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T17:07:01.358870] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-09-14T17:07:01.744795] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T17:07:02.158834] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-09-14T17:07:02.958884] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-09-14T17:07:03.058202] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-14T17:07:03.758877] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-09-14T17:07:04.016118] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T17:07:04.243560] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-14T17:07:04.558878] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-09-14T17:07:05.209563] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-14T17:07:05.358865] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-09-14T17:07:05.632785] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-14T17:07:06.158936] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-09-14T17:07:06.688162] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-14T17:07:06.785861] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T17:07:06.790455] [INFO ] [REMOTE ] BKE: Full fetch complete (38007 records). [2025-09-14T17:07:06.790735] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-09-14T17:07:06.967162] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-09-14T17:07:07.234241] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-09-14T17:07:07.234509] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-09-14T17:07:07.235375] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-09-14T17:07:07.235456] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-09-14T17:07:07.238176] [DEBUG] [LOCAL ] BKE: Trimmed 38007 records to 25219 (keeping 150 days of data) [2025-09-14T17:07:07.405981] [DEBUG] [LOCAL ] BKE: Primary data saved (25219 records). [2025-09-14T17:07:07.406210] [INFO ] [MAIN ] BKE: Full history saved. [2025-09-14T17:07:07.406363] [INFO ] [MAIN ] Update Progress: 287/2370 symbols completed. BKE took 15.9s. Estimated remaining: 3h 37m 13s. Rate: 9.6 symbols/min [2025-09-14T17:07:07.586819] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:07:07.608912] [DEBUG] [LOCAL ] BKKT: Loaded 18164 existing records from primary storage. [2025-09-14T17:07:07.609143] [INFO ] [MAIN ] BKKT: Loaded 18164 existing records. [2025-09-14T17:07:07.763843] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-09-14T17:07:07.801992] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:07:07.802374] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-09-14T17:07:07.802440] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-09-14T17:07:07.803065] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-09-14T17:07:07.803137] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-09-14T17:07:08.193139] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:07:08.563980] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-09-14T17:07:08.572952] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T17:07:08.580255] [INFO ] [REMOTE ] BK: Full fetch complete (58246 records). [2025-09-14T17:07:08.580475] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-09-14T17:07:08.981231] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-09-14T17:07:08.981398] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-09-14T17:07:08.982258] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-09-14T17:07:08.982344] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-09-14T17:07:09.011444] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-14T17:07:09.009810] [DEBUG] [LOCAL ] BK: Trimmed 58246 records to 40340 (keeping 150 days of data) [2025-09-14T17:07:09.280511] [DEBUG] [LOCAL ] BK: Primary data saved (40340 records). [2025-09-14T17:07:09.280713] [INFO ] [MAIN ] BK: Full history saved. [2025-09-14T17:07:09.280842] [INFO ] [MAIN ] Update Progress: 288/2370 symbols completed. BK took 37.4s. Estimated remaining: 3h 36m 35s. Rate: 9.6 symbols/min [2025-09-14T17:07:09.363976] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-09-14T17:07:09.458209] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:07:09.463213] [DEBUG] [LOCAL ] BKN: Loaded 2969 existing records from primary storage. [2025-09-14T17:07:09.463340] [INFO ] [MAIN ] BKN: Loaded 2969 existing records. [2025-09-14T17:07:09.654996] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:07:09.655285] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-09-14T17:07:09.655595] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-09-14T17:07:09.656067] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-09-14T17:07:09.656133] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-09-14T17:07:10.022955] [INFO ] [REMOTE ] BKN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:07:10.158848] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-09-14T17:07:10.357486] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T17:07:10.580845] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-14T17:07:10.587279] [INFO ] [REMOTE ] BKD: Full fetch complete (54343 records). [2025-09-14T17:07:10.587476] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-09-14T17:07:10.896108] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-14T17:07:10.961500] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-09-14T17:07:10.987476] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-09-14T17:07:10.987603] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-09-14T17:07:10.988284] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-09-14T17:07:10.988355] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-09-14T17:07:10.989625] [DEBUG] [LOCAL ] BKD: Trimmed 54343 records to 37868 (keeping 150 days of data) [2025-09-14T17:07:11.214703] [DEBUG] [LOCAL ] BKD: Primary data saved (37868 records). [2025-09-14T17:07:11.214878] [INFO ] [MAIN ] BKD: Full history saved. [2025-09-14T17:07:11.214979] [INFO ] [MAIN ] Update Progress: 289/2370 symbols completed. BKD took 30.0s. Estimated remaining: 3h 35m 58s. Rate: 9.6 symbols/min [2025-09-14T17:07:11.383364] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:07:11.406741] [DEBUG] [LOCAL ] BKSY: Loaded 22942 existing records from primary storage. [2025-09-14T17:07:11.406913] [INFO ] [MAIN ] BKSY: Loaded 22942 existing records. [2025-09-14T17:07:11.595006] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:07:11.595460] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-09-14T17:07:11.595529] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-09-14T17:07:11.596245] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-09-14T17:07:11.596354] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-09-14T17:07:11.779183] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-09-14T17:07:11.974735] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:07:11.999444] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-14T17:07:12.558877] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-09-14T17:07:13.358852] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-09-14T17:07:13.536445] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-14T17:07:14.158852] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-09-14T17:07:14.328246] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T17:07:14.958815] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-09-14T17:07:15.033831] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T17:07:15.105583] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T17:07:15.350512] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T17:07:15.354509] [INFO ] [REMOTE ] BKH: Full fetch complete (39500 records). [2025-09-14T17:07:15.354622] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-09-14T17:07:15.724890] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-09-14T17:07:15.725005] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-09-14T17:07:15.725771] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-09-14T17:07:15.726074] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-09-14T17:07:15.727510] [DEBUG] [LOCAL ] BKH: Trimmed 39500 records to 27760 (keeping 150 days of data) [2025-09-14T17:07:15.787231] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-09-14T17:07:15.921680] [DEBUG] [LOCAL ] BKH: Primary data saved (27760 records). [2025-09-14T17:07:15.921871] [INFO ] [MAIN ] BKH: Full history saved. [2025-09-14T17:07:15.922039] [INFO ] [MAIN ] Update Progress: 290/2370 symbols completed. BKH took 23.7s. Estimated remaining: 3h 35m 41s. Rate: 9.6 symbols/min [2025-09-14T17:07:16.094819] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:07:16.101878] [DEBUG] [LOCAL ] BKT: Loaded 4693 existing records from primary storage. [2025-09-14T17:07:16.102062] [INFO ] [MAIN ] BKT: Loaded 4693 existing records. [2025-09-14T17:07:16.281378] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:07:16.281661] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-09-14T17:07:16.281723] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-09-14T17:07:16.282122] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-09-14T17:07:16.282201] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-09-14T17:07:16.445715] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-14T17:07:16.564023] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-09-14T17:07:16.653291] [INFO ] [REMOTE ] BKT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:07:17.358866] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-09-14T17:07:17.790111] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T17:07:18.158828] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-09-14T17:07:18.958853] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-09-14T17:07:18.986548] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T17:07:19.120007] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T17:07:19.457399] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-14T17:07:19.758834] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-09-14T17:07:20.518631] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-14T17:07:20.558783] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-09-14T17:07:21.358838] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-09-14T17:07:21.423436] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-14T17:07:22.158886] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-09-14T17:07:22.816096] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T17:07:22.958834] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-09-14T17:07:23.473914] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-14T17:07:23.758821] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-09-14T17:07:24.558812] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-09-14T17:07:24.804122] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-14T17:07:24.847841] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-14T17:07:25.358835] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-09-14T17:07:25.383360] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T17:07:26.158842] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-09-14T17:07:26.178705] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T17:07:26.958855] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-09-14T17:07:26.982668] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-14T17:07:27.758873] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-09-14T17:07:28.294964] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-14T17:07:28.558775] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-09-14T17:07:28.608754] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-14T17:07:29.358864] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-09-14T17:07:29.434100] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-14T17:07:30.158840] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-09-14T17:07:30.828317] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-14T17:07:30.958839] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-09-14T17:07:31.094450] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T17:07:31.758890] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-09-14T17:07:32.558936] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-09-14T17:07:32.598965] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T17:07:33.131092] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T17:07:33.132511] [INFO ] [REMOTE ] BKN: Full fetch complete (8127 records). [2025-09-14T17:07:33.132595] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-09-14T17:07:33.369101] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-09-14T17:07:33.491803] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-09-14T17:07:33.491960] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-09-14T17:07:33.492318] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-09-14T17:07:33.492530] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-09-14T17:07:33.493307] [DEBUG] [LOCAL ] BKN: Trimmed 8127 records to 5520 (keeping 150 days of data) [2025-09-14T17:07:33.528841] [DEBUG] [LOCAL ] BKN: Primary data saved (5520 records). [2025-09-14T17:07:33.529113] [INFO ] [MAIN ] BKN: Full history saved. [2025-09-14T17:07:33.529308] [INFO ] [MAIN ] Update Progress: 291/2370 symbols completed. BKN took 24.2s. Estimated remaining: 3h 36m 56s. Rate: 9.6 symbols/min [2025-09-14T17:07:33.706253] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:07:33.739619] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-14T17:07:33.764260] [DEBUG] [LOCAL ] BKU: Loaded 18418 existing records from primary storage. [2025-09-14T17:07:33.764403] [INFO ] [MAIN ] BKU: Loaded 18418 existing records. [2025-09-14T17:07:33.950421] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:07:33.950794] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-09-14T17:07:33.950863] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-09-14T17:07:33.951595] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-09-14T17:07:33.951690] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-09-14T17:07:34.164153] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-09-14T17:07:34.317100] [INFO ] [REMOTE ] BKU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:07:34.958830] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-09-14T17:07:34.981253] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-14T17:07:34.986291] [INFO ] [REMOTE ] BKKT: Full fetch complete (35952 records). [2025-09-14T17:07:34.986472] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-09-14T17:07:35.150814] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T17:07:35.396360] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-09-14T17:07:35.396509] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-09-14T17:07:35.397470] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-09-14T17:07:35.397549] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-09-14T17:07:35.398916] [DEBUG] [LOCAL ] BKKT: Trimmed 35952 records to 25840 (keeping 150 days of data) [2025-09-14T17:07:35.556781] [DEBUG] [LOCAL ] BKKT: Primary data saved (25840 records). [2025-09-14T17:07:35.556956] [INFO ] [MAIN ] BKKT: Full history saved. [2025-09-14T17:07:35.557061] [INFO ] [MAIN ] Update Progress: 292/2370 symbols completed. BKKT took 28.2s. Estimated remaining: 3h 36m 19s. Rate: 9.6 symbols/min [2025-09-14T17:07:35.732800] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:07:35.747538] [DEBUG] [LOCAL ] BKV: Loaded 12386 existing records from primary storage. [2025-09-14T17:07:35.747776] [INFO ] [MAIN ] BKV: Loaded 12386 existing records. [2025-09-14T17:07:35.769431] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-09-14T17:07:35.935625] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:07:35.936026] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-09-14T17:07:35.936133] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-09-14T17:07:35.936823] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-09-14T17:07:35.936907] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-09-14T17:07:36.306553] [INFO ] [REMOTE ] BKV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:07:36.558846] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-09-14T17:07:36.749140] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T17:07:36.751113] [INFO ] [REMOTE ] BKT: Full fetch complete (10667 records). [2025-09-14T17:07:36.751202] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-09-14T17:07:37.124993] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-09-14T17:07:37.125145] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-09-14T17:07:37.125716] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-09-14T17:07:37.125819] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-09-14T17:07:37.126819] [DEBUG] [LOCAL ] BKT: Trimmed 10667 records to 7512 (keeping 150 days of data) [2025-09-14T17:07:37.196679] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-14T17:07:37.219751] [DEBUG] [LOCAL ] BKT: Primary data saved (7512 records). [2025-09-14T17:07:37.220007] [INFO ] [MAIN ] BKT: Full history saved. [2025-09-14T17:07:37.220179] [INFO ] [MAIN ] Update Progress: 293/2370 symbols completed. BKT took 21.3s. Estimated remaining: 3h 35m 41s. Rate: 9.6 symbols/min [2025-09-14T17:07:37.373504] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-09-14T17:07:37.412785] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:07:37.431140] [DEBUG] [LOCAL ] BLCO: Loaded 15563 existing records from primary storage. [2025-09-14T17:07:37.431366] [INFO ] [MAIN ] BLCO: Loaded 15563 existing records. [2025-09-14T17:07:37.610827] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:07:37.611085] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-09-14T17:07:37.611147] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-09-14T17:07:37.611701] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-09-14T17:07:37.611765] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-09-14T17:07:37.981242] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:07:38.005437] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T17:07:38.158859] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-09-14T17:07:38.888273] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-14T17:07:38.895619] [INFO ] [REMOTE ] BKSY: Full fetch complete (52696 records). [2025-09-14T17:07:38.895872] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-09-14T17:07:38.964029] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-09-14T17:07:39.293858] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-09-14T17:07:39.294004] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-09-14T17:07:39.294764] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-09-14T17:07:39.294830] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-09-14T17:07:39.296530] [DEBUG] [LOCAL ] BKSY: Trimmed 52696 records to 36355 (keeping 150 days of data) [2025-09-14T17:07:39.533274] [DEBUG] [LOCAL ] BKSY: Primary data saved (36355 records). [2025-09-14T17:07:39.533592] [INFO ] [MAIN ] BKSY: Full history saved. [2025-09-14T17:07:39.533756] [INFO ] [MAIN ] Update Progress: 294/2370 symbols completed. BKSY took 28.3s. Estimated remaining: 3h 35m 7s. Rate: 9.7 symbols/min [2025-09-14T17:07:39.722085] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:07:39.751053] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T17:07:39.765342] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-09-14T17:07:39.774050] [DEBUG] [LOCAL ] BLD: Loaded 13101 existing records from primary storage. [2025-09-14T17:07:39.774271] [INFO ] [MAIN ] BLD: Loaded 13101 existing records. [2025-09-14T17:07:39.962099] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:07:39.962435] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-09-14T17:07:39.962500] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-09-14T17:07:39.963084] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-09-14T17:07:39.963152] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-09-14T17:07:40.341122] [INFO ] [REMOTE ] BLD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:07:40.365717] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-14T17:07:40.558843] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-09-14T17:07:41.150074] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-14T17:07:41.358887] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-09-14T17:07:42.169493] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-09-14T17:07:42.176667] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-14T17:07:42.921321] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T17:07:42.958924] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-09-14T17:07:43.054736] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T17:07:43.758893] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-09-14T17:07:44.479705] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-14T17:07:44.558861] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-09-14T17:07:45.157514] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-14T17:07:45.358849] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-09-14T17:07:45.900180] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-14T17:07:46.158876] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-09-14T17:07:46.814037] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T17:07:46.958868] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-09-14T17:07:47.541717] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-14T17:07:47.758847] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-09-14T17:07:48.509696] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T17:07:48.558883] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-09-14T17:07:49.051446] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T17:07:49.358937] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-09-14T17:07:50.163248] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-09-14T17:07:50.170428] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T17:07:50.564157] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T17:07:50.958943] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-09-14T17:07:51.443774] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T17:07:51.758925] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-09-14T17:07:52.558898] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-09-14T17:07:52.656867] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-14T17:07:53.049091] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-14T17:07:53.358896] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-09-14T17:07:53.504259] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-14T17:07:54.158901] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-09-14T17:07:54.609928] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T17:07:54.958890] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-09-14T17:07:55.168333] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-14T17:07:55.758876] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-09-14T17:07:56.349422] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T17:07:56.558954] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-09-14T17:07:56.809076] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-14T17:07:57.346700] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-14T17:07:57.358925] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-09-14T17:07:58.158873] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-09-14T17:07:58.224893] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T17:07:58.228013] [INFO ] [REMOTE ] BKV: Full fetch complete (33426 records). [2025-09-14T17:07:58.228115] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-09-14T17:07:58.621703] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-09-14T17:07:58.621853] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-09-14T17:07:58.622476] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-09-14T17:07:58.622540] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-09-14T17:07:58.623934] [DEBUG] [LOCAL ] BKV: Trimmed 33426 records to 21330 (keeping 150 days of data) [2025-09-14T17:07:58.750561] [DEBUG] [LOCAL ] BKV: Primary data saved (21330 records). [2025-09-14T17:07:58.750744] [INFO ] [MAIN ] BKV: Full history saved. [2025-09-14T17:07:58.750870] [INFO ] [MAIN ] Update Progress: 295/2370 symbols completed. BKV took 23.2s. Estimated remaining: 3h 36m 32s. Rate: 9.6 symbols/min [2025-09-14T17:07:58.921948] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:07:58.944848] [DEBUG] [LOCAL ] BLDR: Loaded 23341 existing records from primary storage. [2025-09-14T17:07:58.945035] [INFO ] [MAIN ] BLDR: Loaded 23341 existing records. [2025-09-14T17:07:58.965687] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-09-14T17:07:59.124833] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:07:59.125111] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-09-14T17:07:59.125193] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-09-14T17:07:59.126071] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-09-14T17:07:59.126139] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-09-14T17:07:59.488382] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:07:59.581180] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-14T17:07:59.649198] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:07:59.653758] [INFO ] [REMOTE ] BKU: Full fetch complete (45197 records). [2025-09-14T17:07:59.653943] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-09-14T17:07:59.764319] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-09-14T17:08:00.050272] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-09-14T17:08:00.050381] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-09-14T17:08:00.050945] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-09-14T17:08:00.051004] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-09-14T17:08:00.051990] [DEBUG] [LOCAL ] BKU: Trimmed 45197 records to 31235 (keeping 150 days of data) [2025-09-14T17:08:00.266494] [DEBUG] [LOCAL ] BKU: Primary data saved (31235 records). [2025-09-14T17:08:00.266720] [INFO ] [MAIN ] BKU: Full history saved. [2025-09-14T17:08:00.266842] [INFO ] [MAIN ] Update Progress: 296/2370 symbols completed. BKU took 26.7s. Estimated remaining: 3h 35m 53s. Rate: 9.6 symbols/min [2025-09-14T17:08:00.446386] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:08:00.454151] [DEBUG] [LOCAL ] BLE: Loaded 5632 existing records from primary storage. [2025-09-14T17:08:00.454297] [INFO ] [MAIN ] BLE: Loaded 5632 existing records. [2025-09-14T17:08:00.564023] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-09-14T17:08:00.640109] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:08:00.640390] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-09-14T17:08:00.640457] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-09-14T17:08:00.640834] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-09-14T17:08:00.640899] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-09-14T17:08:00.995100] [INFO ] [REMOTE ] BLE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:08:01.273441] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-14T17:08:01.358859] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-09-14T17:08:02.158866] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-09-14T17:08:02.511503] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-14T17:08:02.545953] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-14T17:08:02.549379] [INFO ] [REMOTE ] BLCO: Full fetch complete (40300 records). [2025-09-14T17:08:02.549487] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-09-14T17:08:02.868236] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-14T17:08:02.954982] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-09-14T17:08:02.955135] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-09-14T17:08:02.956042] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-09-14T17:08:02.956117] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-09-14T17:08:02.957613] [DEBUG] [LOCAL ] BLCO: Trimmed 40300 records to 26908 (keeping 150 days of data) [2025-09-14T17:08:02.958854] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-09-14T17:08:03.127030] [DEBUG] [LOCAL ] BLCO: Primary data saved (26908 records). [2025-09-14T17:08:03.127245] [INFO ] [MAIN ] BLCO: Full history saved. [2025-09-14T17:08:03.127372] [INFO ] [MAIN ] Update Progress: 297/2370 symbols completed. BLCO took 25.9s. Estimated remaining: 3h 35m 23s. Rate: 9.6 symbols/min [2025-09-14T17:08:03.305177] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:08:03.323910] [DEBUG] [LOCAL ] BLK: Loaded 14357 existing records from primary storage. [2025-09-14T17:08:03.324183] [INFO ] [MAIN ] BLK: Loaded 14357 existing records. [2025-09-14T17:08:03.515865] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:08:03.516257] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-09-14T17:08:03.516322] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-09-14T17:08:03.517105] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-09-14T17:08:03.517175] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-09-14T17:08:03.764170] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-09-14T17:08:03.901481] [INFO ] [REMOTE ] BLK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:08:04.558929] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-09-14T17:08:04.883395] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T17:08:05.177529] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-14T17:08:05.358841] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-09-14T17:08:06.158842] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-09-14T17:08:06.513062] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-14T17:08:06.706729] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T17:08:06.709827] [INFO ] [REMOTE ] BLD: Full fetch complete (30856 records). [2025-09-14T17:08:06.709940] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-09-14T17:08:06.963567] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-09-14T17:08:07.085633] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-09-14T17:08:07.085893] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-09-14T17:08:07.086563] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-09-14T17:08:07.086658] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-09-14T17:08:07.087751] [DEBUG] [LOCAL ] BLD: Trimmed 30856 records to 20705 (keeping 150 days of data) [2025-09-14T17:08:07.222435] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T17:08:07.258937] [DEBUG] [LOCAL ] BLD: Primary data saved (20705 records). [2025-09-14T17:08:07.259111] [INFO ] [MAIN ] BLD: Full history saved. [2025-09-14T17:08:07.259286] [INFO ] [MAIN ] Update Progress: 298/2370 symbols completed. BLD took 27.7s. Estimated remaining: 3h 35m 2s. Rate: 9.6 symbols/min [2025-09-14T17:08:07.457316] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:08:07.478033] [DEBUG] [LOCAL ] BLND: Loaded 21744 existing records from primary storage. [2025-09-14T17:08:07.478210] [INFO ] [MAIN ] BLND: Loaded 21744 existing records. [2025-09-14T17:08:07.653942] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:08:07.654197] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-09-14T17:08:07.654258] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-09-14T17:08:07.654916] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-09-14T17:08:07.654980] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-09-14T17:08:07.763954] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-09-14T17:08:08.034464] [INFO ] [REMOTE ] BLND: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:08:08.091439] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-14T17:08:08.558855] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-09-14T17:08:09.358841] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-09-14T17:08:09.565923] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-14T17:08:09.848186] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-14T17:08:10.158880] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-09-14T17:08:10.732061] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-14T17:08:10.958863] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-09-14T17:08:11.552477] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T17:08:11.758857] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-09-14T17:08:11.983278] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T17:08:12.558839] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-09-14T17:08:13.358903] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-09-14T17:08:13.805269] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-14T17:08:14.158852] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-09-14T17:08:14.430996] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T17:08:14.487888] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T17:08:14.958858] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-09-14T17:08:15.758862] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-09-14T17:08:16.155780] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-14T17:08:16.558831] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-09-14T17:08:16.614787] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-14T17:08:16.935790] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T17:08:17.358840] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-09-14T17:08:18.129220] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-14T17:08:18.158027] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-14T17:08:18.161002] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-09-14T17:08:18.492666] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T17:08:18.498256] [INFO ] [REMOTE ] BLDR: Full fetch complete (56096 records). [2025-09-14T17:08:18.498445] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-09-14T17:08:18.888431] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-09-14T17:08:18.888593] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-09-14T17:08:18.889348] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-09-14T17:08:18.889421] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-09-14T17:08:18.890859] [DEBUG] [LOCAL ] BLDR: Trimmed 56096 records to 39059 (keeping 150 days of data) [2025-09-14T17:08:18.982832] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-09-14T17:08:19.137047] [DEBUG] [LOCAL ] BLDR: Primary data saved (39059 records). [2025-09-14T17:08:19.137224] [INFO ] [MAIN ] BLDR: Full history saved. [2025-09-14T17:08:19.137331] [INFO ] [MAIN ] Update Progress: 299/2370 symbols completed. BLDR took 20.4s. Estimated remaining: 3h 35m 35s. Rate: 9.6 symbols/min [2025-09-14T17:08:19.312054] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:08:19.322149] [DEBUG] [LOCAL ] BLSH: Loaded 8340 existing records from primary storage. [2025-09-14T17:08:19.322297] [INFO ] [MAIN ] BLSH: Loaded 8340 existing records. [2025-09-14T17:08:19.502479] [WARN ] [MAIN ] BLSH: Insufficient historical data. Have data from 2025-08-13, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:08:19.502756] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-09-14T17:08:19.502875] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-14T17:08:19.503252] [DEBUG] [LOCAL ] BLSH: Deleted primary data file. [2025-09-14T17:08:19.503313] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-09-14T17:08:19.764037] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-09-14T17:08:19.867468] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:08:20.558821] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-02. [2025-09-14T17:08:20.813370] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:08:20.813730] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-02 [2025-09-14T17:08:20.943077] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-14T17:08:21.049465] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-14T17:08:21.358815] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-09-14T17:08:22.158834] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-03. [2025-09-14T17:08:22.414624] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:08:22.415009] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-03 [2025-09-14T17:08:22.743308] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-14T17:08:22.958853] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-09-14T17:08:23.758870] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-04. [2025-09-14T17:08:23.794771] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-14T17:08:23.797373] [INFO ] [REMOTE ] BLE: Full fetch complete (15570 records). [2025-09-14T17:08:23.797494] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-09-14T17:08:24.033608] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:08:24.093512] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-04 [2025-09-14T17:08:24.173851] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-09-14T17:08:24.173960] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-09-14T17:08:24.174302] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-09-14T17:08:24.174364] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-09-14T17:08:24.174964] [DEBUG] [LOCAL ] BLE: Trimmed 15570 records to 10534 (keeping 150 days of data) [2025-09-14T17:08:24.239114] [DEBUG] [LOCAL ] BLE: Primary data saved (10534 records). [2025-09-14T17:08:24.239295] [INFO ] [MAIN ] BLE: Full history saved. [2025-09-14T17:08:24.239394] [INFO ] [MAIN ] Update Progress: 300/2370 symbols completed. BLE took 24.0s. Estimated remaining: 3h 35m 21s. Rate: 9.6 symbols/min [2025-09-14T17:08:24.415890] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:08:24.424246] [DEBUG] [LOCAL ] BLW: Loaded 5455 existing records from primary storage. [2025-09-14T17:08:24.424422] [INFO ] [MAIN ] BLW: Loaded 5455 existing records. [2025-09-14T17:08:24.568546] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-05. [2025-09-14T17:08:24.612621] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:08:24.612929] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-09-14T17:08:24.612999] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-09-14T17:08:24.613336] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-09-14T17:08:24.613398] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-09-14T17:08:24.888460] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:08:24.889091] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-05 [2025-09-14T17:08:24.965629] [INFO ] [REMOTE ] BLW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:08:25.358870] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-09-14T17:08:26.158911] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-06. [2025-09-14T17:08:26.408455] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:08:26.408819] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-06 [2025-09-14T17:08:26.958859] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-09-14T17:08:27.225051] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-14T17:08:27.758871] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-09-14T17:08:28.542912] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T17:08:28.558773] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-09-14T17:08:29.226420] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T17:08:29.358863] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-09-14T17:08:29.625482] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-14T17:08:29.629325] [INFO ] [REMOTE ] BLK: Full fetch complete (39253 records). [2025-09-14T17:08:29.629440] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-09-14T17:08:30.018848] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-09-14T17:08:30.019074] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-09-14T17:08:30.019715] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-09-14T17:08:30.019986] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-09-14T17:08:30.021458] [DEBUG] [LOCAL ] BLK: Trimmed 39253 records to 24978 (keeping 150 days of data) [2025-09-14T17:08:30.159513] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-14T17:08:30.159663] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-07. [2025-09-14T17:08:30.242231] [DEBUG] [LOCAL ] BLK: Primary data saved (24978 records). [2025-09-14T17:08:30.242435] [INFO ] [MAIN ] BLK: Full history saved. [2025-09-14T17:08:30.242544] [INFO ] [MAIN ] Update Progress: 301/2370 symbols completed. BLK took 27.1s. Estimated remaining: 3h 35m 13s. Rate: 9.6 symbols/min [2025-09-14T17:08:30.415897] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:08:30.424688] [DEBUG] [LOCAL ] BLX: Loaded 6732 existing records from primary storage. [2025-09-14T17:08:30.424837] [INFO ] [MAIN ] BLX: Loaded 6732 existing records. [2025-09-14T17:08:30.469227] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:08:30.518409] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-07 [2025-09-14T17:08:30.612941] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:08:30.613227] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-09-14T17:08:30.613295] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-14T17:08:30.613725] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-09-14T17:08:30.613788] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-09-14T17:08:30.968400] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-08. [2025-09-14T17:08:30.995814] [INFO ] [REMOTE ] BLX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:08:31.758881] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-09-14T17:08:32.390895] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-14T17:08:32.558812] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-09-14T17:08:32.628292] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T17:08:33.358844] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-09-14T17:08:34.166826] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-09. [2025-09-14T17:08:34.172883] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T17:08:34.243905] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T17:08:34.958888] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-09-14T17:08:35.758865] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-09-14T17:08:36.037543] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-14T17:08:36.258256] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-14T17:08:36.263669] [INFO ] [REMOTE ] BLSH: Full fetch complete (8329 records). [2025-09-14T17:08:36.263756] [DEBUG] [VALIDATOR ] BLSH: Validating primary data. [2025-09-14T17:08:36.448901] [WARN ] [VALIDATOR ] BLSH: Validation failed - insufficient historical data. Have 22 unique days, need 150 days [2025-09-14T17:08:36.449322] [FATAL] [MAIN ] BLSH: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:08:36.449502] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:08:36.454794] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-14T17:08:36.460111] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-14T17:08:36.460862] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-09-14T17:08:36.461587] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-14T17:08:36.461775] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-09-14T17:08:36.462014] [INFO ] [MAIN ] Update Progress: 302/2370 symbols completed. BLSH took 17.3s. Estimated remaining: 3h 35m 6s. Rate: 9.6 symbols/min [2025-09-14T17:08:36.563963] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-09-14T17:08:36.641961] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:08:36.658624] [DEBUG] [LOCAL ] BMA: Loaded 15502 existing records from primary storage. [2025-09-14T17:08:36.658822] [INFO ] [MAIN ] BMA: Loaded 15502 existing records. [2025-09-14T17:08:36.841861] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:08:36.842219] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-09-14T17:08:36.842288] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-09-14T17:08:36.843078] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-09-14T17:08:36.843151] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-09-14T17:08:37.248872] [INFO ] [REMOTE ] BMA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:08:37.358865] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-09-14T17:08:38.158787] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-09-14T17:08:38.189159] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T17:08:38.466300] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-14T17:08:38.958842] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-09-14T17:08:39.529334] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-14T17:08:39.758862] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-09-14T17:08:39.980401] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-14T17:08:40.558831] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-09-14T17:08:40.899287] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-14T17:08:41.147318] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-14T17:08:41.358828] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-09-14T17:08:42.158851] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-09-14T17:08:42.863123] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-14T17:08:42.869298] [INFO ] [REMOTE ] BLND: Full fetch complete (53899 records). [2025-09-14T17:08:42.869485] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-09-14T17:08:42.966531] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-09-14T17:08:43.217930] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-14T17:08:43.296160] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-09-14T17:08:43.296282] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-09-14T17:08:43.296992] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-09-14T17:08:43.297051] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-09-14T17:08:43.298220] [DEBUG] [LOCAL ] BLND: Trimmed 53899 records to 36755 (keeping 150 days of data) [2025-09-14T17:08:43.511700] [DEBUG] [LOCAL ] BLND: Primary data saved (36755 records). [2025-09-14T17:08:43.511912] [INFO ] [MAIN ] BLND: Full history saved. [2025-09-14T17:08:43.512036] [INFO ] [MAIN ] Update Progress: 303/2370 symbols completed. BLND took 36.3s. Estimated remaining: 3h 35m 6s. Rate: 9.6 symbols/min [2025-09-14T17:08:43.690353] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:08:43.697469] [DEBUG] [LOCAL ] BME: Loaded 5202 existing records from primary storage. [2025-09-14T17:08:43.697612] [INFO ] [MAIN ] BME: Loaded 5202 existing records. [2025-09-14T17:08:43.764050] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-09-14T17:08:43.876325] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:08:43.876613] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-09-14T17:08:43.876714] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-09-14T17:08:43.877013] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-09-14T17:08:43.877071] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-09-14T17:08:44.241828] [INFO ] [REMOTE ] BME: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:08:44.407542] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-14T17:08:44.558839] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-09-14T17:08:44.668739] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-14T17:08:45.358832] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-09-14T17:08:45.985569] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-14T17:08:46.158790] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-09-14T17:08:46.347899] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T17:08:46.661791] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-14T17:08:46.958868] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-09-14T17:08:47.758866] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-09-14T17:08:47.825418] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T17:08:48.333545] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-14T17:08:48.558859] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-09-14T17:08:49.358913] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-09-14T17:08:49.997927] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-14T17:08:50.053409] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-14T17:08:50.158986] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-09-14T17:08:50.732047] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-14T17:08:50.958883] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-09-14T17:08:51.758905] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-09-14T17:08:51.964573] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-14T17:08:52.558827] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-09-14T17:08:52.663482] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-14T17:08:53.241143] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:08:53.243367] [INFO ] [REMOTE ] BLW: Full fetch complete (14018 records). [2025-09-14T17:08:53.243462] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-09-14T17:08:53.364061] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-09-14T17:08:53.638821] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-09-14T17:08:53.638941] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-09-14T17:08:53.639364] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-09-14T17:08:53.639428] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-09-14T17:08:53.640228] [DEBUG] [LOCAL ] BLW: Trimmed 14018 records to 9026 (keeping 150 days of data) [2025-09-14T17:08:53.700294] [DEBUG] [LOCAL ] BLW: Primary data saved (9026 records). [2025-09-14T17:08:53.700511] [INFO ] [MAIN ] BLW: Full history saved. [2025-09-14T17:08:53.700703] [INFO ] [MAIN ] Update Progress: 304/2370 symbols completed. BLW took 29.5s. Estimated remaining: 3h 35m 26s. Rate: 9.6 symbols/min [2025-09-14T17:08:53.876314] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:08:53.892052] [DEBUG] [LOCAL ] BMEZ: Loaded 11083 existing records from primary storage. [2025-09-14T17:08:53.892224] [INFO ] [MAIN ] BMEZ: Loaded 11083 existing records. [2025-09-14T17:08:54.070816] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:08:54.071102] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-09-14T17:08:54.071165] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-09-14T17:08:54.071629] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-09-14T17:08:54.071733] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-09-14T17:08:54.163217] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-09-14T17:08:54.235697] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T17:08:54.263296] [INFO ] [REMOTE ] BLX: Full fetch complete (17094 records). [2025-09-14T17:08:54.301101] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-09-14T17:08:54.585534] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:08:54.851584] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-09-14T17:08:54.851749] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-09-14T17:08:54.852292] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-09-14T17:08:54.852353] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-09-14T17:08:54.853579] [DEBUG] [LOCAL ] BLX: Trimmed 17094 records to 11179 (keeping 150 days of data) [2025-09-14T17:08:54.931274] [DEBUG] [LOCAL ] BLX: Primary data saved (11179 records). [2025-09-14T17:08:54.931552] [INFO ] [MAIN ] BLX: Full history saved. [2025-09-14T17:08:54.931780] [INFO ] [MAIN ] Update Progress: 305/2370 symbols completed. BLX took 24.7s. Estimated remaining: 3h 34m 46s. Rate: 9.6 symbols/min [2025-09-14T17:08:54.965904] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-09-14T17:08:55.113149] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:08:55.127261] [DEBUG] [LOCAL ] BMI: Loaded 10899 existing records from primary storage. [2025-09-14T17:08:55.127434] [INFO ] [MAIN ] BMI: Loaded 10899 existing records. [2025-09-14T17:08:55.312236] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:08:55.312555] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-09-14T17:08:55.312620] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-09-14T17:08:55.313250] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-09-14T17:08:55.313319] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-09-14T17:08:55.682292] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-14T17:08:55.706769] [INFO ] [REMOTE ] BMI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:08:55.737988] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-14T17:08:55.758780] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-09-14T17:08:56.558924] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-09-14T17:08:56.812257] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-14T17:08:57.358934] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-09-14T17:08:57.740406] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T17:08:58.158904] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-09-14T17:08:58.499468] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T17:08:58.958846] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-09-14T17:08:59.052507] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T17:08:59.758954] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-09-14T17:08:59.837524] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T17:09:00.558848] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-09-14T17:09:01.111068] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-14T17:09:01.115978] [INFO ] [REMOTE ] BMA: Full fetch complete (37642 records). [2025-09-14T17:09:01.116125] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-09-14T17:09:01.364291] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-09-14T17:09:01.547010] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-09-14T17:09:01.547120] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-09-14T17:09:01.547773] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-09-14T17:09:01.547840] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-09-14T17:09:01.548980] [DEBUG] [LOCAL ] BMA: Trimmed 37642 records to 25819 (keeping 150 days of data) [2025-09-14T17:09:01.718325] [DEBUG] [LOCAL ] BMA: Primary data saved (25819 records). [2025-09-14T17:09:01.718521] [INFO ] [MAIN ] BMA: Full history saved. [2025-09-14T17:09:01.718670] [INFO ] [MAIN ] Update Progress: 306/2370 symbols completed. BMA took 25.3s. Estimated remaining: 3h 34m 43s. Rate: 9.6 symbols/min [2025-09-14T17:09:01.911618] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:09:01.934978] [DEBUG] [LOCAL ] BMN: Loaded 1221 existing records from primary storage. [2025-09-14T17:09:01.937305] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T17:09:01.937453] [INFO ] [MAIN ] BMN: Loaded 1221 existing records. [2025-09-14T17:09:02.120203] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:09:02.120470] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-09-14T17:09:02.120532] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-14T17:09:02.120769] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-09-14T17:09:02.120830] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-09-14T17:09:02.164016] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-09-14T17:09:02.490755] [INFO ] [REMOTE ] BMN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:09:02.958877] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-09-14T17:09:03.409931] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-14T17:09:03.758851] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-09-14T17:09:04.558854] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-09-14T17:09:04.611546] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-14T17:09:04.724077] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-14T17:09:05.032688] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-14T17:09:05.358821] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-09-14T17:09:05.456435] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-14T17:09:06.158881] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-09-14T17:09:06.677073] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-14T17:09:06.958859] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-09-14T17:09:07.010481] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-14T17:09:07.758855] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-09-14T17:09:08.010457] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-14T17:09:08.558837] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-09-14T17:09:08.828286] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T17:09:09.358801] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-09-14T17:09:09.814391] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T17:09:10.158896] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-09-14T17:09:10.795747] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-14T17:09:10.816405] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T17:09:10.958873] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-09-14T17:09:11.491413] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-14T17:09:11.758903] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-09-14T17:09:12.558906] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-09-14T17:09:12.627336] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T17:09:13.358856] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-09-14T17:09:14.076672] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-14T17:09:14.158838] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-09-14T17:09:14.388799] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T17:09:14.494800] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-14T17:09:14.958848] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-09-14T17:09:15.538166] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T17:09:15.541587] [INFO ] [REMOTE ] BMI: Full fetch complete (25136 records). [2025-09-14T17:09:15.541723] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-09-14T17:09:15.761868] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-09-14T17:09:15.960517] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-09-14T17:09:15.960628] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-09-14T17:09:15.961070] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-09-14T17:09:15.961126] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-09-14T17:09:15.961907] [DEBUG] [LOCAL ] BMI: Trimmed 25136 records to 17696 (keeping 150 days of data) [2025-09-14T17:09:16.084377] [DEBUG] [LOCAL ] BMI: Primary data saved (17696 records). [2025-09-14T17:09:16.084606] [INFO ] [MAIN ] BMI: Full history saved. [2025-09-14T17:09:16.084748] [INFO ] [MAIN ] Update Progress: 307/2370 symbols completed. BMI took 21.2s. Estimated remaining: 3h 35m 32s. Rate: 9.6 symbols/min [2025-09-14T17:09:16.265315] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:09:16.286429] [DEBUG] [LOCAL ] BMO: Loaded 18430 existing records from primary storage. [2025-09-14T17:09:16.286605] [INFO ] [MAIN ] BMO: Loaded 18430 existing records. [2025-09-14T17:09:16.395725] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-14T17:09:16.479771] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:09:16.480050] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-09-14T17:09:16.480114] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-09-14T17:09:16.480827] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-09-14T17:09:16.480892] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-09-14T17:09:16.564004] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-09-14T17:09:16.840147] [INFO ] [REMOTE ] BMO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:09:17.358877] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-09-14T17:09:17.822470] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T17:09:18.158881] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-09-14T17:09:18.575794] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-14T17:09:18.654680] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T17:09:18.655736] [INFO ] [REMOTE ] BMN: Full fetch complete (2760 records). [2025-09-14T17:09:18.655852] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-09-14T17:09:18.964025] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-09-14T17:09:19.022238] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-09-14T17:09:19.022353] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-09-14T17:09:19.022487] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-09-14T17:09:19.022539] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-09-14T17:09:19.022931] [DEBUG] [LOCAL ] BMN: Trimmed 2760 records to 1921 (keeping 150 days of data) [2025-09-14T17:09:19.035930] [DEBUG] [LOCAL ] BMN: Primary data saved (1921 records). [2025-09-14T17:09:19.036015] [INFO ] [MAIN ] BMN: Full history saved. [2025-09-14T17:09:19.036105] [INFO ] [MAIN ] Update Progress: 308/2370 symbols completed. BMN took 17.3s. Estimated remaining: 3h 35m 3s. Rate: 9.6 symbols/min [2025-09-14T17:09:19.202983] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:09:19.226927] [DEBUG] [LOCAL ] BMY: Loaded 24117 existing records from primary storage. [2025-09-14T17:09:19.227109] [INFO ] [MAIN ] BMY: Loaded 24117 existing records. [2025-09-14T17:09:19.399790] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:09:19.400038] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-09-14T17:09:19.400099] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-09-14T17:09:19.400805] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-09-14T17:09:19.400869] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-09-14T17:09:19.764045] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-09-14T17:09:19.803710] [INFO ] [REMOTE ] BMY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:09:19.811545] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-14T17:09:19.815860] [INFO ] [REMOTE ] BME: Full fetch complete (11374 records). [2025-09-14T17:09:19.816060] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-09-14T17:09:20.188934] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-09-14T17:09:20.189051] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-09-14T17:09:20.189366] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-09-14T17:09:20.189419] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-09-14T17:09:20.189926] [DEBUG] [LOCAL ] BME: Trimmed 11374 records to 8191 (keeping 150 days of data) [2025-09-14T17:09:20.242630] [DEBUG] [LOCAL ] BME: Primary data saved (8191 records). [2025-09-14T17:09:20.242836] [INFO ] [MAIN ] BME: Full history saved. [2025-09-14T17:09:20.242935] [INFO ] [MAIN ] Update Progress: 309/2370 symbols completed. BME took 36.7s. Estimated remaining: 3h 34m 23s. Rate: 9.6 symbols/min [2025-09-14T17:09:20.413707] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:09:20.440380] [DEBUG] [LOCAL ] BN: Loaded 23725 existing records from primary storage. [2025-09-14T17:09:20.440567] [INFO ] [MAIN ] BN: Loaded 23725 existing records. [2025-09-14T17:09:20.564006] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-09-14T17:09:20.618000] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:09:20.618217] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-09-14T17:09:20.618279] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-09-14T17:09:20.618914] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-09-14T17:09:20.618979] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-09-14T17:09:20.767301] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T17:09:20.873683] [INFO ] [REMOTE ] BMEZ: Full fetch complete (28434 records). [2025-09-14T17:09:20.905284] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-09-14T17:09:21.080769] [INFO ] [REMOTE ] BN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:09:21.360968] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-09-14T17:09:21.368673] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-09-14T17:09:21.369532] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-09-14T17:09:21.370119] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-09-14T17:09:21.370226] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-09-14T17:09:21.371207] [DEBUG] [LOCAL ] BMEZ: Trimmed 28434 records to 18009 (keeping 150 days of data) [2025-09-14T17:09:21.486512] [DEBUG] [LOCAL ] BMEZ: Primary data saved (18009 records). [2025-09-14T17:09:21.486746] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-09-14T17:09:21.486927] [INFO ] [MAIN ] Update Progress: 310/2370 symbols completed. BMEZ took 27.8s. Estimated remaining: 3h 33m 44s. Rate: 9.6 symbols/min [2025-09-14T17:09:21.661787] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:09:21.675895] [DEBUG] [LOCAL ] BNED: Loaded 13524 existing records from primary storage. [2025-09-14T17:09:21.676052] [INFO ] [MAIN ] BNED: Loaded 13524 existing records. [2025-09-14T17:09:21.850548] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:09:21.850869] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-09-14T17:09:21.850948] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-09-14T17:09:21.851411] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-09-14T17:09:21.851472] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-09-14T17:09:22.174743] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-09-14T17:09:22.213264] [INFO ] [REMOTE ] BNED: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:09:22.605853] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-14T17:09:22.958853] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-09-14T17:09:23.133865] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T17:09:23.758853] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-09-14T17:09:23.845587] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T17:09:23.890361] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-14T17:09:24.558897] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-09-14T17:09:25.358840] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-09-14T17:09:25.931125] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-14T17:09:25.939921] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-14T17:09:26.158852] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-09-14T17:09:26.958861] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-09-14T17:09:27.434733] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-14T17:09:27.758925] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-09-14T17:09:28.135919] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T17:09:28.216851] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-14T17:09:28.558840] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-09-14T17:09:29.358893] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-09-14T17:09:29.821746] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-14T17:09:29.998497] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-14T17:09:30.158861] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-09-14T17:09:30.958918] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-09-14T17:09:31.255571] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T17:09:31.291763] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-14T17:09:31.758898] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-09-14T17:09:32.458007] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T17:09:32.558791] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-09-14T17:09:32.651702] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-14T17:09:33.358827] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-09-14T17:09:33.847698] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-14T17:09:34.158842] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-09-14T17:09:34.958813] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-09-14T17:09:35.213211] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T17:09:35.739157] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-14T17:09:35.758782] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-09-14T17:09:36.558830] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-09-14T17:09:37.018322] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-14T17:09:37.166037] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-14T17:09:37.170943] [INFO ] [REMOTE ] BMO: Full fetch complete (44899 records). [2025-09-14T17:09:37.171095] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-09-14T17:09:37.363927] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-09-14T17:09:37.555934] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-09-14T17:09:37.556100] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-09-14T17:09:37.556754] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-09-14T17:09:37.556824] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-09-14T17:09:37.572717] [DEBUG] [LOCAL ] BMO: Trimmed 44899 records to 30336 (keeping 150 days of data) [2025-09-14T17:09:37.573287] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-14T17:09:37.766493] [DEBUG] [LOCAL ] BMO: Primary data saved (30336 records). [2025-09-14T17:09:37.766695] [INFO ] [MAIN ] BMO: Full history saved. [2025-09-14T17:09:37.766830] [INFO ] [MAIN ] Update Progress: 311/2370 symbols completed. BMO took 21.7s. Estimated remaining: 3h 34m 44s. Rate: 9.6 symbols/min [2025-09-14T17:09:37.939981] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:09:37.943509] [DEBUG] [LOCAL ] BNH: Loaded 1790 existing records from primary storage. [2025-09-14T17:09:37.943601] [INFO ] [MAIN ] BNH: Loaded 1790 existing records. [2025-09-14T17:09:38.119767] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:09:38.120052] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-09-14T17:09:38.120132] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-09-14T17:09:38.120397] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-09-14T17:09:38.120494] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-09-14T17:09:38.163984] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-09-14T17:09:38.475733] [INFO ] [REMOTE ] BNH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:09:38.958844] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-09-14T17:09:39.711142] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-14T17:09:39.750038] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T17:09:39.759047] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-09-14T17:09:40.558831] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-09-14T17:09:40.883419] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T17:09:40.920165] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T17:09:41.151600] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-14T17:09:41.358824] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-09-14T17:09:42.158843] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-09-14T17:09:42.958790] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-09-14T17:09:43.245874] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-14T17:09:43.248907] [INFO ] [REMOTE ] BNED: Full fetch complete (32413 records). [2025-09-14T17:09:43.249003] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-09-14T17:09:43.415146] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-14T17:09:43.659079] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-09-14T17:09:43.659446] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-09-14T17:09:43.660213] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-09-14T17:09:43.661960] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-14T17:09:43.662120] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-09-14T17:09:43.674574] [DEBUG] [LOCAL ] BNED: Trimmed 32413 records to 22113 (keeping 150 days of data) [2025-09-14T17:09:43.760232] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-09-14T17:09:43.807253] [DEBUG] [LOCAL ] BNED: Primary data saved (22113 records). [2025-09-14T17:09:43.807402] [INFO ] [MAIN ] BNED: Full history saved. [2025-09-14T17:09:43.807498] [INFO ] [MAIN ] Update Progress: 312/2370 symbols completed. BNED took 22.3s. Estimated remaining: 3h 34m 36s. Rate: 9.6 symbols/min [2025-09-14T17:09:43.975664] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:09:43.978370] [DEBUG] [LOCAL ] BNJ: Loaded 1058 existing records from primary storage. [2025-09-14T17:09:43.978458] [INFO ] [MAIN ] BNJ: Loaded 1058 existing records. [2025-09-14T17:09:44.154988] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:09:44.155210] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-09-14T17:09:44.155268] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-09-14T17:09:44.155569] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-09-14T17:09:44.155660] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-09-14T17:09:44.502488] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:09:44.558773] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-09-14T17:09:45.052850] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-14T17:09:45.358856] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-09-14T17:09:45.691348] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-14T17:09:46.158873] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-09-14T17:09:46.810020] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-14T17:09:46.958921] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-09-14T17:09:47.524877] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-14T17:09:47.749261] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-14T17:09:47.758767] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-09-14T17:09:48.448229] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-14T17:09:48.558880] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-09-14T17:09:49.358903] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-09-14T17:09:49.863717] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-14T17:09:49.871805] [INFO ] [REMOTE ] BN: Full fetch complete (57637 records). [2025-09-14T17:09:49.872059] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-09-14T17:09:49.977871] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T17:09:50.164764] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-09-14T17:09:50.258988] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-09-14T17:09:50.259090] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-09-14T17:09:50.259792] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-09-14T17:09:50.259855] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-09-14T17:09:50.261114] [DEBUG] [LOCAL ] BN: Trimmed 57637 records to 39788 (keeping 150 days of data) [2025-09-14T17:09:50.516438] [DEBUG] [LOCAL ] BN: Primary data saved (39788 records). [2025-09-14T17:09:50.516717] [INFO ] [MAIN ] BN: Full history saved. [2025-09-14T17:09:50.516812] [INFO ] [MAIN ] Update Progress: 313/2370 symbols completed. BN took 30.3s. Estimated remaining: 3h 34m 33s. Rate: 9.6 symbols/min [2025-09-14T17:09:50.686192] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:09:50.705948] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T17:09:50.711924] [INFO ] [REMOTE ] BMY: Full fetch complete (58437 records). [2025-09-14T17:09:50.712112] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-09-14T17:09:50.839839] [DEBUG] [LOCAL ] BNL: Loaded 21001 existing records from primary storage. [2025-09-14T17:09:50.869227] [INFO ] [MAIN ] BNL: Loaded 21001 existing records. [2025-09-14T17:09:50.960989] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-09-14T17:09:51.271296] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:09:51.294102] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-09-14T17:09:51.309790] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-09-14T17:09:51.309671] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-09-14T17:09:51.310094] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-09-14T17:09:51.311050] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-09-14T17:09:51.311001] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-09-14T17:09:51.311218] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-09-14T17:09:51.316468] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-09-14T17:09:51.438445] [DEBUG] [LOCAL ] BMY: Trimmed 58437 records to 40497 (keeping 150 days of data) [2025-09-14T17:09:51.779058] [INFO ] [REMOTE ] BNL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:09:51.774723] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-09-14T17:09:51.787109] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-14T17:09:51.964562] [DEBUG] [LOCAL ] BMY: Primary data saved (40497 records). [2025-09-14T17:09:51.964810] [INFO ] [MAIN ] BMY: Full history saved. [2025-09-14T17:09:51.964929] [INFO ] [MAIN ] Update Progress: 314/2370 symbols completed. BMY took 32.9s. Estimated remaining: 3h 33m 55s. Rate: 9.6 symbols/min [2025-09-14T17:09:52.144102] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:09:52.168917] [DEBUG] [LOCAL ] BNS: Loaded 22904 existing records from primary storage. [2025-09-14T17:09:52.169138] [INFO ] [MAIN ] BNS: Loaded 22904 existing records. [2025-09-14T17:09:52.350607] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:09:52.350933] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-09-14T17:09:52.351026] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-09-14T17:09:52.351932] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-09-14T17:09:52.352002] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-09-14T17:09:52.491965] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-14T17:09:52.564039] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-09-14T17:09:52.736432] [INFO ] [REMOTE ] BNS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:09:53.358860] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-09-14T17:09:53.945017] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-14T17:09:54.135132] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T17:09:54.158784] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-09-14T17:09:54.958831] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-09-14T17:09:55.701382] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-14T17:09:55.758833] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-09-14T17:09:56.409281] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-14T17:09:56.558897] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-09-14T17:09:56.735433] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T17:09:56.948129] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T17:09:56.949446] [INFO ] [REMOTE ] BNH: Full fetch complete (5147 records). [2025-09-14T17:09:56.949550] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-09-14T17:09:57.332808] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-09-14T17:09:57.332945] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-09-14T17:09:57.333173] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-09-14T17:09:57.333229] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-09-14T17:09:57.333728] [DEBUG] [LOCAL ] BNH: Trimmed 5147 records to 3202 (keeping 150 days of data) [2025-09-14T17:09:57.354784] [DEBUG] [LOCAL ] BNH: Primary data saved (3202 records). [2025-09-14T17:09:57.354937] [INFO ] [MAIN ] BNH: Full history saved. [2025-09-14T17:09:57.355067] [INFO ] [MAIN ] Update Progress: 315/2370 symbols completed. BNH took 19.6s. Estimated remaining: 3h 33m 44s. Rate: 9.6 symbols/min [2025-09-14T17:09:57.366695] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-09-14T17:09:57.537778] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:09:57.541999] [DEBUG] [LOCAL ] BNT: Loaded 1305 existing records from primary storage. [2025-09-14T17:09:57.542156] [INFO ] [MAIN ] BNT: Loaded 1305 existing records. [2025-09-14T17:09:57.725293] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:09:57.725691] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-09-14T17:09:57.725787] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-09-14T17:09:57.726109] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-09-14T17:09:57.726174] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-09-14T17:09:58.104573] [INFO ] [REMOTE ] BNT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:09:58.158874] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-09-14T17:09:58.726868] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-14T17:09:58.958861] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-09-14T17:09:59.317476] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T17:09:59.443400] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-14T17:09:59.758855] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-09-14T17:10:00.089928] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-14T17:10:00.558839] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-09-14T17:10:00.965383] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T17:10:00.966419] [INFO ] [REMOTE ] BNJ: Full fetch complete (2885 records). [2025-09-14T17:10:00.966504] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-09-14T17:10:01.358336] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-09-14T17:10:01.358552] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-09-14T17:10:01.358934] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-09-14T17:10:01.359187] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-09-14T17:10:01.361004] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-09-14T17:10:01.363638] [DEBUG] [LOCAL ] BNJ: Trimmed 2885 records to 1751 (keeping 150 days of data) [2025-09-14T17:10:01.387422] [DEBUG] [LOCAL ] BNJ: Primary data saved (1751 records). [2025-09-14T17:10:01.387731] [INFO ] [MAIN ] BNJ: Full history saved. [2025-09-14T17:10:01.387953] [INFO ] [MAIN ] Update Progress: 316/2370 symbols completed. BNJ took 17.6s. Estimated remaining: 3h 33m 23s. Rate: 9.6 symbols/min [2025-09-14T17:10:01.640162] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:10:01.646951] [DEBUG] [LOCAL ] BNY: Loaded 3376 existing records from primary storage. [2025-09-14T17:10:01.647161] [INFO ] [MAIN ] BNY: Loaded 3376 existing records. [2025-09-14T17:10:01.938120] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:10:01.938721] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-09-14T17:10:01.938811] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-09-14T17:10:01.939308] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-09-14T17:10:01.939385] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-09-14T17:10:02.111818] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-14T17:10:02.164112] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-09-14T17:10:02.554070] [INFO ] [REMOTE ] BNY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:10:02.958896] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-09-14T17:10:03.758848] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-09-14T17:10:04.066798] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-14T17:10:04.408072] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-14T17:10:04.547496] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T17:10:04.558874] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-09-14T17:10:05.267515] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-14T17:10:05.358830] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-09-14T17:10:06.158870] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-09-14T17:10:06.958898] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-09-14T17:10:06.981820] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T17:10:07.206700] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T17:10:07.747632] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-14T17:10:07.758772] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-09-14T17:10:08.260021] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-14T17:10:08.558889] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-09-14T17:10:09.358889] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-09-14T17:10:10.067050] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-14T17:10:10.158847] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-09-14T17:10:10.316737] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-14T17:10:10.507540] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-14T17:10:10.958886] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-09-14T17:10:11.758907] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-09-14T17:10:12.551440] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-14T17:10:12.558770] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-09-14T17:10:12.591914] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T17:10:13.358873] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-09-14T17:10:13.372398] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-14T17:10:14.158873] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-09-14T17:10:14.652027] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-14T17:10:14.958895] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-09-14T17:10:15.001146] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T17:10:15.758844] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-09-14T17:10:16.210230] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-14T17:10:16.211808] [INFO ] [REMOTE ] BNT: Full fetch complete (3475 records). [2025-09-14T17:10:16.211915] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-09-14T17:10:16.558948] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-09-14T17:10:16.579236] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-09-14T17:10:16.580128] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-09-14T17:10:16.580288] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-09-14T17:10:16.580501] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-09-14T17:10:16.581195] [DEBUG] [LOCAL ] BNT: Trimmed 3475 records to 2113 (keeping 150 days of data) [2025-09-14T17:10:16.594633] [DEBUG] [LOCAL ] BNT: Primary data saved (2113 records). [2025-09-14T17:10:16.594745] [INFO ] [MAIN ] BNT: Full history saved. [2025-09-14T17:10:16.594901] [INFO ] [MAIN ] Update Progress: 317/2370 symbols completed. BNT took 19.2s. Estimated remaining: 3h 34m 15s. Rate: 9.6 symbols/min [2025-09-14T17:10:16.660596] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-14T17:10:17.358942] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-09-14T17:10:18.158796] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-09-14T17:10:18.234158] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-14T17:10:18.958892] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-09-14T17:10:18.984738] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T17:10:19.299473] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-14T17:10:19.758916] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-09-14T17:10:20.458199] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-14T17:10:20.463236] [INFO ] [REMOTE ] BNL: Full fetch complete (50748 records). [2025-09-14T17:10:20.463398] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-09-14T17:10:20.564820] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-09-14T17:10:20.857513] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-09-14T17:10:20.857674] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-09-14T17:10:20.858380] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-09-14T17:10:20.858445] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-09-14T17:10:20.859778] [DEBUG] [LOCAL ] BNL: Trimmed 50748 records to 35098 (keeping 150 days of data) [2025-09-14T17:10:21.082170] [DEBUG] [LOCAL ] BNL: Primary data saved (35098 records). [2025-09-14T17:10:21.082338] [INFO ] [MAIN ] BNL: Full history saved. [2025-09-14T17:10:21.082440] [INFO ] [MAIN ] Update Progress: 318/2370 symbols completed. BNL took 30.6s. Estimated remaining: 3h 33m 57s. Rate: 9.6 symbols/min [2025-09-14T17:10:21.141604] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-14T17:10:21.358828] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-09-14T17:10:21.622200] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T17:10:22.158866] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-09-14T17:10:22.180882] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T17:10:22.958888] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-09-14T17:10:23.617309] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T17:10:23.618844] [INFO ] [REMOTE ] BNY: Full fetch complete (7738 records). [2025-09-14T17:10:23.618952] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-09-14T17:10:24.000400] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-14T17:10:24.028814] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-09-14T17:10:24.035491] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-09-14T17:10:24.036223] [INFO ] [REMOTE ] BNS: Full fetch complete (55920 records). [2025-09-14T17:10:24.036095] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-09-14T17:10:24.036385] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-09-14T17:10:24.036464] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-09-14T17:10:24.051559] [DEBUG] [LOCAL ] BNY: Trimmed 7738 records to 5302 (keeping 150 days of data) [2025-09-14T17:10:24.202401] [DEBUG] [LOCAL ] BNY: Primary data saved (5302 records). [2025-09-14T17:10:24.229080] [INFO ] [MAIN ] BNY: Full history saved. [2025-09-14T17:10:24.278599] [INFO ] [MAIN ] Update Progress: 319/2370 symbols completed. BNY took 22.9s. Estimated remaining: 3h 33m 31s. Rate: 9.6 symbols/min [2025-09-14T17:10:24.530435] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-09-14T17:10:24.530585] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-09-14T17:10:24.531409] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-09-14T17:10:24.531475] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-09-14T17:10:24.533307] [DEBUG] [LOCAL ] BNS: Trimmed 55920 records to 38577 (keeping 150 days of data) [2025-09-14T17:10:24.785522] [DEBUG] [LOCAL ] BNS: Primary data saved (38577 records). [2025-09-14T17:10:24.785804] [INFO ] [MAIN ] BNS: Full history saved. [2025-09-14T17:10:24.785971] [INFO ] [MAIN ] Update Progress: 320/2370 symbols completed. BNS took 32.8s. Estimated remaining: 3h 32m 48s. Rate: 9.6 symbols/min [2025-09-14T17:10:25.437132] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:10:25.512865] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:10:25.564921] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:10:25.545004] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:10:25.581589] [DEBUG] [LOCAL ] BOC: Loaded 8543 existing records from primary storage. [2025-09-14T17:10:25.581988] [INFO ] [MAIN ] BOC: Loaded 8543 existing records. [2025-09-14T17:10:25.672031] [DEBUG] [LOCAL ] BOE: Loaded 7069 existing records from primary storage. [2025-09-14T17:10:25.678159] [DEBUG] [LOCAL ] BOH: Loaded 13627 existing records from primary storage. [2025-09-14T17:10:25.693930] [INFO ] [MAIN ] BOE: Loaded 7069 existing records. [2025-09-14T17:10:25.705628] [DEBUG] [LOCAL ] BOND: Loaded 14395 existing records from primary storage. [2025-09-14T17:10:25.709181] [INFO ] [MAIN ] BOH: Loaded 13627 existing records. [2025-09-14T17:10:25.720044] [INFO ] [MAIN ] BOND: Loaded 14395 existing records. [2025-09-14T17:10:26.057795] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:10:26.142189] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-09-14T17:10:26.223974] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:10:26.362140] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:10:26.362345] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-14T17:10:26.377882] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-09-14T17:10:26.378106] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:10:26.379082] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-09-14T17:10:26.379462] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-09-14T17:10:26.379364] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-09-14T17:10:26.380013] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-09-14T17:10:26.379893] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-09-14T17:10:26.379132] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-09-14T17:10:26.380201] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-09-14T17:10:26.380365] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-09-14T17:10:26.380518] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-09-14T17:10:26.380681] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-09-14T17:10:26.391238] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-09-14T17:10:26.421385] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-09-14T17:10:26.442973] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-09-14T17:10:27.866408] [INFO ] [REMOTE ] BOH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:10:27.883854] [INFO ] [REMOTE ] BOE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:10:27.926258] [INFO ] [REMOTE ] BOC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:10:27.937807] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-09-14T17:10:27.983978] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-09-14T17:10:27.943515] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-09-14T17:10:28.008451] [INFO ] [REMOTE ] BOND: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:10:28.009764] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-09-14T17:10:28.921735] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-14T17:10:28.925234] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-09-14T17:10:29.127906] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-14T17:10:29.132090] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-09-14T17:10:29.296754] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-14T17:10:29.306211] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-09-14T17:10:29.337838] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T17:10:29.358813] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-09-14T17:10:29.956842] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T17:10:29.973627] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T17:10:30.158906] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-09-14T17:10:30.404037] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T17:10:30.818036] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T17:10:30.958785] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-09-14T17:10:31.345321] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T17:10:31.758876] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-09-14T17:10:32.558806] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-09-14T17:10:32.610403] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-14T17:10:32.698925] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-14T17:10:33.358854] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-09-14T17:10:34.001823] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-14T17:10:34.158841] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-09-14T17:10:34.362477] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-14T17:10:34.958829] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-09-14T17:10:35.177199] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T17:10:35.758798] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-09-14T17:10:36.146167] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T17:10:36.558838] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-09-14T17:10:36.806754] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-14T17:10:37.358840] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-09-14T17:10:38.013881] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T17:10:38.158846] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-09-14T17:10:38.289121] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T17:10:38.958829] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-09-14T17:10:39.517178] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-14T17:10:39.758861] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-09-14T17:10:39.851176] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-14T17:10:40.558834] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-09-14T17:10:41.018452] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T17:10:41.163618] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-14T17:10:41.358826] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-09-14T17:10:42.158833] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-09-14T17:10:42.477330] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-14T17:10:42.958827] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-09-14T17:10:43.199368] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-14T17:10:43.507033] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T17:10:43.510457] [INFO ] [REMOTE ] BOH: Full fetch complete (33769 records). [2025-09-14T17:10:43.510586] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-09-14T17:10:43.763929] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-09-14T17:10:43.892580] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-09-14T17:10:43.892706] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-09-14T17:10:43.893258] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-09-14T17:10:43.893323] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-09-14T17:10:43.894264] [DEBUG] [LOCAL ] BOH: Trimmed 33769 records to 22443 (keeping 150 days of data) [2025-09-14T17:10:44.034427] [DEBUG] [LOCAL ] BOH: Primary data saved (22443 records). [2025-09-14T17:10:44.034593] [INFO ] [MAIN ] BOH: Full history saved. [2025-09-14T17:10:44.034710] [INFO ] [MAIN ] Update Progress: 321/2370 symbols completed. BOH took 19.2s. Estimated remaining: 3h 34m 5s. Rate: 9.6 symbols/min [2025-09-14T17:10:44.201764] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:10:44.219314] [DEBUG] [LOCAL ] BOOT: Loaded 16710 existing records from primary storage. [2025-09-14T17:10:44.219487] [INFO ] [MAIN ] BOOT: Loaded 16710 existing records. [2025-09-14T17:10:44.397702] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:10:44.398021] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-09-14T17:10:44.398091] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-09-14T17:10:44.398612] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-09-14T17:10:44.398700] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-09-14T17:10:44.568936] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-09-14T17:10:44.752969] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:10:44.956344] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-14T17:10:45.358802] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-09-14T17:10:45.581273] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-14T17:10:45.583912] [INFO ] [REMOTE ] BOE: Full fetch complete (19000 records). [2025-09-14T17:10:45.584003] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-09-14T17:10:45.941421] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-09-14T17:10:45.941529] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-09-14T17:10:45.941927] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-09-14T17:10:45.941997] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-09-14T17:10:45.942675] [DEBUG] [LOCAL ] BOE: Trimmed 19000 records to 12245 (keeping 150 days of data) [2025-09-14T17:10:46.020456] [DEBUG] [LOCAL ] BOE: Primary data saved (12245 records). [2025-09-14T17:10:46.020670] [INFO ] [MAIN ] BOE: Full history saved. [2025-09-14T17:10:46.020797] [INFO ] [MAIN ] Update Progress: 322/2370 symbols completed. BOE took 21.2s. Estimated remaining: 3h 33m 32s. Rate: 9.6 symbols/min [2025-09-14T17:10:46.167813] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-09-14T17:10:46.192406] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:10:46.215140] [DEBUG] [LOCAL ] BORR: Loaded 22857 existing records from primary storage. [2025-09-14T17:10:46.215311] [INFO ] [MAIN ] BORR: Loaded 22857 existing records. [2025-09-14T17:10:46.390969] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:10:46.391251] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-09-14T17:10:46.391317] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-09-14T17:10:46.392021] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-09-14T17:10:46.392098] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-09-14T17:10:46.742133] [INFO ] [REMOTE ] BORR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:10:46.774847] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-14T17:10:46.958902] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-09-14T17:10:47.758809] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-09-14T17:10:47.840348] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T17:10:48.312508] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T17:10:48.558855] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-09-14T17:10:49.015478] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T17:10:49.358788] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-09-14T17:10:49.749390] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-14T17:10:49.754062] [INFO ] [REMOTE ] BOND: Full fetch complete (34693 records). [2025-09-14T17:10:49.754206] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-09-14T17:10:50.148375] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-09-14T17:10:50.148512] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-09-14T17:10:50.149157] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-09-14T17:10:50.149219] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-09-14T17:10:50.150468] [DEBUG] [LOCAL ] BOND: Trimmed 34693 records to 23942 (keeping 150 days of data) [2025-09-14T17:10:50.207390] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-09-14T17:10:50.323320] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-14T17:10:50.327544] [INFO ] [REMOTE ] BOC: Full fetch complete (19652 records). [2025-09-14T17:10:50.328491] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-09-14T17:10:50.361715] [DEBUG] [LOCAL ] BOND: Primary data saved (23942 records). [2025-09-14T17:10:50.426755] [INFO ] [MAIN ] BOND: Full history saved. [2025-09-14T17:10:50.454608] [INFO ] [MAIN ] Update Progress: 323/2370 symbols completed. BOND took 25.7s. Estimated remaining: 3h 33m 14s. Rate: 9.6 symbols/min [2025-09-14T17:10:50.834785] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:10:50.903782] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-09-14T17:10:50.903891] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-09-14T17:10:50.904329] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-09-14T17:10:50.904397] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-09-14T17:10:50.905903] [DEBUG] [LOCAL ] BOC: Trimmed 19652 records to 13587 (keeping 150 days of data) [2025-09-14T17:10:50.968270] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-09-14T17:10:50.983702] [DEBUG] [LOCAL ] BOW: Loaded 9565 existing records from primary storage. [2025-09-14T17:10:50.989245] [INFO ] [MAIN ] BOW: Loaded 9565 existing records. [2025-09-14T17:10:51.022002] [DEBUG] [LOCAL ] BOC: Primary data saved (13587 records). [2025-09-14T17:10:51.045006] [INFO ] [MAIN ] BOC: Full history saved. [2025-09-14T17:10:51.074773] [INFO ] [MAIN ] Update Progress: 324/2370 symbols completed. BOC took 26.3s. Estimated remaining: 3h 32m 32s. Rate: 9.6 symbols/min [2025-09-14T17:10:51.310092] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:10:51.351881] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-09-14T17:10:51.369835] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:10:51.369969] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-09-14T17:10:51.370794] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-09-14T17:10:51.370895] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-09-14T17:10:51.644743] [DEBUG] [LOCAL ] BOX: Loaded 22525 existing records from primary storage. [2025-09-14T17:10:51.661348] [INFO ] [MAIN ] BOX: Loaded 22525 existing records. [2025-09-14T17:10:51.899518] [INFO ] [REMOTE ] BOW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:10:51.915667] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-09-14T17:10:51.974351] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:10:51.974800] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-09-14T17:10:51.974876] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-09-14T17:10:51.976152] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-09-14T17:10:51.977109] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-09-14T17:10:52.214402] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-14T17:10:52.488090] [INFO ] [REMOTE ] BOX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:10:52.558831] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-09-14T17:10:52.647058] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-14T17:10:52.808524] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-14T17:10:53.358838] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-09-14T17:10:54.158941] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-09-14T17:10:54.235830] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T17:10:54.760809] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-14T17:10:54.958927] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-09-14T17:10:55.758880] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-09-14T17:10:55.954238] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T17:10:56.558910] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-09-14T17:10:56.758021] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T17:10:57.275710] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T17:10:57.358839] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-09-14T17:10:58.158844] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-09-14T17:10:58.425577] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T17:10:58.958864] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-09-14T17:10:59.272918] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-14T17:10:59.758855] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-09-14T17:10:59.887866] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T17:11:00.320154] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-14T17:11:00.558874] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-09-14T17:11:01.358850] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-09-14T17:11:01.621361] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T17:11:02.158847] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-09-14T17:11:02.214241] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T17:11:02.958858] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-09-14T17:11:03.208580] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T17:11:03.758847] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-09-14T17:11:03.874554] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T17:11:04.350055] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-14T17:11:04.558875] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-09-14T17:11:04.678620] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-14T17:11:05.358921] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-09-14T17:11:05.845066] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-14T17:11:06.158848] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-09-14T17:11:06.958861] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-09-14T17:11:07.023361] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T17:11:07.758877] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-09-14T17:11:08.062678] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T17:11:08.086821] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-14T17:11:08.558858] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-09-14T17:11:09.247310] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T17:11:09.358812] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-09-14T17:11:09.677422] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T17:11:09.867019] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T17:11:09.872544] [INFO ] [REMOTE ] BOX: Full fetch complete (54457 records). [2025-09-14T17:11:09.872733] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-09-14T17:11:10.161845] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-09-14T17:11:10.255183] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-09-14T17:11:10.255303] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-09-14T17:11:10.256172] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-09-14T17:11:10.256252] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-09-14T17:11:10.257758] [DEBUG] [LOCAL ] BOX: Trimmed 54457 records to 37722 (keeping 150 days of data) [2025-09-14T17:11:10.483962] [DEBUG] [LOCAL ] BOX: Primary data saved (37722 records). [2025-09-14T17:11:10.484165] [INFO ] [MAIN ] BOX: Full history saved. [2025-09-14T17:11:10.484320] [INFO ] [MAIN ] Update Progress: 325/2370 symbols completed. BOX took 19.4s. Estimated remaining: 3h 33m 49s. Rate: 9.6 symbols/min [2025-09-14T17:11:10.653838] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:11:10.677491] [DEBUG] [LOCAL ] BP: Loaded 24080 existing records from primary storage. [2025-09-14T17:11:10.677701] [INFO ] [MAIN ] BP: Loaded 24080 existing records. [2025-09-14T17:11:10.853336] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:11:10.853696] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-09-14T17:11:10.853769] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-09-14T17:11:10.854562] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-09-14T17:11:10.854637] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-09-14T17:11:10.964228] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-09-14T17:11:11.219075] [INFO ] [REMOTE ] BP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:11:11.758799] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-09-14T17:11:12.251235] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-14T17:11:12.281480] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-14T17:11:12.558914] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-09-14T17:11:13.225812] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T17:11:13.230551] [INFO ] [REMOTE ] BOOT: Full fetch complete (45585 records). [2025-09-14T17:11:13.230676] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-09-14T17:11:13.371830] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-09-14T17:11:13.610042] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-09-14T17:11:13.610153] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-09-14T17:11:13.610782] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-09-14T17:11:13.610853] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-09-14T17:11:13.611879] [DEBUG] [LOCAL ] BOOT: Trimmed 45585 records to 30125 (keeping 150 days of data) [2025-09-14T17:11:13.799251] [DEBUG] [LOCAL ] BOOT: Primary data saved (30125 records). [2025-09-14T17:11:13.799462] [INFO ] [MAIN ] BOOT: Full history saved. [2025-09-14T17:11:13.799597] [INFO ] [MAIN ] Update Progress: 326/2370 symbols completed. BOOT took 29.8s. Estimated remaining: 3h 33m 24s. Rate: 9.6 symbols/min [2025-09-14T17:11:13.974830] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:11:14.005855] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-14T17:11:14.026293] [DEBUG] [LOCAL ] BR: Loaded 15362 existing records from primary storage. [2025-09-14T17:11:14.026419] [INFO ] [MAIN ] BR: Loaded 15362 existing records. [2025-09-14T17:11:14.166246] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-09-14T17:11:14.206101] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:11:14.206628] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-09-14T17:11:14.206812] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-09-14T17:11:14.214137] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-14T17:11:14.214200] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-09-14T17:11:14.217315] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-09-14T17:11:14.217418] [INFO ] [REMOTE ] BOW: Full fetch complete (24908 records). [2025-09-14T17:11:14.299842] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-09-14T17:11:14.868534] [INFO ] [REMOTE ] BR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:11:14.947877] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-09-14T17:11:14.948006] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-09-14T17:11:14.948709] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-09-14T17:11:14.948769] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-09-14T17:11:14.949596] [DEBUG] [LOCAL ] BOW: Trimmed 24908 records to 16592 (keeping 150 days of data) [2025-09-14T17:11:14.959395] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-09-14T17:11:15.065752] [DEBUG] [LOCAL ] BOW: Primary data saved (16592 records). [2025-09-14T17:11:15.066000] [INFO ] [MAIN ] BOW: Full history saved. [2025-09-14T17:11:15.066188] [INFO ] [MAIN ] Update Progress: 327/2370 symbols completed. BOW took 24.6s. Estimated remaining: 3h 32m 46s. Rate: 9.6 symbols/min [2025-09-14T17:11:15.240395] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:11:15.266567] [DEBUG] [LOCAL ] BRBR: Loaded 23602 existing records from primary storage. [2025-09-14T17:11:15.266846] [INFO ] [MAIN ] BRBR: Loaded 23602 existing records. [2025-09-14T17:11:15.452404] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:11:15.452767] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-09-14T17:11:15.452837] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-09-14T17:11:15.453596] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-09-14T17:11:15.453707] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-09-14T17:11:15.764181] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-09-14T17:11:15.845872] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:11:15.911070] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-14T17:11:16.453003] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T17:11:16.558881] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-09-14T17:11:17.358933] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-09-14T17:11:17.786249] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-14T17:11:18.158899] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-09-14T17:11:18.257305] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T17:11:18.661336] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-14T17:11:18.667481] [INFO ] [REMOTE ] BORR: Full fetch complete (55807 records). [2025-09-14T17:11:18.667616] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-09-14T17:11:18.963973] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-09-14T17:11:19.044488] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-09-14T17:11:19.044586] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-09-14T17:11:19.045237] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-09-14T17:11:19.045296] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-09-14T17:11:19.046513] [DEBUG] [LOCAL ] BORR: Trimmed 55807 records to 38458 (keeping 150 days of data) [2025-09-14T17:11:19.270320] [DEBUG] [LOCAL ] BORR: Primary data saved (38458 records). [2025-09-14T17:11:19.270489] [INFO ] [MAIN ] BORR: Full history saved. [2025-09-14T17:11:19.270596] [INFO ] [MAIN ] Update Progress: 328/2370 symbols completed. BORR took 33.2s. Estimated remaining: 3h 32m 27s. Rate: 9.6 symbols/min [2025-09-14T17:11:19.438777] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:11:19.447608] [DEBUG] [LOCAL ] BRC: Loaded 7748 existing records from primary storage. [2025-09-14T17:11:19.447768] [INFO ] [MAIN ] BRC: Loaded 7748 existing records. [2025-09-14T17:11:19.623539] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:11:19.623863] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-09-14T17:11:19.624012] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-09-14T17:11:19.624482] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-09-14T17:11:19.624546] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-09-14T17:11:19.772940] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-09-14T17:11:19.925930] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T17:11:20.003849] [INFO ] [REMOTE ] BRC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:11:20.558919] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-09-14T17:11:20.835218] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T17:11:21.358788] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-09-14T17:11:21.744029] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-14T17:11:21.919291] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-14T17:11:22.158843] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-09-14T17:11:22.963889] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-09-14T17:11:22.984620] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T17:11:23.758839] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-09-14T17:11:24.461747] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-14T17:11:24.558835] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-09-14T17:11:24.739575] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-14T17:11:25.209062] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-14T17:11:25.358864] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-09-14T17:11:25.816612] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-14T17:11:26.158855] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-09-14T17:11:26.577220] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T17:11:26.958840] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-09-14T17:11:27.758857] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-09-14T17:11:27.975381] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T17:11:28.558852] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-09-14T17:11:28.587541] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-14T17:11:28.729759] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-14T17:11:29.358826] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-09-14T17:11:30.158855] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-09-14T17:11:30.225689] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T17:11:30.349192] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T17:11:30.958872] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-09-14T17:11:31.758812] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-09-14T17:11:32.072833] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T17:11:32.377682] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-14T17:11:32.558809] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-09-14T17:11:32.976534] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-14T17:11:33.358850] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-09-14T17:11:34.158886] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-09-14T17:11:34.407387] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-14T17:11:34.632830] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-14T17:11:34.958867] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-09-14T17:11:35.567124] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T17:11:35.571015] [INFO ] [REMOTE ] BR: Full fetch complete (37179 records). [2025-09-14T17:11:35.571125] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-09-14T17:11:35.765195] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-09-14T17:11:35.954680] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-09-14T17:11:35.954828] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-09-14T17:11:35.955522] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-09-14T17:11:35.955694] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-09-14T17:11:35.968369] [DEBUG] [LOCAL ] BR: Trimmed 37179 records to 25468 (keeping 150 days of data) [2025-09-14T17:11:35.990228] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T17:11:36.164025] [DEBUG] [LOCAL ] BR: Primary data saved (25468 records). [2025-09-14T17:11:36.164202] [INFO ] [MAIN ] BR: Full history saved. [2025-09-14T17:11:36.164304] [INFO ] [MAIN ] Update Progress: 329/2370 symbols completed. BR took 22.4s. Estimated remaining: 3h 33m 27s. Rate: 9.6 symbols/min [2025-09-14T17:11:36.336557] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:11:36.356292] [DEBUG] [LOCAL ] BRCC: Loaded 19201 existing records from primary storage. [2025-09-14T17:11:36.356480] [INFO ] [MAIN ] BRCC: Loaded 19201 existing records. [2025-09-14T17:11:36.538764] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:11:36.539031] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-09-14T17:11:36.539088] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-09-14T17:11:36.539800] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-09-14T17:11:36.539864] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-09-14T17:11:36.571341] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-09-14T17:11:36.904074] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:11:37.358846] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-09-14T17:11:37.450672] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-14T17:11:38.071056] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-14T17:11:38.158774] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-09-14T17:11:38.740697] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-14T17:11:38.958851] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-09-14T17:11:39.758834] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-09-14T17:11:39.916003] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-14T17:11:39.921609] [INFO ] [REMOTE ] BP: Full fetch complete (58390 records). [2025-09-14T17:11:39.921774] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-09-14T17:11:40.320111] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-09-14T17:11:40.320288] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-09-14T17:11:40.321150] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-09-14T17:11:40.321245] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-09-14T17:11:40.327691] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T17:11:40.330412] [INFO ] [REMOTE ] BRC: Full fetch complete (21883 records). [2025-09-14T17:11:40.330618] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-09-14T17:11:40.330854] [DEBUG] [LOCAL ] BP: Trimmed 58390 records to 40451 (keeping 150 days of data) [2025-09-14T17:11:40.568752] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-09-14T17:11:40.831985] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-09-14T17:11:40.833071] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-09-14T17:11:40.834170] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-09-14T17:11:40.834825] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-09-14T17:11:40.838978] [DEBUG] [LOCAL ] BRC: Trimmed 21883 records to 13569 (keeping 150 days of data) [2025-09-14T17:11:40.935604] [DEBUG] [LOCAL ] BRC: Primary data saved (13569 records). [2025-09-14T17:11:40.941155] [INFO ] [MAIN ] BRC: Full history saved. [2025-09-14T17:11:40.941345] [INFO ] [MAIN ] Update Progress: 330/2370 symbols completed. BRC took 21.7s. Estimated remaining: 3h 33m 12s. Rate: 9.6 symbols/min [2025-09-14T17:11:41.192194] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-14T17:11:41.281761] [INFO ] [MAIN ] BRFS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:11:41.308951] [DEBUG] [LOCAL ] BRFS: Loaded 16945 existing records from primary storage. [2025-09-14T17:11:41.311735] [INFO ] [MAIN ] BRFS: Loaded 16945 existing records. [2025-09-14T17:11:41.367881] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-09-14T17:11:41.501917] [WARN ] [MAIN ] BRFS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:11:41.505283] [INFO ] [MAIN ] BRFS: Wiping existing primary data before full refresh. [2025-09-14T17:11:41.506557] [INFO ] [LOCAL ] BRFS: Starting deletion of primary data. [2025-09-14T17:11:41.508338] [DEBUG] [LOCAL ] BRFS: Deleted primary data file. [2025-09-14T17:11:41.509340] [INFO ] [MAIN ] BRFS: Starting full primary refresh. [2025-09-14T17:11:41.664058] [DEBUG] [LOCAL ] BP: Primary data saved (40451 records). [2025-09-14T17:11:41.698090] [INFO ] [MAIN ] BP: Full history saved. [2025-09-14T17:11:41.732035] [INFO ] [MAIN ] Update Progress: 331/2370 symbols completed. BP took 31.2s. Estimated remaining: 3h 32m 32s. Rate: 9.6 symbols/min [2025-09-14T17:11:42.004923] [INFO ] [REMOTE ] BRFS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:11:42.047968] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:11:42.071838] [DEBUG] [LOCAL ] BRO: Loaded 23751 existing records from primary storage. [2025-09-14T17:11:42.072012] [INFO ] [MAIN ] BRO: Loaded 23751 existing records. [2025-09-14T17:11:42.169298] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-02. [2025-09-14T17:11:42.251696] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:11:42.252117] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-09-14T17:11:42.252248] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-09-14T17:11:42.257869] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-09-14T17:11:42.267039] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-14T17:11:42.265798] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-09-14T17:11:42.303494] [INFO ] [REMOTE ] BRBR: Full fetch complete (54996 records). [2025-09-14T17:11:42.335743] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-09-14T17:11:42.785943] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-14T17:11:42.966590] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-09-14T17:11:42.971292] [INFO ] [REMOTE ] BRO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:11:43.085750] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-09-14T17:11:43.085867] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-09-14T17:11:43.086586] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-09-14T17:11:43.086688] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-09-14T17:11:43.087988] [DEBUG] [LOCAL ] BRBR: Trimmed 54996 records to 39015 (keeping 150 days of data) [2025-09-14T17:11:43.318953] [DEBUG] [LOCAL ] BRBR: Primary data saved (39015 records). [2025-09-14T17:11:43.319170] [INFO ] [MAIN ] BRBR: Full history saved. [2025-09-14T17:11:43.319304] [INFO ] [MAIN ] Update Progress: 332/2370 symbols completed. BRBR took 28.3s. Estimated remaining: 3h 31m 57s. Rate: 9.6 symbols/min [2025-09-14T17:11:43.490495] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:11:43.513018] [DEBUG] [LOCAL ] BROS: Loaded 23922 existing records from primary storage. [2025-09-14T17:11:43.513176] [INFO ] [MAIN ] BROS: Loaded 23922 existing records. [2025-09-14T17:11:43.689271] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:11:43.689543] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-09-14T17:11:43.689603] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-14T17:11:43.690298] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-09-14T17:11:43.690361] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-09-14T17:11:43.764378] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-09-14T17:11:44.050194] [INFO ] [REMOTE ] BROS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:11:44.074859] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-14T17:11:44.110559] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-14T17:11:44.558828] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-09-14T17:11:45.208594] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T17:11:45.358842] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-03. [2025-09-14T17:11:46.158789] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-09-14T17:11:46.595505] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-14T17:11:46.680805] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-14T17:11:46.958945] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-09-14T17:11:47.709411] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T17:11:47.758869] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-09-14T17:11:48.558872] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-09-14T17:11:48.950701] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-14T17:11:49.306385] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T17:11:49.358794] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-09-14T17:11:50.158854] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-04. [2025-09-14T17:11:50.677667] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-14T17:11:50.911459] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T17:11:50.958818] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-09-14T17:11:51.737599] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T17:11:51.758871] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-09-14T17:11:52.516151] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T17:11:52.558785] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-09-14T17:11:53.358832] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-05. [2025-09-14T17:11:53.610921] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T17:11:53.679424] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-14T17:11:53.684797] [INFO ] [REMOTE ] BRCC: Full fetch complete (43364 records). [2025-09-14T17:11:53.685011] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-09-14T17:11:54.105542] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-09-14T17:11:54.105775] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-09-14T17:11:54.106582] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-09-14T17:11:54.106664] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-09-14T17:11:54.108099] [DEBUG] [LOCAL ] BRCC: Trimmed 43364 records to 30415 (keeping 150 days of data) [2025-09-14T17:11:54.164141] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-09-14T17:11:54.291673] [DEBUG] [LOCAL ] BRCC: Primary data saved (30415 records). [2025-09-14T17:11:54.291902] [INFO ] [MAIN ] BRCC: Full history saved. [2025-09-14T17:11:54.292018] [INFO ] [MAIN ] Update Progress: 333/2370 symbols completed. BRCC took 18.1s. Estimated remaining: 3h 32m 20s. Rate: 9.6 symbols/min [2025-09-14T17:11:54.480842] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:11:54.503477] [DEBUG] [LOCAL ] BRSL: Loaded 18687 existing records from primary storage. [2025-09-14T17:11:54.503698] [INFO ] [MAIN ] BRSL: Loaded 18687 existing records. [2025-09-14T17:11:54.678804] [WARN ] [MAIN ] BRSL: Insufficient historical data. Have data from 2025-07-02, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:11:54.679117] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-09-14T17:11:54.679261] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-14T17:11:54.679930] [DEBUG] [LOCAL ] BRSL: Deleted primary data file. [2025-09-14T17:11:54.679996] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-09-14T17:11:54.924400] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T17:11:54.979664] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-09-14T17:11:55.087270] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:11:55.758812] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-02. [2025-09-14T17:11:56.020766] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:11:56.021141] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-02 [2025-09-14T17:11:56.085081] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-14T17:11:56.558877] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-06. [2025-09-14T17:11:57.108197] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-14T17:11:57.358829] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-03. [2025-09-14T17:11:57.605881] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:11:57.606235] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-03 [2025-09-14T17:11:57.825269] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-14T17:11:58.158841] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-04. [2025-09-14T17:11:58.421307] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:11:58.421715] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-04 [2025-09-14T17:11:58.958945] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-09-14T17:11:59.758874] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-05. [2025-09-14T17:12:00.006761] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:12:00.007151] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-05 [2025-09-14T17:12:00.558858] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-09-14T17:12:01.203580] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-14T17:12:01.358867] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-09-14T17:12:02.158922] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-06. [2025-09-14T17:12:02.436609] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:12:02.436987] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-06 [2025-09-14T17:12:02.760943] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-14T17:12:02.958780] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-07. [2025-09-14T17:12:03.368079] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-14T17:12:03.758927] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-07. [2025-09-14T17:12:04.558902] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-09-14T17:12:04.718689] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T17:12:05.345269] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T17:12:05.358780] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-08. [2025-09-14T17:12:06.158849] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-09-14T17:12:06.655160] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-14T17:12:06.921178] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T17:12:06.958790] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-09. [2025-09-14T17:12:07.758987] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-08. [2025-09-14T17:12:08.469568] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-14T17:12:08.490383] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-14T17:12:08.494566] [INFO ] [REMOTE ] BRFS: Full fetch complete (44998 records). [2025-09-14T17:12:08.494721] [DEBUG] [VALIDATOR ] BRFS: Validating primary data. [2025-09-14T17:12:08.565954] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-09-14T17:12:08.915764] [DEBUG] [VALIDATOR ] BRFS: All expected trading days are present. [2025-09-14T17:12:08.915883] [DEBUG] [VALIDATOR ] BRFS: Primary data validation passed. [2025-09-14T17:12:08.916580] [INFO ] [MAIN ] BRFS: Fetched primary data is valid. [2025-09-14T17:12:08.916656] [DEBUG] [LOCAL ] BRFS: Saving primary data. [2025-09-14T17:12:08.917769] [DEBUG] [LOCAL ] BRFS: Trimmed 44998 records to 30661 (keeping 150 days of data) [2025-09-14T17:12:09.093080] [DEBUG] [LOCAL ] BRFS: Primary data saved (30661 records). [2025-09-14T17:12:09.093274] [INFO ] [MAIN ] BRFS: Full history saved. [2025-09-14T17:12:09.093399] [INFO ] [MAIN ] Update Progress: 334/2370 symbols completed. BRFS took 28.2s. Estimated remaining: 3h 33m 5s. Rate: 9.6 symbols/min [2025-09-14T17:12:09.266745] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:12:09.284521] [DEBUG] [LOCAL ] BRSP: Loaded 16625 existing records from primary storage. [2025-09-14T17:12:09.284745] [INFO ] [MAIN ] BRSP: Loaded 16625 existing records. [2025-09-14T17:12:09.364085] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-09-14T17:12:09.473019] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:12:09.473345] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-09-14T17:12:09.473425] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-14T17:12:09.474004] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-09-14T17:12:09.474073] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-09-14T17:12:09.857453] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:12:09.895469] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-14T17:12:10.158877] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-09-14T17:12:10.359473] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T17:12:10.958854] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-09-14T17:12:11.253222] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T17:12:11.602260] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:12:11.608231] [INFO ] [REMOTE ] BRO: Full fetch complete (56230 records). [2025-09-14T17:12:11.635400] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-09-14T17:12:11.723163] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-14T17:12:11.761670] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-09-14T17:12:12.056106] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-09-14T17:12:12.056277] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-09-14T17:12:12.056958] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-09-14T17:12:12.057023] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-09-14T17:12:12.058369] [DEBUG] [LOCAL ] BRO: Trimmed 56230 records to 39113 (keeping 150 days of data) [2025-09-14T17:12:12.331349] [DEBUG] [LOCAL ] BRO: Primary data saved (39113 records). [2025-09-14T17:12:12.331873] [INFO ] [MAIN ] BRO: Full history saved. [2025-09-14T17:12:12.332009] [INFO ] [MAIN ] Update Progress: 335/2370 symbols completed. BRO took 30.6s. Estimated remaining: 3h 32m 41s. Rate: 9.6 symbols/min [2025-09-14T17:12:12.503962] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:12:12.508616] [DEBUG] [LOCAL ] BRT: Loaded 2279 existing records from primary storage. [2025-09-14T17:12:12.508837] [INFO ] [MAIN ] BRT: Loaded 2279 existing records. [2025-09-14T17:12:12.571190] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-09-14T17:12:12.690687] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:12:12.690960] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-09-14T17:12:12.691020] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-09-14T17:12:12.691449] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-09-14T17:12:12.691509] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-09-14T17:12:13.044347] [INFO ] [REMOTE ] BRT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:12:13.308715] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T17:12:13.358791] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-09-14T17:12:14.158925] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-09. [2025-09-14T17:12:14.445845] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-14T17:12:14.451443] [INFO ] [REMOTE ] BROS: Full fetch complete (57954 records). [2025-09-14T17:12:14.451594] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-09-14T17:12:14.847491] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-09-14T17:12:14.847630] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-09-14T17:12:14.848349] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-09-14T17:12:14.848404] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-09-14T17:12:14.849778] [DEBUG] [LOCAL ] BROS: Trimmed 57954 records to 40080 (keeping 150 days of data) [2025-09-14T17:12:14.960109] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-09-14T17:12:15.104264] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T17:12:15.127372] [DEBUG] [LOCAL ] BROS: Primary data saved (40080 records). [2025-09-14T17:12:15.127553] [INFO ] [MAIN ] BROS: Full history saved. [2025-09-14T17:12:15.127692] [INFO ] [MAIN ] Update Progress: 336/2370 symbols completed. BROS took 31.8s. Estimated remaining: 3h 32m 13s. Rate: 9.6 symbols/min [2025-09-14T17:12:15.295632] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:12:15.307112] [DEBUG] [LOCAL ] BRW: Loaded 9686 existing records from primary storage. [2025-09-14T17:12:15.307271] [INFO ] [MAIN ] BRW: Loaded 9686 existing records. [2025-09-14T17:12:15.488373] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:12:15.488875] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-09-14T17:12:15.492091] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-14T17:12:15.493539] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-09-14T17:12:15.499221] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-09-14T17:12:15.507052] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-09-14T17:12:15.587569] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-14T17:12:15.618267] [INFO ] [REMOTE ] BRSL: Full fetch complete (18687 records). [2025-09-14T17:12:15.633688] [DEBUG] [VALIDATOR ] BRSL: Validating primary data. [2025-09-14T17:12:15.762279] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-09-14T17:12:16.045791] [WARN ] [VALIDATOR ] BRSL: Validation failed - insufficient historical data. Have 51 unique days, need 150 days [2025-09-14T17:12:16.066328] [INFO ] [REMOTE ] BRW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:12:16.062927] [FATAL] [MAIN ] BRSL: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:12:16.066679] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:12:16.066745] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-14T17:12:16.066815] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-14T17:12:16.066864] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-09-14T17:12:16.066975] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-09-14T17:12:16.067077] [INFO ] [MAIN ] Update Progress: 337/2370 symbols completed. BRSL took 21.8s. Estimated remaining: 3h 31m 35s. Rate: 9.6 symbols/min [2025-09-14T17:12:16.234733] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:12:16.258401] [DEBUG] [LOCAL ] BRX: Loaded 23276 existing records from primary storage. [2025-09-14T17:12:16.258611] [INFO ] [MAIN ] BRX: Loaded 23276 existing records. [2025-09-14T17:12:16.431007] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:12:16.431202] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-09-14T17:12:16.431261] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-09-14T17:12:16.432120] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-09-14T17:12:16.432185] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-09-14T17:12:16.569336] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-09-14T17:12:16.777462] [INFO ] [REMOTE ] BRX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:12:17.276421] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T17:12:17.358793] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-09-14T17:12:17.750040] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T17:12:18.158887] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-09-14T17:12:18.958885] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-09-14T17:12:19.108021] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T17:12:19.148633] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T17:12:19.617146] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-14T17:12:19.758870] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-09-14T17:12:20.558901] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-09-14T17:12:21.295506] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-14T17:12:21.358893] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-09-14T17:12:21.577723] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T17:12:22.014763] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-14T17:12:22.158831] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-09-14T17:12:22.958908] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-09-14T17:12:23.700732] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-14T17:12:23.747693] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T17:12:23.758770] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-09-14T17:12:24.558834] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-09-14T17:12:25.013146] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-14T17:12:25.046132] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-14T17:12:25.358845] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-09-14T17:12:26.158839] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-09-14T17:12:26.958872] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-09-14T17:12:27.084760] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T17:12:27.106987] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-14T17:12:27.382190] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-14T17:12:27.758843] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-09-14T17:12:28.472962] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-14T17:12:28.558880] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-09-14T17:12:29.290292] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-14T17:12:29.358797] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-09-14T17:12:30.158852] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-09-14T17:12:30.577558] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-14T17:12:30.581578] [INFO ] [REMOTE ] BRSP: Full fetch complete (40659 records). [2025-09-14T17:12:30.581717] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-09-14T17:12:30.965102] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-09-14T17:12:30.966913] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-09-14T17:12:30.967043] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-09-14T17:12:30.967700] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-09-14T17:12:30.967884] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-09-14T17:12:30.969188] [DEBUG] [LOCAL ] BRSP: Trimmed 40659 records to 26840 (keeping 150 days of data) [2025-09-14T17:12:31.128161] [DEBUG] [LOCAL ] BRSP: Primary data saved (26840 records). [2025-09-14T17:12:31.128336] [INFO ] [MAIN ] BRSP: Full history saved. [2025-09-14T17:12:31.128441] [INFO ] [MAIN ] Update Progress: 338/2370 symbols completed. BRSP took 22.0s. Estimated remaining: 3h 32m 22s. Rate: 9.6 symbols/min [2025-09-14T17:12:31.299244] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:12:31.315251] [DEBUG] [LOCAL ] BSAC: Loaded 14315 existing records from primary storage. [2025-09-14T17:12:31.315453] [INFO ] [MAIN ] BSAC: Loaded 14315 existing records. [2025-09-14T17:12:31.493739] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:12:31.494028] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-09-14T17:12:31.494179] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-09-14T17:12:31.494722] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-09-14T17:12:31.494786] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-09-14T17:12:31.769847] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-09-14T17:12:31.864352] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:12:31.988971] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-14T17:12:32.022194] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-14T17:12:32.351784] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T17:12:32.353220] [INFO ] [REMOTE ] BRT: Full fetch complete (4977 records). [2025-09-14T17:12:32.353317] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-09-14T17:12:32.583997] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-09-14T17:12:32.778045] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-09-14T17:12:32.778187] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-09-14T17:12:32.778402] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-09-14T17:12:32.778468] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-09-14T17:12:32.778959] [DEBUG] [LOCAL ] BRT: Trimmed 4977 records to 3527 (keeping 150 days of data) [2025-09-14T17:12:32.802108] [DEBUG] [LOCAL ] BRT: Primary data saved (3527 records). [2025-09-14T17:12:32.802326] [INFO ] [MAIN ] BRT: Full history saved. [2025-09-14T17:12:32.802457] [INFO ] [MAIN ] Update Progress: 339/2370 symbols completed. BRT took 20.5s. Estimated remaining: 3h 31m 48s. Rate: 9.6 symbols/min [2025-09-14T17:12:32.979127] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:12:32.999757] [DEBUG] [LOCAL ] BSBR: Loaded 16730 existing records from primary storage. [2025-09-14T17:12:33.000022] [INFO ] [MAIN ] BSBR: Loaded 16730 existing records. [2025-09-14T17:12:33.192022] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:12:33.192500] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-09-14T17:12:33.192586] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-09-14T17:12:33.193284] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-09-14T17:12:33.193359] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-09-14T17:12:33.359070] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-09-14T17:12:33.575041] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:12:34.158916] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-09-14T17:12:34.482695] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-14T17:12:34.789377] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-14T17:12:34.958845] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-09-14T17:12:35.614032] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T17:12:35.725394] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-14T17:12:35.758777] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-09-14T17:12:36.558842] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-09-14T17:12:36.712504] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-14T17:12:36.715059] [INFO ] [REMOTE ] BRW: Full fetch complete (20131 records). [2025-09-14T17:12:36.715152] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-09-14T17:12:37.083542] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-09-14T17:12:37.083746] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-09-14T17:12:37.084148] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-09-14T17:12:37.084203] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-09-14T17:12:37.084864] [DEBUG] [LOCAL ] BRW: Trimmed 20131 records to 14128 (keeping 150 days of data) [2025-09-14T17:12:37.170220] [DEBUG] [LOCAL ] BRW: Primary data saved (14128 records). [2025-09-14T17:12:37.170412] [INFO ] [MAIN ] BRW: Full history saved. [2025-09-14T17:12:37.170517] [INFO ] [MAIN ] Update Progress: 340/2370 symbols completed. BRW took 22.0s. Estimated remaining: 3h 31m 30s. Rate: 9.6 symbols/min [2025-09-14T17:12:37.340038] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:12:37.344956] [DEBUG] [LOCAL ] BSL: Loaded 2958 existing records from primary storage. [2025-09-14T17:12:37.345061] [INFO ] [MAIN ] BSL: Loaded 2958 existing records. [2025-09-14T17:12:37.365300] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-09-14T17:12:37.526476] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:12:37.526791] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-09-14T17:12:37.526856] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-09-14T17:12:37.527164] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-09-14T17:12:37.527224] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-09-14T17:12:37.886369] [INFO ] [REMOTE ] BSL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:12:38.158892] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-09-14T17:12:38.436530] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T17:12:38.470060] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T17:12:38.958850] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-09-14T17:12:39.202286] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-14T17:12:39.758875] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-09-14T17:12:39.835232] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T17:12:40.558938] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-09-14T17:12:41.140734] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-14T17:12:41.143867] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-14T17:12:41.358837] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-09-14T17:12:41.967680] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-14T17:12:42.158837] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-09-14T17:12:42.958843] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-09-14T17:12:43.391074] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T17:12:43.758868] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-09-14T17:12:43.793043] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T17:12:44.558831] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-09-14T17:12:45.350038] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-14T17:12:45.358809] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-09-14T17:12:45.552759] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T17:12:45.894227] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-14T17:12:46.158826] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-09-14T17:12:46.815418] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-14T17:12:46.958852] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-09-14T17:12:47.248028] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-14T17:12:47.254680] [INFO ] [REMOTE ] BRX: Full fetch complete (56452 records). [2025-09-14T17:12:47.254919] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-09-14T17:12:47.654320] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-09-14T17:12:47.654450] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-09-14T17:12:47.655187] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-09-14T17:12:47.655250] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-09-14T17:12:47.656466] [DEBUG] [LOCAL ] BRX: Trimmed 56452 records to 39074 (keeping 150 days of data) [2025-09-14T17:12:47.758820] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-09-14T17:12:47.907683] [DEBUG] [LOCAL ] BRX: Primary data saved (39074 records). [2025-09-14T17:12:47.907874] [INFO ] [MAIN ] BRX: Full history saved. [2025-09-14T17:12:47.907991] [INFO ] [MAIN ] Update Progress: 341/2370 symbols completed. BRX took 31.8s. Estimated remaining: 3h 31m 51s. Rate: 9.6 symbols/min [2025-09-14T17:12:48.078593] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:12:48.097424] [DEBUG] [LOCAL ] BSM: Loaded 16021 existing records from primary storage. [2025-09-14T17:12:48.097633] [INFO ] [MAIN ] BSM: Loaded 16021 existing records. [2025-09-14T17:12:48.278124] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:12:48.278398] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-09-14T17:12:48.278463] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-09-14T17:12:48.279006] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-09-14T17:12:48.279076] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-09-14T17:12:48.465409] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:12:48.514759] [INFO ] [REMOTE ] BSL: Full fetch complete (9389 records). [2025-09-14T17:12:48.547635] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-09-14T17:12:48.563930] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-09-14T17:12:48.754404] [INFO ] [REMOTE ] BSM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:12:49.015592] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-09-14T17:12:49.015714] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-09-14T17:12:49.015964] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-09-14T17:12:49.016027] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-09-14T17:12:49.016500] [DEBUG] [LOCAL ] BSL: Trimmed 9389 records to 5222 (keeping 150 days of data) [2025-09-14T17:12:49.050018] [DEBUG] [LOCAL ] BSL: Primary data saved (5222 records). [2025-09-14T17:12:49.050154] [INFO ] [MAIN ] BSL: Full history saved. [2025-09-14T17:12:49.050281] [INFO ] [MAIN ] Update Progress: 342/2370 symbols completed. BSL took 11.9s. Estimated remaining: 3h 31m 14s. Rate: 9.6 symbols/min [2025-09-14T17:12:49.228432] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:12:49.240039] [DEBUG] [LOCAL ] BST: Loaded 8207 existing records from primary storage. [2025-09-14T17:12:49.240270] [INFO ] [MAIN ] BST: Loaded 8207 existing records. [2025-09-14T17:12:49.363903] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-09-14T17:12:49.426744] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:12:49.427071] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-09-14T17:12:49.427151] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-14T17:12:49.427545] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-09-14T17:12:49.427623] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-09-14T17:12:49.794116] [INFO ] [REMOTE ] BST: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:12:49.813410] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T17:12:50.158825] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-09-14T17:12:50.911927] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T17:12:50.958828] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-09-14T17:12:51.597582] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T17:12:51.758780] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-09-14T17:12:52.080294] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-14T17:12:52.558836] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-09-14T17:12:52.825744] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T17:12:53.358827] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-09-14T17:12:54.054239] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T17:12:54.158877] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-09-14T17:12:54.399999] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-14T17:12:54.958839] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-09-14T17:12:55.510366] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T17:12:55.758834] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-09-14T17:12:55.962099] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-14T17:12:56.558824] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-09-14T17:12:57.345619] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T17:12:57.358769] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-09-14T17:12:57.822742] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-14T17:12:58.158890] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-09-14T17:12:58.758723] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-14T17:12:58.958883] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-09-14T17:12:59.571044] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-14T17:12:59.758937] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-09-14T17:13:00.321320] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T17:13:00.326316] [INFO ] [REMOTE ] BSBR: Full fetch complete (38213 records). [2025-09-14T17:13:00.326466] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-09-14T17:13:00.566274] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-09-14T17:13:00.710201] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-09-14T17:13:00.710337] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-09-14T17:13:00.711014] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-09-14T17:13:00.711079] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-09-14T17:13:00.712326] [DEBUG] [LOCAL ] BSBR: Trimmed 38213 records to 26870 (keeping 150 days of data) [2025-09-14T17:13:00.872687] [DEBUG] [LOCAL ] BSBR: Primary data saved (26870 records). [2025-09-14T17:13:00.872866] [INFO ] [MAIN ] BSBR: Full history saved. [2025-09-14T17:13:00.873000] [INFO ] [MAIN ] Update Progress: 343/2370 symbols completed. BSBR took 28.1s. Estimated remaining: 3h 31m 41s. Rate: 9.6 symbols/min [2025-09-14T17:13:01.044758] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:13:01.059292] [DEBUG] [LOCAL ] BSTZ: Loaded 11116 existing records from primary storage. [2025-09-14T17:13:01.059479] [INFO ] [MAIN ] BSTZ: Loaded 11116 existing records. [2025-09-14T17:13:01.250171] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:13:01.250686] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-09-14T17:13:01.250834] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-14T17:13:01.251369] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-09-14T17:13:01.251451] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-09-14T17:13:01.367454] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T17:13:01.365368] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-09-14T17:13:01.651742] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:13:01.938213] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-14T17:13:02.158904] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-09-14T17:13:02.627380] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-14T17:13:02.958868] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-09-14T17:13:03.508356] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T17:13:03.758882] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-09-14T17:13:04.057475] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-14T17:13:04.558855] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-09-14T17:13:04.619714] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-14T17:13:04.623628] [INFO ] [REMOTE ] BSAC: Full fetch complete (35554 records). [2025-09-14T17:13:04.623788] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-09-14T17:13:05.002183] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-09-14T17:13:05.002313] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-09-14T17:13:05.003261] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-09-14T17:13:05.003358] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-09-14T17:13:05.004788] [DEBUG] [LOCAL ] BSAC: Trimmed 35554 records to 24764 (keeping 150 days of data) [2025-09-14T17:13:05.158062] [DEBUG] [LOCAL ] BSAC: Primary data saved (24764 records). [2025-09-14T17:13:05.158250] [INFO ] [MAIN ] BSAC: Full history saved. [2025-09-14T17:13:05.158417] [INFO ] [MAIN ] Update Progress: 344/2370 symbols completed. BSAC took 34.0s. Estimated remaining: 3h 31m 23s. Rate: 9.6 symbols/min [2025-09-14T17:13:05.350909] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:13:05.365548] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-09-14T17:13:05.384857] [DEBUG] [LOCAL ] BSX: Loaded 24051 existing records from primary storage. [2025-09-14T17:13:05.385059] [INFO ] [MAIN ] BSX: Loaded 24051 existing records. [2025-09-14T17:13:05.565626] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:13:05.566031] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-09-14T17:13:05.566294] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-09-14T17:13:05.572147] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-09-14T17:13:05.580419] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-09-14T17:13:05.625410] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T17:13:05.941407] [INFO ] [REMOTE ] BSX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:13:06.158847] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-09-14T17:13:06.576836] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-14T17:13:06.958899] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-09-14T17:13:07.758846] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-09-14T17:13:08.075463] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-14T17:13:08.329806] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-14T17:13:08.558838] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-09-14T17:13:08.885075] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-14T17:13:09.358846] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-09-14T17:13:10.144190] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-14T17:13:10.158804] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-09-14T17:13:10.815319] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-14T17:13:10.958792] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-09-14T17:13:11.256279] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-14T17:13:11.258957] [INFO ] [REMOTE ] BST: Full fetch complete (21329 records). [2025-09-14T17:13:11.259132] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-09-14T17:13:11.651298] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-09-14T17:13:11.651411] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-09-14T17:13:11.651897] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-09-14T17:13:11.651966] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-09-14T17:13:11.652670] [DEBUG] [LOCAL ] BST: Trimmed 21329 records to 13627 (keeping 150 days of data) [2025-09-14T17:13:11.744666] [DEBUG] [LOCAL ] BST: Primary data saved (13627 records). [2025-09-14T17:13:11.744854] [INFO ] [MAIN ] BST: Full history saved. [2025-09-14T17:13:11.744976] [INFO ] [MAIN ] Update Progress: 345/2370 symbols completed. BST took 22.7s. Estimated remaining: 3h 31m 19s. Rate: 9.6 symbols/min [2025-09-14T17:13:11.766616] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-09-14T17:13:11.928095] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:13:11.933329] [DEBUG] [LOCAL ] BTA: Loaded 2373 existing records from primary storage. [2025-09-14T17:13:11.933458] [INFO ] [MAIN ] BTA: Loaded 2373 existing records. [2025-09-14T17:13:12.116010] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:13:12.116347] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-09-14T17:13:12.116413] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-09-14T17:13:12.116748] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-09-14T17:13:12.116815] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-09-14T17:13:12.466000] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T17:13:12.514275] [INFO ] [REMOTE ] BTA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:13:12.558815] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-09-14T17:13:13.358889] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-09-14T17:13:13.787396] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-14T17:13:13.978599] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-14T17:13:14.158899] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-09-14T17:13:14.251221] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T17:13:14.958867] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-09-14T17:13:15.236929] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T17:13:15.611211] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-14T17:13:15.758877] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-09-14T17:13:16.558966] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-09-14T17:13:17.104444] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T17:13:17.358901] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-09-14T17:13:18.114323] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-14T17:13:18.158898] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-09-14T17:13:18.306745] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-14T17:13:18.841631] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-14T17:13:18.958900] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-09-14T17:13:19.758867] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-09-14T17:13:19.835174] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T17:13:19.838495] [INFO ] [REMOTE ] BSTZ: Full fetch complete (27036 records). [2025-09-14T17:13:19.838673] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-09-14T17:13:20.244110] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-09-14T17:13:20.244271] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-09-14T17:13:20.244953] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-09-14T17:13:20.245027] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-09-14T17:13:20.246506] [DEBUG] [LOCAL ] BSTZ: Trimmed 27036 records to 18235 (keeping 150 days of data) [2025-09-14T17:13:20.353568] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-14T17:13:20.390181] [DEBUG] [LOCAL ] BSTZ: Primary data saved (18235 records). [2025-09-14T17:13:20.390451] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-09-14T17:13:20.390621] [INFO ] [MAIN ] Update Progress: 346/2370 symbols completed. BSTZ took 19.5s. Estimated remaining: 3h 31m 26s. Rate: 9.6 symbols/min [2025-09-14T17:13:20.585049] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-09-14T17:13:20.642951] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:13:20.657949] [DEBUG] [LOCAL ] BTCM: Loaded 10681 existing records from primary storage. [2025-09-14T17:13:20.658144] [INFO ] [MAIN ] BTCM: Loaded 10681 existing records. [2025-09-14T17:13:20.851384] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:13:20.851825] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-09-14T17:13:20.851893] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-09-14T17:13:20.852285] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-09-14T17:13:20.852347] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-09-14T17:13:21.215099] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:13:21.358857] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-09-14T17:13:22.158856] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-09-14T17:13:22.603386] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-14T17:13:22.824103] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-14T17:13:22.953222] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-14T17:13:22.961687] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-09-14T17:13:23.689268] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-14T17:13:23.758845] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-09-14T17:13:24.558875] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-09-14T17:13:25.257035] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-14T17:13:25.358848] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-09-14T17:13:25.631458] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-14T17:13:25.981545] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-14T17:13:26.158902] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-09-14T17:13:26.709304] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T17:13:26.710861] [INFO ] [REMOTE ] BTA: Full fetch complete (6067 records). [2025-09-14T17:13:26.710980] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-09-14T17:13:26.964009] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-09-14T17:13:27.090529] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-09-14T17:13:27.090685] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-09-14T17:13:27.090992] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-09-14T17:13:27.091048] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-09-14T17:13:27.091511] [DEBUG] [LOCAL ] BTA: Trimmed 6067 records to 4083 (keeping 150 days of data) [2025-09-14T17:13:27.118480] [DEBUG] [LOCAL ] BTA: Primary data saved (4083 records). [2025-09-14T17:13:27.118709] [INFO ] [MAIN ] BTA: Full history saved. [2025-09-14T17:13:27.118880] [INFO ] [MAIN ] Update Progress: 347/2370 symbols completed. BTA took 15.4s. Estimated remaining: 3h 31m 23s. Rate: 9.6 symbols/min [2025-09-14T17:13:27.299336] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:13:27.329210] [DEBUG] [LOCAL ] BTE: Loaded 23635 existing records from primary storage. [2025-09-14T17:13:27.329449] [INFO ] [MAIN ] BTE: Loaded 23635 existing records. [2025-09-14T17:13:27.519243] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:13:27.519547] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-09-14T17:13:27.519613] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-09-14T17:13:27.520314] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-09-14T17:13:27.520387] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-09-14T17:13:27.771715] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-09-14T17:13:27.893425] [INFO ] [REMOTE ] BTE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:13:28.558798] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-09-14T17:13:29.127128] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-14T17:13:29.174153] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-14T17:13:29.178470] [INFO ] [REMOTE ] BSM: Full fetch complete (35930 records). [2025-09-14T17:13:29.178594] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-09-14T17:13:29.363878] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-09-14T17:13:29.550617] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-09-14T17:13:29.550738] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-09-14T17:13:29.551235] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-09-14T17:13:29.551289] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-09-14T17:13:29.552145] [DEBUG] [LOCAL ] BSM: Trimmed 35930 records to 24437 (keeping 150 days of data) [2025-09-14T17:13:29.709126] [DEBUG] [LOCAL ] BSM: Primary data saved (24437 records). [2025-09-14T17:13:29.709302] [INFO ] [MAIN ] BSM: Full history saved. [2025-09-14T17:13:29.709410] [INFO ] [MAIN ] Update Progress: 348/2370 symbols completed. BSM took 41.8s. Estimated remaining: 3h 30m 55s. Rate: 9.6 symbols/min [2025-09-14T17:13:29.881710] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:13:29.905942] [DEBUG] [LOCAL ] BTI: Loaded 24046 existing records from primary storage. [2025-09-14T17:13:29.906116] [INFO ] [MAIN ] BTI: Loaded 24046 existing records. [2025-09-14T17:13:30.084894] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:13:30.085152] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-09-14T17:13:30.085212] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-09-14T17:13:30.086028] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-09-14T17:13:30.086095] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-09-14T17:13:30.163982] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-09-14T17:13:30.447912] [INFO ] [REMOTE ] BTI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:13:30.474948] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-14T17:13:30.877053] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-14T17:13:30.958842] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-09-14T17:13:31.226702] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T17:13:31.457173] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-14T17:13:31.758868] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-09-14T17:13:32.451345] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-14T17:13:32.558864] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-09-14T17:13:33.358932] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-09-14T17:13:33.991844] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T17:13:33.998004] [INFO ] [REMOTE ] BSX: Full fetch complete (58365 records). [2025-09-14T17:13:33.998245] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-09-14T17:13:34.165951] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-09-14T17:13:34.405597] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-09-14T17:13:34.405756] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-09-14T17:13:34.406447] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-09-14T17:13:34.406505] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-09-14T17:13:34.408791] [DEBUG] [LOCAL ] BSX: Trimmed 58365 records to 40428 (keeping 150 days of data) [2025-09-14T17:13:34.697662] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-14T17:13:34.728430] [DEBUG] [LOCAL ] BSX: Primary data saved (40428 records). [2025-09-14T17:13:34.728675] [INFO ] [MAIN ] BSX: Full history saved. [2025-09-14T17:13:34.728829] [INFO ] [MAIN ] Update Progress: 349/2370 symbols completed. BSX took 29.6s. Estimated remaining: 3h 30m 42s. Rate: 9.6 symbols/min [2025-09-14T17:13:34.866202] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-14T17:13:34.924778] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:13:34.931193] [DEBUG] [LOCAL ] BTO: Loaded 3759 existing records from primary storage. [2025-09-14T17:13:34.931349] [INFO ] [MAIN ] BTO: Loaded 3759 existing records. [2025-09-14T17:13:34.963976] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-09-14T17:13:35.123807] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:13:35.124194] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-09-14T17:13:35.124264] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-09-14T17:13:35.124612] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-09-14T17:13:35.124709] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-09-14T17:13:35.495457] [INFO ] [REMOTE ] BTO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:13:35.758879] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-09-14T17:13:36.558894] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-09-14T17:13:37.082968] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-14T17:13:37.358845] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-09-14T17:13:37.564902] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T17:13:38.092117] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T17:13:38.158792] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-09-14T17:13:38.958871] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-09-14T17:13:38.974514] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-14T17:13:39.546044] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-14T17:13:39.758860] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-09-14T17:13:40.007318] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-14T17:13:40.358470] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-14T17:13:40.558895] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-09-14T17:13:41.358840] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-09-14T17:13:41.758800] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-14T17:13:41.761369] [INFO ] [REMOTE ] BTCM: Full fetch complete (14378 records). [2025-09-14T17:13:41.761458] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-09-14T17:13:42.128279] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-09-14T17:13:42.128392] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-09-14T17:13:42.128754] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-09-14T17:13:42.128811] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-09-14T17:13:42.129395] [DEBUG] [LOCAL ] BTCM: Trimmed 14378 records to 12647 (keeping 150 days of data) [2025-09-14T17:13:42.159217] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-09-14T17:13:42.205385] [DEBUG] [LOCAL ] BTCM: Primary data saved (12647 records). [2025-09-14T17:13:42.205593] [INFO ] [MAIN ] BTCM: Full history saved. [2025-09-14T17:13:42.205773] [INFO ] [MAIN ] Update Progress: 350/2370 symbols completed. BTCM took 21.8s. Estimated remaining: 3h 30m 42s. Rate: 9.6 symbols/min [2025-09-14T17:13:42.386778] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:13:42.395403] [DEBUG] [LOCAL ] BTT: Loaded 6892 existing records from primary storage. [2025-09-14T17:13:42.395554] [INFO ] [MAIN ] BTT: Loaded 6892 existing records. [2025-09-14T17:13:42.591277] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:13:42.591663] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-09-14T17:13:42.591765] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-14T17:13:42.592170] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-09-14T17:13:42.592247] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-09-14T17:13:42.961595] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-09-14T17:13:42.980932] [INFO ] [REMOTE ] BTT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:13:43.134193] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-14T17:13:43.286297] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-14T17:13:43.758889] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-09-14T17:13:44.558922] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-09-14T17:13:44.693518] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-14T17:13:44.996568] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-14T17:13:45.152973] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-14T17:13:45.358846] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-09-14T17:13:46.159391] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-09-14T17:13:46.163474] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-14T17:13:46.958817] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-09-14T17:13:47.711568] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-14T17:13:47.758776] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-09-14T17:13:48.069066] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T17:13:48.555920] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-14T17:13:48.558843] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-09-14T17:13:49.358872] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-09-14T17:13:49.566547] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-14T17:13:50.158914] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-09-14T17:13:50.674970] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T17:13:50.676939] [INFO ] [REMOTE ] BTO: Full fetch complete (9774 records). [2025-09-14T17:13:50.677064] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-09-14T17:13:50.968665] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-09-14T17:13:51.060583] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-09-14T17:13:51.060754] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-09-14T17:13:51.061072] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-09-14T17:13:51.061143] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-09-14T17:13:51.061664] [DEBUG] [LOCAL ] BTO: Trimmed 9774 records to 6230 (keeping 150 days of data) [2025-09-14T17:13:51.100333] [DEBUG] [LOCAL ] BTO: Primary data saved (6230 records). [2025-09-14T17:13:51.100500] [INFO ] [MAIN ] BTO: Full history saved. [2025-09-14T17:13:51.100657] [INFO ] [MAIN ] Update Progress: 351/2370 symbols completed. BTO took 16.4s. Estimated remaining: 3h 30m 51s. Rate: 9.6 symbols/min [2025-09-14T17:13:51.267716] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:13:51.292505] [DEBUG] [LOCAL ] BTU: Loaded 23839 existing records from primary storage. [2025-09-14T17:13:51.292756] [INFO ] [MAIN ] BTU: Loaded 23839 existing records. [2025-09-14T17:13:51.484332] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:13:51.485088] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-09-14T17:13:51.485224] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-09-14T17:13:51.486478] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-09-14T17:13:51.486577] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-09-14T17:13:51.609665] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-14T17:13:51.764578] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-09-14T17:13:51.998908] [INFO ] [REMOTE ] BTU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:13:52.003146] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-14T17:13:52.558967] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-09-14T17:13:53.358933] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-09-14T17:13:53.611345] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T17:13:54.158858] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-09-14T17:13:54.375822] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T17:13:54.442668] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T17:13:54.958872] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-09-14T17:13:55.758887] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-09-14T17:13:56.169696] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-14T17:13:56.461530] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T17:13:56.558877] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-09-14T17:13:57.200303] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-14T17:13:57.358868] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-09-14T17:13:57.824744] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-14T17:13:57.983550] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-14T17:13:58.158911] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-09-14T17:13:58.958921] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-09-14T17:13:59.758815] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-09-14T17:13:59.814522] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T17:14:00.558939] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-09-14T17:14:00.736911] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-14T17:14:01.096424] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-14T17:14:01.358918] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-09-14T17:14:02.158898] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-09-14T17:14:02.697873] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-14T17:14:02.958891] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-09-14T17:14:03.069957] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-14T17:14:03.074113] [INFO ] [REMOTE ] BTT: Full fetch complete (17306 records). [2025-09-14T17:14:03.074406] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-09-14T17:14:03.483064] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-09-14T17:14:03.483196] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-09-14T17:14:03.483801] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-09-14T17:14:03.483884] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-09-14T17:14:03.484748] [DEBUG] [LOCAL ] BTT: Trimmed 17306 records to 11736 (keeping 150 days of data) [2025-09-14T17:14:03.562547] [DEBUG] [LOCAL ] BTT: Primary data saved (11736 records). [2025-09-14T17:14:03.562810] [INFO ] [MAIN ] BTT: Full history saved. [2025-09-14T17:14:03.562966] [INFO ] [MAIN ] Update Progress: 352/2370 symbols completed. BTT took 21.4s. Estimated remaining: 3h 31m 21s. Rate: 9.5 symbols/min [2025-09-14T17:14:03.774622] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-09-14T17:14:03.782707] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:14:03.834868] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-14T17:14:03.856502] [DEBUG] [LOCAL ] BTX: Loaded 14517 existing records from primary storage. [2025-09-14T17:14:03.857250] [INFO ] [MAIN ] BTX: Loaded 14517 existing records. [2025-09-14T17:14:04.139500] [WARN ] [MAIN ] BTX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:14:04.139926] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-09-14T17:14:04.140078] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-14T17:14:04.140868] [DEBUG] [LOCAL ] BTX: Deleted primary data file. [2025-09-14T17:14:04.140957] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-09-14T17:14:04.559794] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-09-14T17:14:04.559633] [INFO ] [REMOTE ] BTX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:14:04.579841] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-14T17:14:04.586294] [INFO ] [REMOTE ] BTE: Full fetch complete (57284 records). [2025-09-14T17:14:04.586429] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-09-14T17:14:05.003902] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-09-14T17:14:05.004041] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-09-14T17:14:05.004929] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-09-14T17:14:05.004999] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-09-14T17:14:05.006582] [DEBUG] [LOCAL ] BTE: Trimmed 57284 records to 39642 (keeping 150 days of data) [2025-09-14T17:14:05.248768] [DEBUG] [LOCAL ] BTE: Primary data saved (39642 records). [2025-09-14T17:14:05.248983] [INFO ] [MAIN ] BTE: Full history saved. [2025-09-14T17:14:05.249094] [INFO ] [MAIN ] Update Progress: 353/2370 symbols completed. BTE took 38.1s. Estimated remaining: 3h 30m 48s. Rate: 9.6 symbols/min [2025-09-14T17:14:05.364052] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-02. [2025-09-14T17:14:05.430794] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:14:05.452427] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-14T17:14:05.462404] [INFO ] [REMOTE ] BTI: Full fetch complete (58219 records). [2025-09-14T17:14:05.467347] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-09-14T17:14:05.467739] [DEBUG] [LOCAL ] BTZ: Loaded 9789 existing records from primary storage. [2025-09-14T17:14:05.468275] [INFO ] [MAIN ] BTZ: Loaded 9789 existing records. [2025-09-14T17:14:05.891681] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:14:05.983752] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-09-14T17:14:06.006483] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-09-14T17:14:06.023238] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-09-14T17:14:06.059408] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-09-14T17:14:06.182425] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-09-14T17:14:06.214103] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-09-14T17:14:06.219681] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-09-14T17:14:06.235547] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-09-14T17:14:06.358097] [DEBUG] [LOCAL ] BTI: Trimmed 58219 records to 40349 (keeping 150 days of data) [2025-09-14T17:14:06.599917] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:14:06.601980] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-09-14T17:14:06.603000] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T17:14:06.654464] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-14T17:14:06.821670] [DEBUG] [LOCAL ] BTI: Primary data saved (40349 records). [2025-09-14T17:14:06.821895] [INFO ] [MAIN ] BTI: Full history saved. [2025-09-14T17:14:06.822026] [INFO ] [MAIN ] Update Progress: 354/2370 symbols completed. BTI took 37.1s. Estimated remaining: 3h 30m 15s. Rate: 9.6 symbols/min [2025-09-14T17:14:06.964040] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-03. [2025-09-14T17:14:07.017208] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:14:07.045474] [DEBUG] [LOCAL ] BUD: Loaded 23583 existing records from primary storage. [2025-09-14T17:14:07.045724] [INFO ] [MAIN ] BUD: Loaded 23583 existing records. [2025-09-14T17:14:07.229027] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:14:07.229373] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-09-14T17:14:07.229441] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-09-14T17:14:07.230198] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-09-14T17:14:07.230281] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-09-14T17:14:07.601809] [INFO ] [REMOTE ] BUD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:14:07.728356] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-14T17:14:07.758833] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-09-14T17:14:08.558891] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-09-14T17:14:08.645785] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-14T17:14:08.985721] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-14T17:14:09.358883] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-04. [2025-09-14T17:14:10.158883] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-09-14T17:14:10.277115] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-14T17:14:10.895069] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-14T17:14:10.958873] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-05. [2025-09-14T17:14:11.474420] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-14T17:14:11.758978] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-09-14T17:14:12.117767] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T17:14:12.558893] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-09-14T17:14:13.358792] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-09-14T17:14:13.498107] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T17:14:13.785059] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-14T17:14:14.158885] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-09-14T17:14:14.958886] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-09-14T17:14:15.058156] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T17:14:15.697615] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-14T17:14:15.758807] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-09-14T17:14:16.135979] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-14T17:14:16.558800] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-09-14T17:14:16.916352] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-14T17:14:16.921808] [INFO ] [REMOTE ] BTU: Full fetch complete (57934 records). [2025-09-14T17:14:16.921967] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-09-14T17:14:17.236941] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T17:14:17.331869] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-09-14T17:14:17.331985] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-09-14T17:14:17.332680] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-09-14T17:14:17.332743] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-09-14T17:14:17.334010] [DEBUG] [LOCAL ] BTU: Trimmed 57934 records to 40092 (keeping 150 days of data) [2025-09-14T17:14:17.392286] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-09-14T17:14:17.589613] [DEBUG] [LOCAL ] BTU: Primary data saved (40092 records). [2025-09-14T17:14:17.589806] [INFO ] [MAIN ] BTU: Full history saved. [2025-09-14T17:14:17.589911] [INFO ] [MAIN ] Update Progress: 355/2370 symbols completed. BTU took 26.5s. Estimated remaining: 3h 30m 34s. Rate: 9.6 symbols/min [2025-09-14T17:14:17.759659] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:14:17.767682] [DEBUG] [LOCAL ] BUI: Loaded 5460 existing records from primary storage. [2025-09-14T17:14:17.767846] [INFO ] [MAIN ] BUI: Loaded 5460 existing records. [2025-09-14T17:14:17.947104] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:14:17.947439] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-09-14T17:14:17.947512] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-09-14T17:14:17.947846] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-09-14T17:14:17.947909] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-09-14T17:14:18.164017] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-06. [2025-09-14T17:14:18.297544] [INFO ] [REMOTE ] BUI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:14:18.958868] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-09-14T17:14:19.452761] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-14T17:14:19.642990] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T17:14:19.736438] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-14T17:14:19.758829] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-09-14T17:14:20.558826] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-09-14T17:14:21.358854] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-07. [2025-09-14T17:14:21.469739] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-14T17:14:21.472910] [INFO ] [REMOTE ] BTZ: Full fetch complete (24998 records). [2025-09-14T17:14:21.473007] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-09-14T17:14:21.843894] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-09-14T17:14:21.844051] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-09-14T17:14:21.844561] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-09-14T17:14:21.844634] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-09-14T17:14:21.845483] [DEBUG] [LOCAL ] BTZ: Trimmed 24998 records to 16645 (keeping 150 days of data) [2025-09-14T17:14:21.950722] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-14T17:14:21.988999] [DEBUG] [LOCAL ] BTZ: Primary data saved (16645 records). [2025-09-14T17:14:21.989161] [INFO ] [MAIN ] BTZ: Full history saved. [2025-09-14T17:14:21.989268] [INFO ] [MAIN ] Update Progress: 356/2370 symbols completed. BTZ took 16.7s. Estimated remaining: 3h 30m 17s. Rate: 9.6 symbols/min [2025-09-14T17:14:22.161931] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-09-14T17:14:22.161847] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:14:22.184615] [DEBUG] [LOCAL ] BUR: Loaded 21306 existing records from primary storage. [2025-09-14T17:14:22.184805] [INFO ] [MAIN ] BUR: Loaded 21306 existing records. [2025-09-14T17:14:22.363070] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:14:22.363397] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-09-14T17:14:22.363466] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-14T17:14:22.364001] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-09-14T17:14:22.364062] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-09-14T17:14:22.763300] [INFO ] [REMOTE ] BUR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:14:22.784692] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-14T17:14:22.958849] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-08. [2025-09-14T17:14:23.060877] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-14T17:14:23.758864] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-09-14T17:14:24.303194] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-14T17:14:24.558863] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-09-14T17:14:24.576012] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T17:14:25.358856] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-09-14T17:14:26.158929] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-09-14T17:14:26.434973] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-14T17:14:26.846302] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T17:14:26.958874] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-09-14T17:14:27.065898] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-14T17:14:27.758839] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-09. [2025-09-14T17:14:28.455852] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T17:14:28.558815] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-09-14T17:14:28.850508] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-14T17:14:28.854235] [INFO ] [REMOTE ] BTX: Full fetch complete (33980 records). [2025-09-14T17:14:28.854371] [DEBUG] [VALIDATOR ] BTX: Validating primary data. [2025-09-14T17:14:29.038811] [WARN ] [VALIDATOR ] BTX: Validation failed - insufficient historical data. Have 142 unique days, need 150 days [2025-09-14T17:14:29.039300] [FATAL] [MAIN ] BTX: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:14:29.039357] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:14:29.039407] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-14T17:14:29.039483] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-14T17:14:29.039529] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-09-14T17:14:29.039615] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-09-14T17:14:29.039815] [INFO ] [MAIN ] Update Progress: 357/2370 symbols completed. BTX took 25.5s. Estimated remaining: 3h 30m 16s. Rate: 9.6 symbols/min [2025-09-14T17:14:29.358850] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-09-14T17:14:29.416342] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T17:14:30.158845] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-09-14T17:14:30.823930] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-14T17:14:30.861020] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-14T17:14:30.958833] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-09-14T17:14:31.758914] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-09-14T17:14:32.558925] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-09-14T17:14:32.583961] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-14T17:14:32.593228] [INFO ] [REMOTE ] BUD: Full fetch complete (57364 records). [2025-09-14T17:14:32.593569] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-09-14T17:14:33.010610] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-09-14T17:14:33.010866] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-09-14T17:14:33.011841] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-09-14T17:14:33.011928] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-09-14T17:14:33.013864] [DEBUG] [LOCAL ] BUD: Trimmed 57364 records to 39588 (keeping 150 days of data) [2025-09-14T17:14:33.269012] [DEBUG] [LOCAL ] BUD: Primary data saved (39588 records). [2025-09-14T17:14:33.269285] [INFO ] [MAIN ] BUD: Full history saved. [2025-09-14T17:14:33.269424] [INFO ] [MAIN ] Update Progress: 358/2370 symbols completed. BUD took 26.4s. Estimated remaining: 3h 29m 58s. Rate: 9.6 symbols/min [2025-09-14T17:14:33.325932] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-14T17:14:33.358891] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-09-14T17:14:33.392133] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T17:14:34.158887] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-09-14T17:14:34.247553] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-14T17:14:34.958885] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-09-14T17:14:35.711326] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T17:14:35.713341] [INFO ] [REMOTE ] BUI: Full fetch complete (12289 records). [2025-09-14T17:14:35.713428] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-09-14T17:14:36.077653] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-09-14T17:14:36.077835] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-09-14T17:14:36.078221] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-09-14T17:14:36.078295] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-09-14T17:14:36.102230] [DEBUG] [LOCAL ] BUI: Trimmed 12289 records to 8643 (keeping 150 days of data) [2025-09-14T17:14:36.104167] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T17:14:36.152832] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-09-14T17:14:36.169206] [DEBUG] [LOCAL ] BUI: Primary data saved (8643 records). [2025-09-14T17:14:36.169321] [INFO ] [MAIN ] BUI: Full history saved. [2025-09-14T17:14:36.169452] [INFO ] [MAIN ] Update Progress: 359/2370 symbols completed. BUI took 18.6s. Estimated remaining: 3h 29m 33s. Rate: 9.6 symbols/min [2025-09-14T17:14:37.723964] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T17:14:37.733322] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-09-14T17:14:39.397128] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T17:14:39.413210] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-09-14T17:14:40.638412] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-14T17:14:40.649572] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-09-14T17:14:42.364040] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T17:14:42.375218] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-09-14T17:14:43.881493] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-14T17:14:43.886519] [INFO ] [REMOTE ] BUR: Full fetch complete (48573 records). [2025-09-14T17:14:43.886665] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-09-14T17:14:44.268268] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-09-14T17:14:44.268435] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-09-14T17:14:44.269180] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-09-14T17:14:44.269250] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-09-14T17:14:44.270621] [DEBUG] [LOCAL ] BUR: Trimmed 48573 records to 34135 (keeping 150 days of data) [2025-09-14T17:14:44.486448] [DEBUG] [LOCAL ] BUR: Primary data saved (34135 records). [2025-09-14T17:14:44.486709] [INFO ] [MAIN ] BUR: Full history saved. [2025-09-14T17:14:44.487038] [INFO ] [MAIN ] Update Progress: 360/2370 symbols completed. BUR took 22.5s. Estimated remaining: 3h 29m 38s. Rate: 9.6 symbols/min [2025-09-14T17:14:45.334221] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:14:45.495244] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:14:45.426414] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:14:45.560371] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:14:45.568321] [DEBUG] [LOCAL ] BUXX: Loaded 6237 existing records from primary storage. [2025-09-14T17:14:45.576362] [INFO ] [MAIN ] BUXX: Loaded 6237 existing records. [2025-09-14T17:14:45.589018] [DEBUG] [LOCAL ] BVN: Loaded 19198 existing records from primary storage. [2025-09-14T17:14:45.594932] [INFO ] [MAIN ] BVN: Loaded 19198 existing records. [2025-09-14T17:14:45.724332] [DEBUG] [LOCAL ] BURL: Loaded 20050 existing records from primary storage. [2025-09-14T17:14:45.786802] [DEBUG] [LOCAL ] BV: Loaded 17155 existing records from primary storage. [2025-09-14T17:14:45.785823] [INFO ] [MAIN ] BURL: Loaded 20050 existing records. [2025-09-14T17:14:45.853608] [INFO ] [MAIN ] BV: Loaded 17155 existing records. [2025-09-14T17:14:46.247084] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:14:46.288246] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:14:46.298986] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-09-14T17:14:46.325621] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-09-14T17:14:46.352242] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-09-14T17:14:46.395837] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:14:46.395561] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-09-14T17:14:46.412583] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-09-14T17:14:46.422333] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-09-14T17:14:46.456161] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:14:46.449711] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-09-14T17:14:46.422511] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-09-14T17:14:46.457139] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-09-14T17:14:46.457334] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-09-14T17:14:46.456018] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-09-14T17:14:46.457532] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-09-14T17:14:46.478699] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-09-14T17:14:46.516661] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-09-14T17:14:46.537362] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-09-14T17:14:46.582616] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-09-14T17:14:47.809754] [INFO ] [REMOTE ] BVN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:14:47.891457] [INFO ] [REMOTE ] BV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:14:47.921616] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-09-14T17:14:47.932483] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-09-14T17:14:47.932130] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:14:47.966117] [INFO ] [REMOTE ] BURL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:14:47.966478] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-09-14T17:14:47.969132] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-09-14T17:14:48.765659] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-14T17:14:48.768526] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-09-14T17:14:49.104491] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T17:14:49.113354] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-09-14T17:14:49.186433] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-14T17:14:49.195211] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-09-14T17:14:49.400291] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-14T17:14:49.408322] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-09-14T17:14:49.621947] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-14T17:14:49.625482] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-09-14T17:14:50.375638] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-14T17:14:50.388140] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-09-14T17:14:50.658248] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-14T17:14:50.668962] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-09-14T17:14:50.722954] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T17:14:50.729225] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-09-14T17:14:50.882578] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T17:14:50.891808] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-09-14T17:14:51.541438] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-14T17:14:51.547167] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-09-14T17:14:51.739290] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-14T17:14:51.749224] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-09-14T17:14:51.914059] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-14T17:14:51.922918] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-09-14T17:14:52.202821] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-14T17:14:52.289460] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-14T17:14:52.558838] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-09-14T17:14:53.206271] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T17:14:53.358890] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-09-14T17:14:53.386739] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T17:14:54.158831] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-09-14T17:14:54.200228] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-14T17:14:54.848174] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-14T17:14:54.958791] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-09-14T17:14:55.490734] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-14T17:14:55.758881] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-09-14T17:14:56.370379] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-14T17:14:56.558840] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-09-14T17:14:57.135117] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-14T17:14:57.358838] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-09-14T17:14:57.998235] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T17:14:58.158800] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-09-14T17:14:58.958869] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-09-14T17:14:59.047694] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T17:14:59.574355] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-14T17:14:59.579316] [INFO ] [REMOTE ] BVN: Full fetch complete (46983 records). [2025-09-14T17:14:59.579452] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-09-14T17:14:59.766893] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-09-14T17:14:59.958718] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-09-14T17:14:59.958838] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-09-14T17:14:59.959774] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-09-14T17:14:59.959841] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-09-14T17:14:59.961010] [DEBUG] [LOCAL ] BVN: Trimmed 46983 records to 32333 (keeping 150 days of data) [2025-09-14T17:15:00.095484] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-14T17:15:00.193211] [DEBUG] [LOCAL ] BVN: Primary data saved (32333 records). [2025-09-14T17:15:00.193395] [INFO ] [MAIN ] BVN: Full history saved. [2025-09-14T17:15:00.193497] [INFO ] [MAIN ] Update Progress: 361/2370 symbols completed. BVN took 15.7s. Estimated remaining: 3h 30m 24s. Rate: 9.5 symbols/min [2025-09-14T17:15:00.369080] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:15:00.390768] [DEBUG] [LOCAL ] BW: Loaded 17055 existing records from primary storage. [2025-09-14T17:15:00.390924] [INFO ] [MAIN ] BW: Loaded 17055 existing records. [2025-09-14T17:15:00.564002] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-09-14T17:15:00.567952] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:15:00.569000] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-09-14T17:15:00.569076] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-09-14T17:15:00.569547] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-09-14T17:15:00.569624] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-09-14T17:15:00.931867] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T17:15:00.938315] [INFO ] [REMOTE ] BW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:15:01.358908] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-09-14T17:15:02.158869] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-09-14T17:15:02.451468] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T17:15:02.958835] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-09-14T17:15:03.705580] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-14T17:15:03.758849] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-09-14T17:15:04.437637] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-14T17:15:04.558878] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-09-14T17:15:04.710683] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-14T17:15:04.715441] [INFO ] [REMOTE ] BURL: Full fetch complete (50461 records). [2025-09-14T17:15:04.715552] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-09-14T17:15:05.091878] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-09-14T17:15:05.092031] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-09-14T17:15:05.092681] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-09-14T17:15:05.092740] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-09-14T17:15:05.094140] [DEBUG] [LOCAL ] BURL: Trimmed 50461 records to 34400 (keeping 150 days of data) [2025-09-14T17:15:05.308417] [DEBUG] [LOCAL ] BURL: Primary data saved (34400 records). [2025-09-14T17:15:05.308621] [INFO ] [MAIN ] BURL: Full history saved. [2025-09-14T17:15:05.308785] [INFO ] [MAIN ] Update Progress: 362/2370 symbols completed. BURL took 20.8s. Estimated remaining: 3h 30m 12s. Rate: 9.6 symbols/min [2025-09-14T17:15:05.372063] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-09-14T17:15:05.482874] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:15:05.506197] [DEBUG] [LOCAL ] BWA: Loaded 23382 existing records from primary storage. [2025-09-14T17:15:05.506455] [INFO ] [MAIN ] BWA: Loaded 23382 existing records. [2025-09-14T17:15:05.685198] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:15:05.685577] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-09-14T17:15:05.685638] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-09-14T17:15:05.686288] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-09-14T17:15:05.686348] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-09-14T17:15:05.981579] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-14T17:15:06.057214] [INFO ] [REMOTE ] BV: Full fetch complete (42123 records). [2025-09-14T17:15:06.061915] [INFO ] [REMOTE ] BWA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:15:06.062109] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-09-14T17:15:06.161078] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-09-14T17:15:06.415080] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T17:15:06.503332] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-09-14T17:15:06.503501] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-09-14T17:15:06.504447] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-09-14T17:15:06.504529] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-09-14T17:15:06.506253] [DEBUG] [LOCAL ] BV: Trimmed 42123 records to 28695 (keeping 150 days of data) [2025-09-14T17:15:06.702256] [DEBUG] [LOCAL ] BV: Primary data saved (28695 records). [2025-09-14T17:15:06.702507] [INFO ] [MAIN ] BV: Full history saved. [2025-09-14T17:15:06.702689] [INFO ] [MAIN ] Update Progress: 363/2370 symbols completed. BV took 22.2s. Estimated remaining: 3h 29m 38s. Rate: 9.6 symbols/min [2025-09-14T17:15:06.883830] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:15:06.890612] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-14T17:15:06.893199] [INFO ] [REMOTE ] BUXX: Full fetch complete (16127 records). [2025-09-14T17:15:06.893338] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-09-14T17:15:06.959007] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-09-14T17:15:07.003635] [DEBUG] [LOCAL ] BWG: Loaded 6216 existing records from primary storage. [2025-09-14T17:15:07.046545] [INFO ] [MAIN ] BWG: Loaded 6216 existing records. [2025-09-14T17:15:07.443099] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:15:07.478433] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-09-14T17:15:07.478721] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-09-14T17:15:07.478848] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-09-14T17:15:07.479121] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-09-14T17:15:07.480271] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-09-14T17:15:07.480323] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-09-14T17:15:07.480447] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-09-14T17:15:07.480567] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-09-14T17:15:07.558300] [DEBUG] [LOCAL ] BUXX: Trimmed 16127 records to 11633 (keeping 150 days of data) [2025-09-14T17:15:07.904837] [INFO ] [REMOTE ] BWG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:15:07.905722] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-09-14T17:15:07.925763] [DEBUG] [LOCAL ] BUXX: Primary data saved (11633 records). [2025-09-14T17:15:07.926371] [INFO ] [MAIN ] BUXX: Full history saved. [2025-09-14T17:15:07.926536] [INFO ] [MAIN ] Update Progress: 364/2370 symbols completed. BUXX took 23.4s. Estimated remaining: 3h 29m 4s. Rate: 9.6 symbols/min [2025-09-14T17:15:08.157231] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:15:08.197478] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-14T17:15:08.215514] [DEBUG] [LOCAL ] BWLP: Loaded 14175 existing records from primary storage. [2025-09-14T17:15:08.215751] [INFO ] [MAIN ] BWLP: Loaded 14175 existing records. [2025-09-14T17:15:08.412915] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:15:08.413327] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-09-14T17:15:08.413396] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-09-14T17:15:08.413871] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-09-14T17:15:08.413936] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-09-14T17:15:08.569906] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-09-14T17:15:08.783764] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T17:15:08.830720] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:15:08.833133] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T17:15:09.358891] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-09-14T17:15:10.158880] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-09-14T17:15:10.697392] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-14T17:15:10.738862] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-14T17:15:10.755351] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-14T17:15:10.958833] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-09-14T17:15:11.758866] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-09-14T17:15:12.558840] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-09-14T17:15:12.723567] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-14T17:15:13.216151] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T17:15:13.230333] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-14T17:15:13.358824] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-09-14T17:15:14.158869] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-09-14T17:15:14.958931] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-09-14T17:15:15.374133] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-14T17:15:15.758855] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-09-14T17:15:16.335341] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-14T17:15:16.558798] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-09-14T17:15:16.655992] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T17:15:17.148005] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-14T17:15:17.358841] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-09-14T17:15:17.604839] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T17:15:18.125728] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-14T17:15:18.158767] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-09-14T17:15:18.812826] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-14T17:15:18.958892] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-09-14T17:15:19.758843] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-09-14T17:15:20.528759] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T17:15:20.558871] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-09-14T17:15:21.358804] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-09-14T17:15:21.414610] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T17:15:21.665186] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T17:15:22.158841] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-09-14T17:15:22.468857] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-14T17:15:22.958873] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-09-14T17:15:23.599890] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-14T17:15:23.605507] [INFO ] [REMOTE ] BW: Full fetch complete (42797 records). [2025-09-14T17:15:23.605722] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-09-14T17:15:23.764489] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-09-14T17:15:24.008344] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-09-14T17:15:24.008547] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-09-14T17:15:24.009210] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-09-14T17:15:24.009274] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-09-14T17:15:24.010588] [DEBUG] [LOCAL ] BW: Trimmed 42797 records to 28564 (keeping 150 days of data) [2025-09-14T17:15:24.119633] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T17:15:24.210345] [DEBUG] [LOCAL ] BW: Primary data saved (28564 records). [2025-09-14T17:15:24.210534] [INFO ] [MAIN ] BW: Full history saved. [2025-09-14T17:15:24.210658] [INFO ] [MAIN ] Update Progress: 365/2370 symbols completed. BW took 24.0s. Estimated remaining: 3h 29m 53s. Rate: 9.6 symbols/min [2025-09-14T17:15:24.391525] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:15:24.397971] [DEBUG] [LOCAL ] BWMX: Loaded 4154 existing records from primary storage. [2025-09-14T17:15:24.398124] [INFO ] [MAIN ] BWMX: Loaded 4154 existing records. [2025-09-14T17:15:24.565458] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-09-14T17:15:24.584760] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T17:15:24.589685] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:15:24.594470] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-09-14T17:15:24.594983] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-14T17:15:24.595737] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-09-14T17:15:24.595809] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-09-14T17:15:24.944512] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:15:25.358835] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-09-14T17:15:26.158849] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-09-14T17:15:26.290953] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-14T17:15:26.293054] [INFO ] [REMOTE ] BWG: Full fetch complete (13066 records). [2025-09-14T17:15:26.293154] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-09-14T17:15:26.658674] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-09-14T17:15:26.658812] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-09-14T17:15:26.659173] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-09-14T17:15:26.659227] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-09-14T17:15:26.659776] [DEBUG] [LOCAL ] BWG: Trimmed 13066 records to 9612 (keeping 150 days of data) [2025-09-14T17:15:26.721166] [DEBUG] [LOCAL ] BWG: Primary data saved (9612 records). [2025-09-14T17:15:26.721359] [INFO ] [MAIN ] BWG: Full history saved. [2025-09-14T17:15:26.721479] [INFO ] [MAIN ] Update Progress: 366/2370 symbols completed. BWG took 20.0s. Estimated remaining: 3h 29m 26s. Rate: 9.6 symbols/min [2025-09-14T17:15:26.909043] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:15:26.941944] [DEBUG] [LOCAL ] BWNB: Loaded 1420 existing records from primary storage. [2025-09-14T17:15:26.942120] [INFO ] [MAIN ] BWNB: Loaded 1420 existing records. [2025-09-14T17:15:26.963905] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-09-14T17:15:27.008585] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-14T17:15:27.134955] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:15:27.135214] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-09-14T17:15:27.135275] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-14T17:15:27.135563] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-09-14T17:15:27.135638] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-09-14T17:15:27.510270] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:15:27.529403] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T17:15:27.679355] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-14T17:15:27.758832] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-09-14T17:15:28.368629] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-14T17:15:28.558836] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-09-14T17:15:29.358847] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-09-14T17:15:29.944388] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-14T17:15:30.158801] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-09-14T17:15:30.264696] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T17:15:30.576985] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-14T17:15:30.958849] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-09-14T17:15:31.612279] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-14T17:15:31.758854] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-09-14T17:15:32.360862] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-14T17:15:32.558842] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-09-14T17:15:32.865158] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T17:15:32.873438] [INFO ] [REMOTE ] BWA: Full fetch complete (56858 records). [2025-09-14T17:15:32.873709] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-09-14T17:15:33.277114] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-09-14T17:15:33.277240] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-09-14T17:15:33.277944] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-09-14T17:15:33.278045] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-09-14T17:15:33.279346] [DEBUG] [LOCAL ] BWA: Trimmed 56858 records to 39146 (keeping 150 days of data) [2025-09-14T17:15:33.377314] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-09-14T17:15:33.541124] [DEBUG] [LOCAL ] BWA: Primary data saved (39146 records). [2025-09-14T17:15:33.541316] [INFO ] [MAIN ] BWA: Full history saved. [2025-09-14T17:15:33.541422] [INFO ] [MAIN ] Update Progress: 367/2370 symbols completed. BWA took 28.2s. Estimated remaining: 3h 29m 23s. Rate: 9.6 symbols/min [2025-09-14T17:15:33.723777] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:15:33.727557] [DEBUG] [LOCAL ] BWSN: Loaded 1842 existing records from primary storage. [2025-09-14T17:15:33.727685] [INFO ] [MAIN ] BWSN: Loaded 1842 existing records. [2025-09-14T17:15:33.913541] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:15:33.913844] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-09-14T17:15:33.913910] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-14T17:15:33.914185] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-09-14T17:15:33.914265] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-09-14T17:15:34.162313] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-09-14T17:15:34.263071] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-14T17:15:34.283877] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:15:34.958890] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-09-14T17:15:35.681036] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-14T17:15:35.717230] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-14T17:15:35.758774] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-09-14T17:15:36.558832] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-09-14T17:15:36.654771] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-14T17:15:37.065614] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-14T17:15:37.358955] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-09-14T17:15:38.158868] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-09-14T17:15:38.170224] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-14T17:15:38.958837] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-09-14T17:15:39.394836] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-14T17:15:39.526611] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T17:15:39.758840] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-09-14T17:15:40.329348] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-14T17:15:40.558845] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-09-14T17:15:41.014435] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-14T17:15:41.358825] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-09-14T17:15:42.156562] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-14T17:15:42.159127] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-09-14T17:15:42.879556] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-14T17:15:42.958856] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-09-14T17:15:43.416875] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-14T17:15:43.418331] [INFO ] [REMOTE ] BWMX: Full fetch complete (7855 records). [2025-09-14T17:15:43.418447] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-09-14T17:15:43.766006] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-09-14T17:15:43.789903] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-09-14T17:15:43.790014] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-09-14T17:15:43.790235] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-09-14T17:15:43.790284] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-09-14T17:15:43.790770] [DEBUG] [LOCAL ] BWMX: Trimmed 7855 records to 6394 (keeping 150 days of data) [2025-09-14T17:15:43.830169] [DEBUG] [LOCAL ] BWMX: Primary data saved (6394 records). [2025-09-14T17:15:43.830306] [INFO ] [MAIN ] BWMX: Full history saved. [2025-09-14T17:15:43.830403] [INFO ] [MAIN ] Update Progress: 368/2370 symbols completed. BWMX took 19.6s. Estimated remaining: 3h 29m 39s. Rate: 9.5 symbols/min [2025-09-14T17:15:43.999385] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:15:44.021694] [DEBUG] [LOCAL ] BWXT: Loaded 21361 existing records from primary storage. [2025-09-14T17:15:44.021868] [INFO ] [MAIN ] BWXT: Loaded 21361 existing records. [2025-09-14T17:15:44.197158] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:15:44.197430] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-09-14T17:15:44.197494] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-09-14T17:15:44.198289] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-09-14T17:15:44.198355] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-09-14T17:15:44.558168] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:15:44.562735] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-09-14T17:15:44.563679] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-14T17:15:45.030781] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-14T17:15:45.358887] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-09-14T17:15:46.158891] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-09-14T17:15:46.484415] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-14T17:15:46.488072] [INFO ] [REMOTE ] BWLP: Full fetch complete (35929 records). [2025-09-14T17:15:46.488183] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-09-14T17:15:46.860867] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-09-14T17:15:46.861041] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-09-14T17:15:46.861728] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-09-14T17:15:46.866385] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-09-14T17:15:46.866544] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-14T17:15:46.869541] [DEBUG] [LOCAL ] BWLP: Trimmed 35929 records to 24114 (keeping 150 days of data) [2025-09-14T17:15:46.964186] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-09-14T17:15:47.027436] [DEBUG] [LOCAL ] BWLP: Primary data saved (24114 records). [2025-09-14T17:15:47.027632] [INFO ] [MAIN ] BWLP: Full history saved. [2025-09-14T17:15:47.027758] [INFO ] [MAIN ] Update Progress: 369/2370 symbols completed. BWLP took 39.1s. Estimated remaining: 3h 29m 16s. Rate: 9.6 symbols/min [2025-09-14T17:15:47.197745] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:15:47.224153] [DEBUG] [LOCAL ] BX: Loaded 23941 existing records from primary storage. [2025-09-14T17:15:47.224396] [INFO ] [MAIN ] BX: Loaded 23941 existing records. [2025-09-14T17:15:47.418113] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:15:47.418615] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-09-14T17:15:47.418696] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-09-14T17:15:47.419563] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-09-14T17:15:47.419630] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-09-14T17:15:47.780154] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-09-14T17:15:47.787722] [INFO ] [REMOTE ] BX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:15:48.279075] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-14T17:15:48.558820] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-09-14T17:15:48.642707] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T17:15:49.358846] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-09-14T17:15:50.025048] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-14T17:15:50.158835] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-09-14T17:15:50.665629] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-14T17:15:50.958867] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-09-14T17:15:51.475164] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T17:15:51.476319] [INFO ] [REMOTE ] BWNB: Full fetch complete (4771 records). [2025-09-14T17:15:51.476415] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-09-14T17:15:51.761107] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-09-14T17:15:51.843880] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-09-14T17:15:51.843999] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-09-14T17:15:51.844217] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-09-14T17:15:51.844299] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-09-14T17:15:51.844771] [DEBUG] [LOCAL ] BWNB: Trimmed 4771 records to 3446 (keeping 150 days of data) [2025-09-14T17:15:51.865932] [DEBUG] [LOCAL ] BWNB: Primary data saved (3446 records). [2025-09-14T17:15:51.866063] [INFO ] [MAIN ] BWNB: Full history saved. [2025-09-14T17:15:51.866212] [INFO ] [MAIN ] Update Progress: 370/2370 symbols completed. BWNB took 25.1s. Estimated remaining: 3h 29m 1s. Rate: 9.6 symbols/min [2025-09-14T17:15:52.041483] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:15:52.074188] [DEBUG] [LOCAL ] BXC: Loaded 6262 existing records from primary storage. [2025-09-14T17:15:52.075697] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T17:15:52.085270] [INFO ] [MAIN ] BXC: Loaded 6262 existing records. [2025-09-14T17:15:52.273689] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:15:52.274006] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-09-14T17:15:52.274066] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-09-14T17:15:52.274444] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-09-14T17:15:52.274511] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-09-14T17:15:52.566226] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-09-14T17:15:52.658904] [INFO ] [REMOTE ] BXC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:15:53.186233] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T17:15:53.187481] [INFO ] [REMOTE ] BWSN: Full fetch complete (5345 records). [2025-09-14T17:15:53.187581] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-09-14T17:15:53.365093] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-09-14T17:15:53.552687] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-09-14T17:15:53.552804] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-09-14T17:15:53.552997] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-09-14T17:15:53.553048] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-09-14T17:15:53.553448] [DEBUG] [LOCAL ] BWSN: Trimmed 5345 records to 4133 (keeping 150 days of data) [2025-09-14T17:15:53.580270] [DEBUG] [LOCAL ] BWSN: Primary data saved (4133 records). [2025-09-14T17:15:53.580439] [INFO ] [MAIN ] BWSN: Full history saved. [2025-09-14T17:15:53.580567] [INFO ] [MAIN ] Update Progress: 371/2370 symbols completed. BWSN took 20.0s. Estimated remaining: 3h 28m 31s. Rate: 9.6 symbols/min [2025-09-14T17:15:53.761501] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:15:53.786581] [DEBUG] [LOCAL ] BXMT: Loaded 20689 existing records from primary storage. [2025-09-14T17:15:53.786803] [INFO ] [MAIN ] BXMT: Loaded 20689 existing records. [2025-09-14T17:15:53.997552] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-14T17:15:54.003301] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:15:54.015742] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-09-14T17:15:54.015830] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-09-14T17:15:54.016731] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-09-14T17:15:54.016797] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-09-14T17:15:54.168525] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-09-14T17:15:54.396435] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:15:54.959304] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-09-14T17:15:54.962161] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T17:15:55.081813] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T17:15:55.758875] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-09-14T17:15:56.558833] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-09-14T17:15:56.645753] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T17:15:57.358838] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-09-14T17:15:57.718283] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-14T17:15:58.158842] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-09-14T17:15:58.408986] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T17:15:58.958837] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-09-14T17:15:59.012022] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-14T17:15:59.543054] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-14T17:15:59.758866] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-09-14T17:16:00.558862] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-09-14T17:16:00.733037] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-14T17:16:01.276809] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-14T17:16:01.358796] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-09-14T17:16:02.158870] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-09-14T17:16:02.613358] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-14T17:16:02.918862] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-14T17:16:02.958813] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-09-14T17:16:03.219757] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T17:16:03.758830] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-09-14T17:16:03.876127] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-14T17:16:04.558829] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-09-14T17:16:05.358837] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-09-14T17:16:05.794292] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-14T17:16:06.158807] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-09-14T17:16:06.222124] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T17:16:06.290838] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T17:16:06.958837] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-09-14T17:16:07.758872] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-09-14T17:16:08.047607] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-14T17:16:08.558842] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-09-14T17:16:08.899430] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-14T17:16:09.358818] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-09-14T17:16:09.402339] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T17:16:09.697753] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-14T17:16:09.702976] [INFO ] [REMOTE ] BWXT: Full fetch complete (50734 records). [2025-09-14T17:16:09.703117] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-09-14T17:16:10.099279] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-09-14T17:16:10.099405] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-09-14T17:16:10.100173] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-09-14T17:16:10.100245] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-09-14T17:16:10.101537] [DEBUG] [LOCAL ] BWXT: Trimmed 50734 records to 35100 (keeping 150 days of data) [2025-09-14T17:16:10.163927] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-09-14T17:16:10.355514] [DEBUG] [LOCAL ] BWXT: Primary data saved (35100 records). [2025-09-14T17:16:10.355751] [INFO ] [MAIN ] BWXT: Full history saved. [2025-09-14T17:16:10.355867] [INFO ] [MAIN ] Update Progress: 372/2370 symbols completed. BWXT took 26.5s. Estimated remaining: 3h 29m 21s. Rate: 9.5 symbols/min [2025-09-14T17:16:10.529905] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:16:10.539848] [DEBUG] [LOCAL ] BXMX: Loaded 7543 existing records from primary storage. [2025-09-14T17:16:10.540003] [INFO ] [MAIN ] BXMX: Loaded 7543 existing records. [2025-09-14T17:16:10.718412] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:16:10.718830] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-09-14T17:16:10.718952] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-09-14T17:16:10.719358] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-09-14T17:16:10.719586] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-09-14T17:16:10.853850] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-14T17:16:10.966384] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-09-14T17:16:11.128940] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:16:11.139131] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-14T17:16:11.758879] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-09-14T17:16:12.558839] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-09-14T17:16:12.614874] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-14T17:16:12.636380] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-14T17:16:12.934939] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-14T17:16:12.940476] [INFO ] [REMOTE ] BX: Full fetch complete (58173 records). [2025-09-14T17:16:12.940611] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-09-14T17:16:13.337079] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-09-14T17:16:13.337201] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-09-14T17:16:13.337917] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-09-14T17:16:13.337976] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-09-14T17:16:13.339198] [DEBUG] [LOCAL ] BX: Trimmed 58173 records to 40257 (keeping 150 days of data) [2025-09-14T17:16:13.400350] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-09-14T17:16:13.599887] [DEBUG] [LOCAL ] BX: Primary data saved (40257 records). [2025-09-14T17:16:13.600047] [INFO ] [MAIN ] BX: Full history saved. [2025-09-14T17:16:13.600155] [INFO ] [MAIN ] Update Progress: 373/2370 symbols completed. BX took 26.6s. Estimated remaining: 3h 28m 58s. Rate: 9.6 symbols/min [2025-09-14T17:16:13.768863] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:16:13.789944] [DEBUG] [LOCAL ] BXP: Loaded 22191 existing records from primary storage. [2025-09-14T17:16:13.790141] [INFO ] [MAIN ] BXP: Loaded 22191 existing records. [2025-09-14T17:16:13.974024] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:16:13.974356] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-09-14T17:16:13.974420] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-09-14T17:16:13.975003] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-09-14T17:16:13.975085] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-09-14T17:16:14.167042] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-09-14T17:16:14.340956] [INFO ] [REMOTE ] BXP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:16:14.958800] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-09-14T17:16:15.029478] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-14T17:16:15.031259] [INFO ] [REMOTE ] BXC: Full fetch complete (14530 records). [2025-09-14T17:16:15.031347] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-09-14T17:16:15.391122] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-09-14T17:16:15.391349] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-09-14T17:16:15.391882] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-09-14T17:16:15.392025] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-09-14T17:16:15.392728] [DEBUG] [LOCAL ] BXC: Trimmed 14530 records to 10237 (keeping 150 days of data) [2025-09-14T17:16:15.466351] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-14T17:16:15.489286] [DEBUG] [LOCAL ] BXC: Primary data saved (10237 records). [2025-09-14T17:16:15.489427] [INFO ] [MAIN ] BXC: Full history saved. [2025-09-14T17:16:15.489524] [INFO ] [MAIN ] Update Progress: 374/2370 symbols completed. BXC took 23.6s. Estimated remaining: 3h 28m 29s. Rate: 9.6 symbols/min [2025-09-14T17:16:15.656235] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:16:15.678321] [DEBUG] [LOCAL ] BXSL: Loaded 21207 existing records from primary storage. [2025-09-14T17:16:15.678543] [INFO ] [MAIN ] BXSL: Loaded 21207 existing records. [2025-09-14T17:16:15.766602] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-09-14T17:16:15.853507] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:16:15.853779] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-09-14T17:16:15.853839] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-09-14T17:16:15.854590] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-09-14T17:16:15.854678] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-09-14T17:16:16.204482] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:16:16.434488] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T17:16:16.439407] [INFO ] [REMOTE ] BXMT: Full fetch complete (51807 records). [2025-09-14T17:16:16.439525] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-09-14T17:16:16.559364] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-09-14T17:16:16.815729] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T17:16:16.859519] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-09-14T17:16:16.859631] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-09-14T17:16:16.860434] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-09-14T17:16:16.860492] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-09-14T17:16:16.861664] [DEBUG] [LOCAL ] BXMT: Trimmed 51807 records to 34780 (keeping 150 days of data) [2025-09-14T17:16:17.074472] [DEBUG] [LOCAL ] BXMT: Primary data saved (34780 records). [2025-09-14T17:16:17.074671] [INFO ] [MAIN ] BXMT: Full history saved. [2025-09-14T17:16:17.074777] [INFO ] [MAIN ] Update Progress: 375/2370 symbols completed. BXMT took 23.5s. Estimated remaining: 3h 27m 57s. Rate: 9.6 symbols/min [2025-09-14T17:16:17.252450] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:16:17.263826] [DEBUG] [LOCAL ] BY: Loaded 9981 existing records from primary storage. [2025-09-14T17:16:17.263999] [INFO ] [MAIN ] BY: Loaded 9981 existing records. [2025-09-14T17:16:17.364953] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-09-14T17:16:17.450069] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:16:17.450370] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-09-14T17:16:17.450449] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-09-14T17:16:17.450942] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-09-14T17:16:17.451011] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-09-14T17:16:17.645042] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T17:16:17.846413] [INFO ] [REMOTE ] BY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:16:18.158882] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-09-14T17:16:18.937983] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T17:16:18.967223] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-09-14T17:16:18.970132] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T17:16:19.758907] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-09-14T17:16:20.558910] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-09-14T17:16:20.731591] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T17:16:21.358885] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-09-14T17:16:21.464247] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-14T17:16:21.662722] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T17:16:22.158831] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-09-14T17:16:22.964818] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-09-14T17:16:22.987520] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T17:16:23.561518] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-14T17:16:23.758924] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-09-14T17:16:23.887306] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-14T17:16:24.558895] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-09-14T17:16:24.962790] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-14T17:16:25.358849] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-09-14T17:16:25.544788] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-14T17:16:26.158842] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-09-14T17:16:26.826085] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T17:16:26.958903] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-09-14T17:16:27.759555] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-09-14T17:16:27.765073] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T17:16:28.057353] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-14T17:16:28.558844] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-09-14T17:16:29.116156] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-14T17:16:29.358857] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-09-14T17:16:29.876517] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-14T17:16:30.158823] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-09-14T17:16:30.487387] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-14T17:16:30.958949] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-09-14T17:16:31.758854] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-09-14T17:16:31.846589] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T17:16:32.533415] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T17:16:32.558839] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-09-14T17:16:32.751129] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T17:16:33.358929] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-09-14T17:16:33.762613] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-14T17:16:33.768431] [INFO ] [REMOTE ] BXSL: Full fetch complete (51437 records). [2025-09-14T17:16:33.768676] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-09-14T17:16:34.159205] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-09-14T17:16:34.159124] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-09-14T17:16:34.160479] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-09-14T17:16:34.161355] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-09-14T17:16:34.161870] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-09-14T17:16:34.163963] [DEBUG] [LOCAL ] BXSL: Trimmed 51437 records to 35067 (keeping 150 days of data) [2025-09-14T17:16:34.402188] [DEBUG] [LOCAL ] BXSL: Primary data saved (35067 records). [2025-09-14T17:16:34.402430] [INFO ] [MAIN ] BXSL: Full history saved. [2025-09-14T17:16:34.402564] [INFO ] [MAIN ] Update Progress: 376/2370 symbols completed. BXSL took 18.9s. Estimated remaining: 3h 28m 50s. Rate: 9.5 symbols/min [2025-09-14T17:16:34.597520] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-14T17:16:34.599697] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:16:34.628068] [DEBUG] [LOCAL ] BYD: Loaded 20494 existing records from primary storage. [2025-09-14T17:16:34.628285] [INFO ] [MAIN ] BYD: Loaded 20494 existing records. [2025-09-14T17:16:34.814199] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:16:34.814521] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-09-14T17:16:34.814585] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-09-14T17:16:34.815288] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-09-14T17:16:34.815353] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-09-14T17:16:34.964854] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-09-14T17:16:35.177250] [INFO ] [REMOTE ] BYD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:16:35.192228] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-14T17:16:35.758829] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-09-14T17:16:36.558786] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-09-14T17:16:36.801812] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-14T17:16:36.950761] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-14T17:16:37.358889] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-09-14T17:16:38.158848] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-09-14T17:16:38.195197] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-14T17:16:38.233664] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T17:16:38.958833] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-09-14T17:16:39.538068] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-14T17:16:39.758897] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-09-14T17:16:40.488908] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T17:16:40.491358] [INFO ] [REMOTE ] BY: Full fetch complete (22454 records). [2025-09-14T17:16:40.491449] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-09-14T17:16:40.564032] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-09-14T17:16:40.888111] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-09-14T17:16:40.888352] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-09-14T17:16:40.888921] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-09-14T17:16:40.889090] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-09-14T17:16:40.890282] [DEBUG] [LOCAL ] BY: Trimmed 22454 records to 16124 (keeping 150 days of data) [2025-09-14T17:16:41.001355] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-14T17:16:41.040600] [DEBUG] [LOCAL ] BY: Primary data saved (16124 records). [2025-09-14T17:16:41.040802] [INFO ] [MAIN ] BY: Full history saved. [2025-09-14T17:16:41.040913] [INFO ] [MAIN ] Update Progress: 377/2370 symbols completed. BY took 24.0s. Estimated remaining: 3h 28m 46s. Rate: 9.5 symbols/min [2025-09-14T17:16:41.212295] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:16:41.219322] [DEBUG] [LOCAL ] BYM: Loaded 4794 existing records from primary storage. [2025-09-14T17:16:41.219513] [INFO ] [MAIN ] BYM: Loaded 4794 existing records. [2025-09-14T17:16:41.364430] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-09-14T17:16:41.410189] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:16:41.410948] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-09-14T17:16:41.411012] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-09-14T17:16:41.411360] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-09-14T17:16:41.411424] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-09-14T17:16:41.765585] [INFO ] [REMOTE ] BYM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:16:41.786505] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-14T17:16:42.158863] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-09-14T17:16:42.903184] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T17:16:42.905320] [INFO ] [REMOTE ] BXMX: Full fetch complete (21312 records). [2025-09-14T17:16:42.905435] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-09-14T17:16:42.967932] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-09-14T17:16:43.273069] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-09-14T17:16:43.273202] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-09-14T17:16:43.273627] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-09-14T17:16:43.273732] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-09-14T17:16:43.274451] [DEBUG] [LOCAL ] BXMX: Trimmed 21312 records to 13751 (keeping 150 days of data) [2025-09-14T17:16:43.364359] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-14T17:16:43.404474] [DEBUG] [LOCAL ] BXMX: Primary data saved (13751 records). [2025-09-14T17:16:43.404690] [INFO ] [MAIN ] BXMX: Full history saved. [2025-09-14T17:16:43.404797] [INFO ] [MAIN ] Update Progress: 378/2370 symbols completed. BXMX took 33.0s. Estimated remaining: 3h 28m 19s. Rate: 9.6 symbols/min [2025-09-14T17:16:43.579995] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:16:43.595939] [DEBUG] [LOCAL ] BZH: Loaded 14369 existing records from primary storage. [2025-09-14T17:16:43.596103] [INFO ] [MAIN ] BZH: Loaded 14369 existing records. [2025-09-14T17:16:43.771177] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-09-14T17:16:43.776161] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:16:43.777354] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-09-14T17:16:43.777434] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-09-14T17:16:43.777969] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-09-14T17:16:43.778045] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-09-14T17:16:44.141530] [INFO ] [REMOTE ] BZH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:16:44.157233] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-14T17:16:44.162786] [INFO ] [REMOTE ] BXP: Full fetch complete (54124 records). [2025-09-14T17:16:44.162971] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-09-14T17:16:44.564545] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-09-14T17:16:44.566468] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-09-14T17:16:44.566542] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-09-14T17:16:44.567527] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-09-14T17:16:44.567741] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-09-14T17:16:44.571231] [DEBUG] [LOCAL ] BXP: Trimmed 54124 records to 37306 (keeping 150 days of data) [2025-09-14T17:16:44.695236] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-14T17:16:44.828089] [DEBUG] [LOCAL ] BXP: Primary data saved (37306 records). [2025-09-14T17:16:44.828302] [INFO ] [MAIN ] BXP: Full history saved. [2025-09-14T17:16:44.828440] [INFO ] [MAIN ] Update Progress: 379/2370 symbols completed. BXP took 31.2s. Estimated remaining: 3h 27m 47s. Rate: 9.6 symbols/min [2025-09-14T17:16:45.000307] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:16:45.024679] [DEBUG] [LOCAL ] C: Loaded 24152 existing records from primary storage. [2025-09-14T17:16:45.024882] [INFO ] [MAIN ] C: Loaded 24152 existing records. [2025-09-14T17:16:45.204457] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:16:45.204781] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-09-14T17:16:45.204847] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-09-14T17:16:45.209480] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-09-14T17:16:45.210071] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-09-14T17:16:45.367566] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-09-14T17:16:45.633526] [INFO ] [REMOTE ] C: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:16:46.158851] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-09-14T17:16:46.626101] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-14T17:16:46.958900] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-09-14T17:16:47.736724] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-14T17:16:47.758773] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-09-14T17:16:47.871988] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T17:16:48.024299] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-14T17:16:48.558894] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-09-14T17:16:49.358822] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-09-14T17:16:49.555993] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-14T17:16:49.898983] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-14T17:16:50.158898] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-09-14T17:16:50.958838] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-09-14T17:16:51.063489] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-14T17:16:51.685663] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-14T17:16:51.758839] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-09-14T17:16:52.558881] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-09-14T17:16:52.705307] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-14T17:16:52.887333] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-14T17:16:53.174786] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-14T17:16:53.358889] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-09-14T17:16:54.158907] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-09-14T17:16:54.958925] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-09-14T17:16:55.001114] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T17:16:55.758980] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-09-14T17:16:56.017958] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-14T17:16:56.088307] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T17:16:56.093369] [INFO ] [REMOTE ] BYD: Full fetch complete (49284 records). [2025-09-14T17:16:56.093547] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-09-14T17:16:56.498894] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-09-14T17:16:56.499020] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-09-14T17:16:56.499795] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-09-14T17:16:56.499875] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-09-14T17:16:56.502772] [DEBUG] [LOCAL ] BYD: Trimmed 49284 records to 33858 (keeping 150 days of data) [2025-09-14T17:16:56.564216] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-09-14T17:16:56.737205] [DEBUG] [LOCAL ] BYD: Primary data saved (33858 records). [2025-09-14T17:16:56.737410] [INFO ] [MAIN ] BYD: Full history saved. [2025-09-14T17:16:56.737612] [INFO ] [MAIN ] Update Progress: 380/2370 symbols completed. BYD took 22.3s. Estimated remaining: 3h 28m 10s. Rate: 9.6 symbols/min [2025-09-14T17:16:56.918773] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:16:56.928631] [DEBUG] [LOCAL ] CAAP: Loaded 7949 existing records from primary storage. [2025-09-14T17:16:56.928844] [INFO ] [MAIN ] CAAP: Loaded 7949 existing records. [2025-09-14T17:16:57.110528] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:16:57.110844] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-09-14T17:16:57.110929] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-09-14T17:16:57.111326] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-09-14T17:16:57.111388] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-09-14T17:16:57.361947] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-09-14T17:16:57.460860] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (3.30 seconds). [2025-09-14T17:16:57.531627] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:16:57.641257] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T17:16:58.158864] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-09-14T17:16:58.319470] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-14T17:16:58.958849] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-09-14T17:16:59.574617] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-14T17:16:59.758847] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-09-14T17:16:59.891120] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T17:17:00.558868] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-09-14T17:17:00.711126] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-14T17:17:01.358843] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-09-14T17:17:02.027527] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T17:17:02.158393] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-14T17:17:02.160720] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-09-14T17:17:02.958886] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-09-14T17:17:03.261882] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-14T17:17:03.758893] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-09-14T17:17:03.772206] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T17:17:03.774921] [INFO ] [REMOTE ] BYM: Full fetch complete (13097 records). [2025-09-14T17:17:03.775102] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-09-14T17:17:04.146100] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-09-14T17:17:04.146266] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-09-14T17:17:04.146680] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-09-14T17:17:04.146756] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-09-14T17:17:04.147336] [DEBUG] [LOCAL ] BYM: Trimmed 13097 records to 8535 (keeping 150 days of data) [2025-09-14T17:17:04.201971] [DEBUG] [LOCAL ] BYM: Primary data saved (8535 records). [2025-09-14T17:17:04.202148] [INFO ] [MAIN ] BYM: Full history saved. [2025-09-14T17:17:04.202282] [INFO ] [MAIN ] Update Progress: 381/2370 symbols completed. BYM took 23.2s. Estimated remaining: 3h 28m 10s. Rate: 9.6 symbols/min [2025-09-14T17:17:04.374301] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:17:04.385759] [DEBUG] [LOCAL ] CABO: Loaded 8088 existing records from primary storage. [2025-09-14T17:17:04.385904] [INFO ] [MAIN ] CABO: Loaded 8088 existing records. [2025-09-14T17:17:04.561315] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-09-14T17:17:04.564598] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:17:04.565906] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-09-14T17:17:04.565969] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-09-14T17:17:04.566358] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-09-14T17:17:04.566410] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-09-14T17:17:04.945297] [INFO ] [REMOTE ] CABO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:17:04.960515] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-14T17:17:05.358881] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-09-14T17:17:06.158896] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-09-14T17:17:06.420418] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-14T17:17:06.622076] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-14T17:17:06.958827] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-09-14T17:17:07.434192] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T17:17:07.758867] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-09-14T17:17:08.558802] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-09-14T17:17:08.708800] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-14T17:17:09.040893] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-14T17:17:09.358848] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-09-14T17:17:09.425932] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T17:17:09.429793] [INFO ] [REMOTE ] BZH: Full fetch complete (36423 records). [2025-09-14T17:17:09.429894] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-09-14T17:17:09.798412] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-09-14T17:17:09.798535] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-09-14T17:17:09.799085] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-09-14T17:17:09.799143] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-09-14T17:17:09.800410] [DEBUG] [LOCAL ] BZH: Trimmed 36423 records to 24562 (keeping 150 days of data) [2025-09-14T17:17:09.963744] [DEBUG] [LOCAL ] BZH: Primary data saved (24562 records). [2025-09-14T17:17:09.963979] [INFO ] [MAIN ] BZH: Full history saved. [2025-09-14T17:17:09.964105] [INFO ] [MAIN ] Update Progress: 382/2370 symbols completed. BZH took 26.6s. Estimated remaining: 3h 28m 1s. Rate: 9.6 symbols/min [2025-09-14T17:17:10.149669] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:17:10.161905] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-09-14T17:17:10.161747] [DEBUG] [LOCAL ] CACI: Loaded 9042 existing records from primary storage. [2025-09-14T17:17:10.163389] [INFO ] [MAIN ] CACI: Loaded 9042 existing records. [2025-09-14T17:17:10.348134] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:17:10.348453] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-09-14T17:17:10.348520] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-09-14T17:17:10.348967] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-09-14T17:17:10.349033] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-09-14T17:17:10.744212] [INFO ] [REMOTE ] CACI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:17:10.760059] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-14T17:17:10.958854] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-09-14T17:17:11.249863] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-14T17:17:11.758904] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-09-14T17:17:12.350915] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T17:17:12.558886] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-09-14T17:17:12.769787] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-14T17:17:13.358967] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-09-14T17:17:13.813335] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-14T17:17:14.158836] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-09-14T17:17:14.958815] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-09-14T17:17:15.065890] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-14T17:17:15.068824] [INFO ] [REMOTE ] CAAP: Full fetch complete (20148 records). [2025-09-14T17:17:15.068930] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-09-14T17:17:15.450987] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-09-14T17:17:15.451142] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-09-14T17:17:15.451755] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-09-14T17:17:15.451875] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-09-14T17:17:15.453108] [DEBUG] [LOCAL ] CAAP: Trimmed 20148 records to 13531 (keeping 150 days of data) [2025-09-14T17:17:15.556391] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-14T17:17:15.578703] [DEBUG] [LOCAL ] CAAP: Primary data saved (13531 records). [2025-09-14T17:17:15.578853] [INFO ] [MAIN ] CAAP: Full history saved. [2025-09-14T17:17:15.578990] [INFO ] [MAIN ] Update Progress: 383/2370 symbols completed. CAAP took 18.8s. Estimated remaining: 3h 27m 51s. Rate: 9.6 symbols/min [2025-09-14T17:17:15.751807] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:17:15.758817] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-09-14T17:17:15.777578] [DEBUG] [LOCAL ] CADE: Loaded 22503 existing records from primary storage. [2025-09-14T17:17:15.777758] [INFO ] [MAIN ] CADE: Loaded 22503 existing records. [2025-09-14T17:17:15.953486] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:17:15.953929] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-09-14T17:17:15.954003] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-14T17:17:15.962424] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-09-14T17:17:15.963519] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-14T17:17:15.963219] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-09-14T17:17:16.330978] [INFO ] [REMOTE ] CADE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:17:16.558841] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-09-14T17:17:17.358835] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-09-14T17:17:17.706769] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-14T17:17:17.785543] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-14T17:17:18.158845] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-09-14T17:17:18.495978] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-14T17:17:18.503188] [INFO ] [REMOTE ] C: Full fetch complete (58421 records). [2025-09-14T17:17:18.503522] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-09-14T17:17:18.926559] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-09-14T17:17:18.926724] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-09-14T17:17:18.927578] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-09-14T17:17:18.927700] [DEBUG] [LOCAL ] C: Saving primary data. [2025-09-14T17:17:18.929394] [DEBUG] [LOCAL ] C: Trimmed 58421 records to 40482 (keeping 150 days of data) [2025-09-14T17:17:18.951950] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T17:17:18.959916] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-09-14T17:17:19.221007] [DEBUG] [LOCAL ] C: Primary data saved (40482 records). [2025-09-14T17:17:19.221180] [INFO ] [MAIN ] C: Full history saved. [2025-09-14T17:17:19.221291] [INFO ] [MAIN ] Update Progress: 384/2370 symbols completed. C took 34.4s. Estimated remaining: 3h 27m 31s. Rate: 9.6 symbols/min [2025-09-14T17:17:19.415413] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:17:19.435733] [DEBUG] [LOCAL ] CAE: Loaded 17385 existing records from primary storage. [2025-09-14T17:17:19.435952] [INFO ] [MAIN ] CAE: Loaded 17385 existing records. [2025-09-14T17:17:19.626343] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:17:19.626764] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-09-14T17:17:19.626851] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-09-14T17:17:19.627488] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-09-14T17:17:19.627562] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-09-14T17:17:19.773524] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-09-14T17:17:19.999332] [INFO ] [REMOTE ] CAE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:17:20.558818] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-09-14T17:17:20.659939] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T17:17:20.863838] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T17:17:21.358810] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-09-14T17:17:21.421408] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T17:17:22.158845] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-09-14T17:17:22.614726] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T17:17:22.958850] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-09-14T17:17:23.243943] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T17:17:23.758874] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-09-14T17:17:23.942752] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-14T17:17:24.558852] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-09-14T17:17:25.358859] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-09-14T17:17:25.511625] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T17:17:25.625960] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-14T17:17:26.158833] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-09-14T17:17:26.375053] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-09-14T17:17:26.377095] [INFO ] [REMOTE ] CABO: Full fetch complete (19202 records). [2025-09-14T17:17:26.377214] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-09-14T17:17:26.744860] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-09-14T17:17:26.744986] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-09-14T17:17:26.745516] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-09-14T17:17:26.745670] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-09-14T17:17:26.758167] [DEBUG] [LOCAL ] CABO: Trimmed 19202 records to 13907 (keeping 150 days of data) [2025-09-14T17:17:26.759065] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-14T17:17:26.851496] [DEBUG] [LOCAL ] CABO: Primary data saved (13907 records). [2025-09-14T17:17:26.851721] [INFO ] [MAIN ] CABO: Full history saved. [2025-09-14T17:17:26.851831] [INFO ] [MAIN ] Update Progress: 385/2370 symbols completed. CABO took 22.6s. Estimated remaining: 3h 27m 32s. Rate: 9.6 symbols/min [2025-09-14T17:17:26.959858] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-09-14T17:17:27.037297] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:17:27.040404] [DEBUG] [LOCAL ] CAF: Loaded 1229 existing records from primary storage. [2025-09-14T17:17:27.040498] [INFO ] [MAIN ] CAF: Loaded 1229 existing records. [2025-09-14T17:17:27.221956] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:17:27.222260] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-09-14T17:17:27.222373] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-09-14T17:17:27.222598] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-09-14T17:17:27.222695] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-09-14T17:17:27.588104] [INFO ] [REMOTE ] CAF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:17:27.758843] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-09-14T17:17:28.558849] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-09-14T17:17:28.788461] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-14T17:17:29.240280] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-14T17:17:29.358923] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-09-14T17:17:29.515980] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-14T17:17:29.965260] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-14T17:17:30.158911] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-09-14T17:17:30.958857] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-09-14T17:17:31.406834] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-14T17:17:31.663067] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-14T17:17:31.758863] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-09-14T17:17:32.408765] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-14T17:17:32.559033] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-09-14T17:17:33.358863] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-09-14T17:17:34.071850] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T17:17:34.158840] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-09-14T17:17:34.750820] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-14T17:17:34.958797] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-09-14T17:17:34.993816] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T17:17:35.758820] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-09-14T17:17:35.958634] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-14T17:17:36.558859] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-09-14T17:17:37.364014] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-09-14T17:17:37.380950] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-14T17:17:37.841930] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-14T17:17:37.901153] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T17:17:37.903828] [INFO ] [REMOTE ] CACI: Full fetch complete (29741 records). [2025-09-14T17:17:37.903931] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-09-14T17:17:38.158870] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-09-14T17:17:38.282076] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-09-14T17:17:38.282193] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-09-14T17:17:38.282684] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-09-14T17:17:38.282743] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-09-14T17:17:38.283511] [DEBUG] [LOCAL ] CACI: Trimmed 29741 records to 17208 (keeping 150 days of data) [2025-09-14T17:17:38.387771] [DEBUG] [LOCAL ] CACI: Primary data saved (17208 records). [2025-09-14T17:17:38.388003] [INFO ] [MAIN ] CACI: Full history saved. [2025-09-14T17:17:38.388146] [INFO ] [MAIN ] Update Progress: 386/2370 symbols completed. CACI took 28.4s. Estimated remaining: 3h 27m 53s. Rate: 9.5 symbols/min [2025-09-14T17:17:38.578580] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:17:38.604678] [DEBUG] [LOCAL ] CAG: Loaded 24099 existing records from primary storage. [2025-09-14T17:17:38.604870] [INFO ] [MAIN ] CAG: Loaded 24099 existing records. [2025-09-14T17:17:38.788723] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:17:38.789026] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-09-14T17:17:38.789102] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-09-14T17:17:38.790084] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-09-14T17:17:38.790166] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-09-14T17:17:38.975813] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-09-14T17:17:39.175527] [INFO ] [REMOTE ] CAG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:17:39.758851] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-09-14T17:17:39.902822] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T17:17:40.558917] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-09-14T17:17:40.725200] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-14T17:17:41.207717] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T17:17:41.358842] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-09-14T17:17:42.164448] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-09-14T17:17:42.170408] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T17:17:42.754187] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-14T17:17:42.958874] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-09-14T17:17:43.582459] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-14T17:17:43.620489] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T17:17:43.628108] [INFO ] [REMOTE ] CADE: Full fetch complete (52631 records). [2025-09-14T17:17:43.628394] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-09-14T17:17:43.764130] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-09-14T17:17:44.171358] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-09-14T17:17:44.171552] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-09-14T17:17:44.173015] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-09-14T17:17:44.173132] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-09-14T17:17:44.175041] [DEBUG] [LOCAL ] CADE: Trimmed 52631 records to 37014 (keeping 150 days of data) [2025-09-14T17:17:44.499008] [DEBUG] [LOCAL ] CADE: Primary data saved (37014 records). [2025-09-14T17:17:44.499256] [INFO ] [MAIN ] CADE: Full history saved. [2025-09-14T17:17:44.499400] [INFO ] [MAIN ] Update Progress: 387/2370 symbols completed. CADE took 28.9s. Estimated remaining: 3h 27m 46s. Rate: 9.5 symbols/min [2025-09-14T17:17:44.566569] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-09-14T17:17:44.718794] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:17:44.744946] [DEBUG] [LOCAL ] CAH: Loaded 23005 existing records from primary storage. [2025-09-14T17:17:44.745153] [INFO ] [MAIN ] CAH: Loaded 23005 existing records. [2025-09-14T17:17:44.929946] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:17:44.930347] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-09-14T17:17:44.930422] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-09-14T17:17:44.931266] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-09-14T17:17:44.931347] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-09-14T17:17:45.304594] [INFO ] [REMOTE ] CAH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:17:45.358824] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-09-14T17:17:45.646195] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T17:17:45.939819] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-14T17:17:45.943732] [INFO ] [REMOTE ] CAE: Full fetch complete (42466 records). [2025-09-14T17:17:45.943837] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-09-14T17:17:46.164143] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-09-14T17:17:46.326394] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-09-14T17:17:46.326542] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-09-14T17:17:46.327182] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-09-14T17:17:46.327246] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-09-14T17:17:46.328498] [DEBUG] [LOCAL ] CAE: Trimmed 42466 records to 28792 (keeping 150 days of data) [2025-09-14T17:17:46.501510] [DEBUG] [LOCAL ] CAE: Primary data saved (28792 records). [2025-09-14T17:17:46.501759] [INFO ] [MAIN ] CAE: Full history saved. [2025-09-14T17:17:46.501889] [INFO ] [MAIN ] Update Progress: 388/2370 symbols completed. CAE took 27.3s. Estimated remaining: 3h 27m 18s. Rate: 9.6 symbols/min [2025-09-14T17:17:46.611164] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-14T17:17:46.689848] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:17:46.711711] [DEBUG] [LOCAL ] CAL: Loaded 18787 existing records from primary storage. [2025-09-14T17:17:46.712008] [INFO ] [MAIN ] CAL: Loaded 18787 existing records. [2025-09-14T17:17:46.909822] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:17:46.910380] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-09-14T17:17:46.910454] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-09-14T17:17:46.929217] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-09-14T17:17:46.939538] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-09-14T17:17:46.963995] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-09-14T17:17:46.975070] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-14T17:17:47.361263] [INFO ] [REMOTE ] CAL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:17:47.574616] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-14T17:17:47.758873] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-09-14T17:17:48.558870] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-09-14T17:17:48.968621] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-14T17:17:49.358901] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-09-14T17:17:50.158895] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-09-14T17:17:50.526962] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-14T17:17:50.553476] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T17:17:50.554599] [INFO ] [REMOTE ] CAF: Full fetch complete (3957 records). [2025-09-14T17:17:50.554711] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-09-14T17:17:50.927483] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-09-14T17:17:50.927618] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-09-14T17:17:50.927839] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-09-14T17:17:50.927897] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-09-14T17:17:50.928348] [DEBUG] [LOCAL ] CAF: Trimmed 3957 records to 2328 (keeping 150 days of data) [2025-09-14T17:17:50.944584] [DEBUG] [LOCAL ] CAF: Primary data saved (2328 records). [2025-09-14T17:17:50.944834] [INFO ] [MAIN ] CAF: Full history saved. [2025-09-14T17:17:50.944987] [INFO ] [MAIN ] Update Progress: 389/2370 symbols completed. CAF took 24.1s. Estimated remaining: 3h 27m 2s. Rate: 9.6 symbols/min [2025-09-14T17:17:50.967282] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-09-14T17:17:51.128167] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:17:51.148284] [DEBUG] [LOCAL ] CALX: Loaded 17044 existing records from primary storage. [2025-09-14T17:17:51.148521] [INFO ] [MAIN ] CALX: Loaded 17044 existing records. [2025-09-14T17:17:51.333602] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:17:51.334027] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-09-14T17:17:51.334114] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-09-14T17:17:51.399027] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-09-14T17:17:51.419444] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-09-14T17:17:51.501960] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-14T17:17:51.764060] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-09-14T17:17:51.839803] [INFO ] [REMOTE ] CALX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:17:52.287237] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-14T17:17:52.558894] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-09-14T17:17:53.358877] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-09-14T17:17:54.158854] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-09-14T17:17:54.228398] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-09-14T17:17:54.531709] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-14T17:17:54.958897] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-09-14T17:17:55.758860] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-09-14T17:17:56.425041] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (3.07 seconds). [2025-09-14T17:17:56.558873] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-09-14T17:17:56.912093] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-14T17:17:57.008722] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-14T17:17:57.317996] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (3.16 seconds). [2025-09-14T17:17:57.358834] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-09-14T17:17:58.158918] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-09-14T17:17:58.380729] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T17:17:58.958853] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-09-14T17:17:59.486624] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-14T17:17:59.647760] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-14T17:17:59.758882] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-09-14T17:18:00.569389] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-09-14T17:18:00.574813] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-14T17:18:01.042089] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T17:18:01.358896] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-09-14T17:18:02.158902] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-09-14T17:18:02.765188] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-14T17:18:02.965271] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-09-14T17:18:02.968221] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T17:18:03.758872] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-09-14T17:18:04.011064] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T17:18:04.178040] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-14T17:18:04.183792] [INFO ] [REMOTE ] CAG: Full fetch complete (58335 records). [2025-09-14T17:18:04.183947] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-09-14T17:18:04.566957] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-09-14T17:18:04.588928] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-09-14T17:18:04.589080] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-09-14T17:18:04.590142] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-09-14T17:18:04.590392] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-09-14T17:18:04.592882] [DEBUG] [LOCAL ] CAG: Trimmed 58335 records to 40406 (keeping 150 days of data) [2025-09-14T17:18:04.855040] [DEBUG] [LOCAL ] CAG: Primary data saved (40406 records). [2025-09-14T17:18:04.855238] [INFO ] [MAIN ] CAG: Full history saved. [2025-09-14T17:18:04.855397] [INFO ] [MAIN ] Update Progress: 390/2370 symbols completed. CAG took 26.5s. Estimated remaining: 3h 27m 35s. Rate: 9.5 symbols/min [2025-09-14T17:18:05.025356] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:18:05.039254] [DEBUG] [LOCAL ] CANG: Loaded 13033 existing records from primary storage. [2025-09-14T17:18:05.039427] [INFO ] [MAIN ] CANG: Loaded 13033 existing records. [2025-09-14T17:18:05.217636] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:18:05.217912] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-09-14T17:18:05.217986] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-09-14T17:18:05.218470] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-09-14T17:18:05.218547] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-09-14T17:18:05.372793] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-09-14T17:18:05.602012] [INFO ] [REMOTE ] CANG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:18:06.158874] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-09-14T17:18:06.242280] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-09-14T17:18:06.793508] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-14T17:18:06.861064] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-14T17:18:06.958852] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-09-14T17:18:07.000029] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-14T17:18:07.758833] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-09-14T17:18:08.561174] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-09-14T17:18:08.564285] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T17:18:09.110082] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-14T17:18:09.200209] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:18:09.205074] [INFO ] [REMOTE ] CAL: Full fetch complete (46941 records). [2025-09-14T17:18:09.205185] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-09-14T17:18:09.363395] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-09-14T17:18:09.587955] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-09-14T17:18:09.588089] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-09-14T17:18:09.588771] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-09-14T17:18:09.588831] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-09-14T17:18:09.589968] [DEBUG] [LOCAL ] CAL: Trimmed 46941 records to 32070 (keeping 150 days of data) [2025-09-14T17:18:09.787840] [DEBUG] [LOCAL ] CAL: Primary data saved (32070 records). [2025-09-14T17:18:09.788031] [INFO ] [MAIN ] CAL: Full history saved. [2025-09-14T17:18:09.788128] [INFO ] [MAIN ] Update Progress: 391/2370 symbols completed. CAL took 23.3s. Estimated remaining: 3h 27m 21s. Rate: 9.5 symbols/min [2025-09-14T17:18:09.959939] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:18:09.964594] [DEBUG] [LOCAL ] CAPL: Loaded 2347 existing records from primary storage. [2025-09-14T17:18:09.964753] [INFO ] [MAIN ] CAPL: Loaded 2347 existing records. [2025-09-14T17:18:10.143918] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:18:10.144247] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-09-14T17:18:10.144309] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-09-14T17:18:10.144639] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-09-14T17:18:10.144734] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-09-14T17:18:10.159426] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-09-14T17:18:10.515888] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:18:10.530906] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-14T17:18:10.958855] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-09-14T17:18:11.388406] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-14T17:18:11.758938] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-09-14T17:18:12.153182] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-14T17:18:12.558830] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-09-14T17:18:13.315818] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T17:18:13.358791] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-09-14T17:18:13.590519] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T17:18:13.791165] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T17:18:13.794939] [INFO ] [REMOTE ] CALX: Full fetch complete (41877 records). [2025-09-14T17:18:13.795043] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-09-14T17:18:14.165767] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-09-14T17:18:14.168274] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-09-14T17:18:14.169235] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-09-14T17:18:14.169925] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-09-14T17:18:14.169990] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-09-14T17:18:14.171117] [DEBUG] [LOCAL ] CALX: Trimmed 41877 records to 28955 (keeping 150 days of data) [2025-09-14T17:18:14.350254] [DEBUG] [LOCAL ] CALX: Primary data saved (28955 records). [2025-09-14T17:18:14.350441] [INFO ] [MAIN ] CALX: Full history saved. [2025-09-14T17:18:14.350544] [INFO ] [MAIN ] Update Progress: 392/2370 symbols completed. CALX took 23.4s. Estimated remaining: 3h 27m 6s. Rate: 9.6 symbols/min [2025-09-14T17:18:14.519582] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:18:14.542248] [DEBUG] [LOCAL ] CARR: Loaded 23996 existing records from primary storage. [2025-09-14T17:18:14.542463] [INFO ] [MAIN ] CARR: Loaded 23996 existing records. [2025-09-14T17:18:14.716736] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:18:14.717029] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-09-14T17:18:14.717107] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-09-14T17:18:14.717865] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-09-14T17:18:14.717952] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-09-14T17:18:14.969913] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-09-14T17:18:15.042210] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T17:18:15.097166] [INFO ] [REMOTE ] CARR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:18:15.758815] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-09-14T17:18:15.798412] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-14T17:18:15.803776] [INFO ] [REMOTE ] CAH: Full fetch complete (56160 records). [2025-09-14T17:18:15.803893] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-09-14T17:18:16.180598] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-09-14T17:18:16.180741] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-09-14T17:18:16.181476] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-09-14T17:18:16.181534] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-09-14T17:18:16.182745] [DEBUG] [LOCAL ] CAH: Trimmed 56160 records to 38710 (keeping 150 days of data) [2025-09-14T17:18:16.295544] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-14T17:18:16.441017] [DEBUG] [LOCAL ] CAH: Primary data saved (38710 records). [2025-09-14T17:18:16.441202] [INFO ] [MAIN ] CAH: Full history saved. [2025-09-14T17:18:16.441303] [INFO ] [MAIN ] Update Progress: 393/2370 symbols completed. CAH took 31.9s. Estimated remaining: 3h 26m 39s. Rate: 9.6 symbols/min [2025-09-14T17:18:16.563998] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-09-14T17:18:16.615272] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:18:16.634150] [DEBUG] [LOCAL ] CARS: Loaded 17231 existing records from primary storage. [2025-09-14T17:18:16.634326] [INFO ] [MAIN ] CARS: Loaded 17231 existing records. [2025-09-14T17:18:16.809211] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:18:16.809496] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-09-14T17:18:16.809556] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-09-14T17:18:16.810109] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-09-14T17:18:16.810200] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-09-14T17:18:17.153919] [INFO ] [REMOTE ] CARS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:18:17.358815] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-09-14T17:18:18.158894] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-09-14T17:18:18.402539] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-14T17:18:18.462173] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T17:18:18.958843] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-09-14T17:18:19.402303] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-14T17:18:19.758862] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-09-14T17:18:20.565911] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-09-14T17:18:20.589448] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T17:18:21.358892] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-09-14T17:18:21.613218] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-14T17:18:22.062558] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T17:18:22.158793] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-09-14T17:18:22.445448] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T17:18:22.958899] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-09-14T17:18:23.758861] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-09-14T17:18:23.983190] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-14T17:18:24.202458] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-14T17:18:24.558887] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-09-14T17:18:25.033100] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-14T17:18:25.060494] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-14T17:18:25.358859] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-09-14T17:18:26.158899] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-09-14T17:18:26.768447] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-14T17:18:26.958862] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-09-14T17:18:27.261227] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-14T17:18:27.730728] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-14T17:18:27.758775] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-09-14T17:18:28.558905] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-09-14T17:18:28.745996] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-14T17:18:28.749611] [INFO ] [REMOTE ] CANG: Full fetch complete (29040 records). [2025-09-14T17:18:28.749717] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-09-14T17:18:29.116107] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-09-14T17:18:29.116219] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-09-14T17:18:29.116844] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-09-14T17:18:29.116908] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-09-14T17:18:29.117706] [DEBUG] [LOCAL ] CANG: Trimmed 29040 records to 20289 (keeping 150 days of data) [2025-09-14T17:18:29.234474] [DEBUG] [LOCAL ] CANG: Primary data saved (20289 records). [2025-09-14T17:18:29.234670] [INFO ] [MAIN ] CANG: Full history saved. [2025-09-14T17:18:29.234770] [INFO ] [MAIN ] Update Progress: 394/2370 symbols completed. CANG took 24.4s. Estimated remaining: 3h 27m 5s. Rate: 9.5 symbols/min [2025-09-14T17:18:29.364033] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-09-14T17:18:29.408046] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:18:29.432718] [DEBUG] [LOCAL ] CAT: Loaded 23753 existing records from primary storage. [2025-09-14T17:18:29.432898] [INFO ] [MAIN ] CAT: Loaded 23753 existing records. [2025-09-14T17:18:29.608213] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:18:29.608456] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-09-14T17:18:29.608515] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-09-14T17:18:29.609279] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-09-14T17:18:29.609352] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-09-14T17:18:29.973219] [INFO ] [REMOTE ] CAT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:18:30.153477] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T17:18:30.161544] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-09-14T17:18:30.168990] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-14T17:18:30.958846] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-09-14T17:18:31.758851] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-09-14T17:18:31.982858] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T17:18:32.172887] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T17:18:32.174050] [INFO ] [REMOTE ] CAPL: Full fetch complete (6397 records). [2025-09-14T17:18:32.174147] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-09-14T17:18:32.533985] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-09-14T17:18:32.534091] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-09-14T17:18:32.534284] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-09-14T17:18:32.534336] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-09-14T17:18:32.534775] [DEBUG] [LOCAL ] CAPL: Trimmed 6397 records to 3919 (keeping 150 days of data) [2025-09-14T17:18:32.558988] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-09-14T17:18:32.563145] [DEBUG] [LOCAL ] CAPL: Primary data saved (3919 records). [2025-09-14T17:18:32.563271] [INFO ] [MAIN ] CAPL: Full history saved. [2025-09-14T17:18:32.563395] [INFO ] [MAIN ] Update Progress: 395/2370 symbols completed. CAPL took 22.8s. Estimated remaining: 3h 26m 44s. Rate: 9.6 symbols/min [2025-09-14T17:18:32.740245] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:18:32.746946] [DEBUG] [LOCAL ] CATO: Loaded 3374 existing records from primary storage. [2025-09-14T17:18:32.747063] [INFO ] [MAIN ] CATO: Loaded 3374 existing records. [2025-09-14T17:18:32.927003] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:18:32.927528] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-09-14T17:18:32.927593] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-09-14T17:18:32.927892] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-09-14T17:18:32.927951] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-09-14T17:18:33.061621] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-14T17:18:33.325685] [INFO ] [REMOTE ] CATO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:18:33.358798] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-09-14T17:18:34.158874] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-09-14T17:18:34.531574] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-14T17:18:34.723630] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-14T17:18:34.900496] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-14T17:18:34.958798] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-09-14T17:18:35.758817] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-09-14T17:18:36.558857] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-09-14T17:18:36.849020] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T17:18:37.361046] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-09-14T17:18:37.380682] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-14T17:18:37.451336] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T17:18:38.042021] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:18:38.050045] [INFO ] [REMOTE ] CARR: Full fetch complete (58279 records). [2025-09-14T17:18:38.050309] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-09-14T17:18:38.164007] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-09-14T17:18:38.437102] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-09-14T17:18:38.437226] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-09-14T17:18:38.438010] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-09-14T17:18:38.438083] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-09-14T17:18:38.439777] [DEBUG] [LOCAL ] CARR: Trimmed 58279 records to 40349 (keeping 150 days of data) [2025-09-14T17:18:38.702303] [DEBUG] [LOCAL ] CARR: Primary data saved (40349 records). [2025-09-14T17:18:38.702491] [INFO ] [MAIN ] CARR: Full history saved. [2025-09-14T17:18:38.702753] [INFO ] [MAIN ] Update Progress: 396/2370 symbols completed. CARR took 24.4s. Estimated remaining: 3h 26m 37s. Rate: 9.6 symbols/min [2025-09-14T17:18:38.874702] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:18:38.898792] [DEBUG] [LOCAL ] CAVA: Loaded 24047 existing records from primary storage. [2025-09-14T17:18:38.898987] [INFO ] [MAIN ] CAVA: Loaded 24047 existing records. [2025-09-14T17:18:38.961762] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-09-14T17:18:39.024638] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-14T17:18:39.139420] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:18:39.139754] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-09-14T17:18:39.139846] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-09-14T17:18:39.140520] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-09-14T17:18:39.140585] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-09-14T17:18:39.513750] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:18:39.758899] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-09-14T17:18:40.151457] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-14T17:18:40.429725] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-14T17:18:40.558853] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-09-14T17:18:41.019109] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-14T17:18:41.358862] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-09-14T17:18:42.043060] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-14T17:18:42.158839] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-09-14T17:18:42.822285] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-14T17:18:42.958790] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-09-14T17:18:43.511611] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T17:18:43.515677] [INFO ] [REMOTE ] CARS: Full fetch complete (43455 records). [2025-09-14T17:18:43.515806] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-09-14T17:18:43.763952] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-09-14T17:18:43.898341] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-09-14T17:18:43.898463] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-09-14T17:18:43.899090] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-09-14T17:18:43.899148] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-09-14T17:18:43.900180] [DEBUG] [LOCAL ] CARS: Trimmed 43455 records to 29560 (keeping 150 days of data) [2025-09-14T17:18:44.081158] [DEBUG] [LOCAL ] CARS: Primary data saved (29560 records). [2025-09-14T17:18:44.081324] [INFO ] [MAIN ] CARS: Full history saved. [2025-09-14T17:18:44.081431] [INFO ] [MAIN ] Update Progress: 397/2370 symbols completed. CARS took 27.6s. Estimated remaining: 3h 26m 27s. Rate: 9.6 symbols/min [2025-09-14T17:18:44.558880] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-09-14T17:18:44.573833] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T17:18:44.575576] [INFO ] [REMOTE ] CATO: Full fetch complete (8228 records). [2025-09-14T17:18:44.575685] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-09-14T17:18:44.931669] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-09-14T17:18:44.931801] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-09-14T17:18:44.932058] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-09-14T17:18:44.932114] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-09-14T17:18:44.932563] [DEBUG] [LOCAL ] CATO: Trimmed 8228 records to 5126 (keeping 150 days of data) [2025-09-14T17:18:44.962471] [DEBUG] [LOCAL ] CATO: Primary data saved (5126 records). [2025-09-14T17:18:44.962588] [INFO ] [MAIN ] CATO: Full history saved. [2025-09-14T17:18:44.962698] [INFO ] [MAIN ] Update Progress: 398/2370 symbols completed. CATO took 12.4s. Estimated remaining: 3h 25m 54s. Rate: 9.6 symbols/min [2025-09-14T17:18:45.358849] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-09-14T17:18:46.726398] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-14T17:18:46.737997] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-09-14T17:18:47.531577] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-14T17:18:47.542059] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-09-14T17:18:49.014982] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-14T17:18:49.026531] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-09-14T17:18:49.385796] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-14T17:18:49.397286] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-09-14T17:18:51.140948] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-14T17:18:51.153314] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-09-14T17:18:51.211535] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T17:18:51.223717] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-09-14T17:18:53.175221] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-14T17:18:53.187671] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-09-14T17:18:53.256807] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-14T17:18:53.269046] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-09-14T17:18:55.255434] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-14T17:18:55.269103] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-09-14T17:18:55.325431] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-14T17:18:55.337088] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-09-14T17:18:55.951467] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:18:55.957312] [INFO ] [REMOTE ] CAT: Full fetch complete (57582 records). [2025-09-14T17:18:55.957490] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-09-14T17:18:56.365880] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-09-14T17:18:56.366034] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-09-14T17:18:56.367033] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-09-14T17:18:56.367103] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-09-14T17:18:56.369174] [DEBUG] [LOCAL ] CAT: Trimmed 57582 records to 39807 (keeping 150 days of data) [2025-09-14T17:18:56.638475] [DEBUG] [LOCAL ] CAT: Primary data saved (39807 records). [2025-09-14T17:18:56.638739] [INFO ] [MAIN ] CAT: Full history saved. [2025-09-14T17:18:56.638867] [INFO ] [MAIN ] Update Progress: 399/2370 symbols completed. CAT took 27.4s. Estimated remaining: 3h 26m 14s. Rate: 9.6 symbols/min [2025-09-14T17:18:57.236658] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-14T17:18:57.249508] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-09-14T17:18:59.490627] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-14T17:18:59.502575] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-09-14T17:18:59.824211] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-14T17:18:59.829836] [INFO ] [REMOTE ] CAVA: Full fetch complete (58176 records). [2025-09-14T17:18:59.829976] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-09-14T17:19:00.237198] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-09-14T17:19:00.237319] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-09-14T17:19:00.238123] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-09-14T17:19:00.238186] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-09-14T17:19:00.239532] [DEBUG] [LOCAL ] CAVA: Trimmed 58176 records to 40321 (keeping 150 days of data) [2025-09-14T17:19:00.487591] [DEBUG] [LOCAL ] CAVA: Primary data saved (40321 records). [2025-09-14T17:19:00.487782] [INFO ] [MAIN ] CAVA: Full history saved. [2025-09-14T17:19:00.487882] [INFO ] [MAIN ] Update Progress: 400/2370 symbols completed. CAVA took 21.8s. Estimated remaining: 3h 25m 56s. Rate: 9.6 symbols/min [2025-09-14T17:19:01.127037] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:01.085827] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:01.129231] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:01.173561] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:01.182324] [DEBUG] [LOCAL ] CBNA: Loaded 1432 existing records from primary storage. [2025-09-14T17:19:01.184783] [DEBUG] [LOCAL ] CBAN: Loaded 4216 existing records from primary storage. [2025-09-14T17:19:01.185467] [INFO ] [MAIN ] CBAN: Loaded 4216 existing records. [2025-09-14T17:19:01.185339] [INFO ] [MAIN ] CBNA: Loaded 1432 existing records. [2025-09-14T17:19:01.216418] [DEBUG] [LOCAL ] CBL: Loaded 7540 existing records from primary storage. [2025-09-14T17:19:01.272062] [INFO ] [MAIN ] CBL: Loaded 7540 existing records. [2025-09-14T17:19:01.596104] [DEBUG] [LOCAL ] CB: Loaded 22320 existing records from primary storage. [2025-09-14T17:19:01.669597] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:19:01.687278] [INFO ] [MAIN ] CB: Loaded 22320 existing records. [2025-09-14T17:19:01.704512] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:19:01.705811] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-09-14T17:19:01.805147] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:19:01.705961] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-09-14T17:19:01.833515] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-09-14T17:19:01.817508] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-09-14T17:19:01.871279] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-09-14T17:19:01.881922] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-09-14T17:19:01.860340] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-09-14T17:19:01.887450] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-09-14T17:19:01.897931] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-09-14T17:19:01.917181] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-09-14T17:19:01.996574] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-09-14T17:19:02.094908] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-09-14T17:19:02.201059] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:19:02.350170] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-09-14T17:19:02.490798] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-09-14T17:19:02.552629] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-09-14T17:19:02.687612] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-09-14T17:19:03.050979] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:03.114689] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-09-14T17:19:03.195304] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:03.213688] [INFO ] [REMOTE ] CBL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:03.215153] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-09-14T17:19:03.214897] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-09-14T17:19:03.470296] [INFO ] [REMOTE ] CB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:03.470694] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-09-14T17:19:03.644767] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-14T17:19:03.646261] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-09-14T17:19:03.935575] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-14T17:19:03.938767] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-09-14T17:19:04.152715] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-14T17:19:04.154000] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-09-14T17:19:04.382455] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-14T17:19:04.387439] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-09-14T17:19:04.599813] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-14T17:19:04.603591] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-09-14T17:19:04.679427] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-14T17:19:04.680919] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-09-14T17:19:05.022189] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T17:19:05.031856] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-09-14T17:19:05.339466] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-14T17:19:05.341140] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-09-14T17:19:05.426538] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-14T17:19:05.430057] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-09-14T17:19:05.532987] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-14T17:19:05.732677] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-14T17:19:06.101210] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-14T17:19:06.158875] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-09-14T17:19:06.575813] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-14T17:19:06.958832] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-09-14T17:19:07.004367] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-14T17:19:07.758812] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-09-14T17:19:08.023264] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-14T17:19:08.094357] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-14T17:19:08.558823] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-09-14T17:19:09.358805] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-09-14T17:19:09.643971] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-14T17:19:09.792042] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-14T17:19:10.158886] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-09-14T17:19:10.664791] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T17:19:10.665857] [INFO ] [REMOTE ] CBNA: Full fetch complete (3235 records). [2025-09-14T17:19:10.665958] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-09-14T17:19:10.963928] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-09-14T17:19:11.029076] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-09-14T17:19:11.029178] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-09-14T17:19:11.029315] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-09-14T17:19:11.029365] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-09-14T17:19:11.029767] [DEBUG] [LOCAL ] CBNA: Trimmed 3235 records to 2374 (keeping 150 days of data) [2025-09-14T17:19:11.044199] [DEBUG] [LOCAL ] CBNA: Primary data saved (2374 records). [2025-09-14T17:19:11.044286] [INFO ] [MAIN ] CBNA: Full history saved. [2025-09-14T17:19:11.044381] [INFO ] [MAIN ] Update Progress: 401/2370 symbols completed. CBNA took 10.6s. Estimated remaining: 3h 26m 11s. Rate: 9.6 symbols/min [2025-09-14T17:19:11.212983] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:11.213237] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-09-14T17:19:11.213293] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-09-14T17:19:11.213410] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-09-14T17:19:11.213460] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-14T17:19:11.213510] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-14T17:19:11.213553] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-09-14T17:19:11.563060] [INFO ] [REMOTE ] CBO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:11.758832] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-09-14T17:19:12.558835] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-02. [2025-09-14T17:19:12.754929] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-14T17:19:12.794186] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:19:12.794535] [WARN ] [REMOTE ] CBO: No data returned for month 2025-02 [2025-09-14T17:19:13.296217] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-14T17:19:13.358826] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-09-14T17:19:14.158857] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-09-14T17:19:14.958856] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-09-14T17:19:15.005974] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-14T17:19:15.084531] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T17:19:15.715621] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-14T17:19:15.758788] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-09-14T17:19:16.558848] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-09-14T17:19:16.582796] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T17:19:17.358859] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-03. [2025-09-14T17:19:17.422810] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-14T17:19:17.572051] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-03 (0.21 seconds). [2025-09-14T17:19:18.158831] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-09-14T17:19:18.697088] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T17:19:18.698452] [INFO ] [REMOTE ] CBAN: Full fetch complete (12355 records). [2025-09-14T17:19:18.698535] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-09-14T17:19:18.963894] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-09-14T17:19:19.065917] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-09-14T17:19:19.066103] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-09-14T17:19:19.066440] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-09-14T17:19:19.066492] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-09-14T17:19:19.067048] [DEBUG] [LOCAL ] CBAN: Trimmed 12355 records to 7543 (keeping 150 days of data) [2025-09-14T17:19:19.114076] [DEBUG] [LOCAL ] CBAN: Primary data saved (7543 records). [2025-09-14T17:19:19.114227] [INFO ] [MAIN ] CBAN: Full history saved. [2025-09-14T17:19:19.114340] [INFO ] [MAIN ] Update Progress: 402/2370 symbols completed. CBAN took 18.6s. Estimated remaining: 3h 26m 13s. Rate: 9.5 symbols/min [2025-09-14T17:19:19.282363] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:19.306507] [DEBUG] [LOCAL ] CBRE: Loaded 22180 existing records from primary storage. [2025-09-14T17:19:19.306708] [INFO ] [MAIN ] CBRE: Loaded 22180 existing records. [2025-09-14T17:19:19.480916] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:19:19.481190] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-09-14T17:19:19.481254] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-09-14T17:19:19.481927] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-09-14T17:19:19.481990] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-09-14T17:19:19.764019] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-09-14T17:19:19.837939] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:20.558841] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-09-14T17:19:20.601853] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T17:19:20.619215] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-14T17:19:20.621673] [INFO ] [REMOTE ] CBL: Full fetch complete (18616 records). [2025-09-14T17:19:20.621841] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-09-14T17:19:21.022814] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-09-14T17:19:21.022984] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-09-14T17:19:21.023392] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-09-14T17:19:21.023446] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-09-14T17:19:21.024031] [DEBUG] [LOCAL ] CBL: Trimmed 18616 records to 12055 (keeping 150 days of data) [2025-09-14T17:19:21.096665] [DEBUG] [LOCAL ] CBL: Primary data saved (12055 records). [2025-09-14T17:19:21.096830] [INFO ] [MAIN ] CBL: Full history saved. [2025-09-14T17:19:21.096931] [INFO ] [MAIN ] Update Progress: 403/2370 symbols completed. CBL took 20.6s. Estimated remaining: 3h 25m 46s. Rate: 9.6 symbols/min [2025-09-14T17:19:21.272936] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:21.289583] [DEBUG] [LOCAL ] CBT: Loaded 13086 existing records from primary storage. [2025-09-14T17:19:21.289800] [INFO ] [MAIN ] CBT: Loaded 13086 existing records. [2025-09-14T17:19:21.364132] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-04. [2025-09-14T17:19:21.472549] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:19:21.472883] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-09-14T17:19:21.472950] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-09-14T17:19:21.473447] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-09-14T17:19:21.473507] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-09-14T17:19:21.730609] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-14T17:19:21.840938] [INFO ] [REMOTE ] CBT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:22.158820] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-05. [2025-09-14T17:19:22.217570] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T17:19:22.424871] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-14T17:19:22.958859] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-09-14T17:19:23.758861] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-06. [2025-09-14T17:19:23.974946] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-09-14T17:19:24.558831] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-09-14T17:19:24.683830] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T17:19:25.358827] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-09-14T17:19:25.870502] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-14T17:19:26.158827] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-07. [2025-09-14T17:19:26.370290] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-09-14T17:19:26.958831] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-09-14T17:19:27.425011] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-14T17:19:27.758839] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-09-14T17:19:28.558909] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-09-14T17:19:28.904400] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T17:19:29.236709] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-14T17:19:29.358909] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-09-14T17:19:29.665891] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T17:19:29.674519] [INFO ] [REMOTE ] CB: Full fetch complete (54330 records). [2025-09-14T17:19:29.674833] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-09-14T17:19:30.158312] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-09-14T17:19:30.158573] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-09-14T17:19:30.159689] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-09-14T17:19:30.160104] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-09-14T17:19:30.159807] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-09-14T17:19:30.162927] [DEBUG] [LOCAL ] CB: Trimmed 54330 records to 37384 (keeping 150 days of data) [2025-09-14T17:19:30.283138] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T17:19:30.442198] [DEBUG] [LOCAL ] CB: Primary data saved (37384 records). [2025-09-14T17:19:30.442422] [INFO ] [MAIN ] CB: Full history saved. [2025-09-14T17:19:30.442534] [INFO ] [MAIN ] Update Progress: 404/2370 symbols completed. CB took 30.0s. Estimated remaining: 3h 25m 54s. Rate: 9.5 symbols/min [2025-09-14T17:19:30.624066] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:30.636323] [DEBUG] [LOCAL ] CBU: Loaded 10583 existing records from primary storage. [2025-09-14T17:19:30.636496] [INFO ] [MAIN ] CBU: Loaded 10583 existing records. [2025-09-14T17:19:30.818742] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:19:30.819028] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-09-14T17:19:30.819089] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-09-14T17:19:30.819547] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-09-14T17:19:30.819608] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-09-14T17:19:30.963885] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-09-14T17:19:31.178284] [INFO ] [REMOTE ] CBU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:31.758891] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-08. [2025-09-14T17:19:31.981680] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:19:31.982063] [WARN ] [REMOTE ] CBO: No data returned for month 2025-08 [2025-09-14T17:19:32.107060] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-14T17:19:32.192157] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T17:19:32.558844] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-09-14T17:19:33.358849] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-09-14T17:19:34.158827] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-09. [2025-09-14T17:19:34.333480] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T17:19:34.389333] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:19:34.389852] [WARN ] [REMOTE ] CBO: No data returned for month 2025-09 [2025-09-14T17:19:34.389957] [INFO ] [REMOTE ] CBO: Full fetch complete (1016 records). [2025-09-14T17:19:34.390057] [DEBUG] [VALIDATOR ] CBO: Validating primary data. [2025-09-14T17:19:34.391063] [FATAL] [VALIDATOR ] CBO: Data is stale - most recent date (2025-07-10) is before last completed trading day (2025-09-12). Symbol may be delisted or halted. [2025-09-14T17:19:34.391140] [FATAL] [MAIN ] CBO: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:19:34.391188] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:19:34.391239] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-14T17:19:34.391321] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-14T17:19:34.391378] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-09-14T17:19:34.391617] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-09-14T17:19:34.392090] [INFO ] [MAIN ] Update Progress: 405/2370 symbols completed. CBO took 23.3s. Estimated remaining: 3h 25m 37s. Rate: 9.6 symbols/min [2025-09-14T17:19:34.569040] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:34.569321] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-09-14T17:19:34.569397] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-09-14T17:19:34.569553] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-09-14T17:19:34.569626] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-14T17:19:34.569731] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-14T17:19:34.569800] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-09-14T17:19:34.941601] [INFO ] [REMOTE ] CBX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:34.963716] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-09-14T17:19:34.967834] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T17:19:35.758853] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-09-14T17:19:36.516045] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T17:19:36.558870] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-09-14T17:19:36.813180] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T17:19:37.358840] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-09-14T17:19:38.158855] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-09-14T17:19:38.393352] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T17:19:38.426886] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T17:19:38.958872] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-09-14T17:19:39.373467] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-14T17:19:39.758917] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-09-14T17:19:40.286593] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-14T17:19:40.558860] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-02. [2025-09-14T17:19:40.767830] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:19:40.768225] [WARN ] [REMOTE ] CBX: No data returned for month 2025-02 [2025-09-14T17:19:40.990588] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T17:19:41.358922] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-09-14T17:19:42.158880] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-09-14T17:19:42.780242] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-14T17:19:42.958837] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-03. [2025-09-14T17:19:43.190490] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:19:43.190910] [WARN ] [REMOTE ] CBX: No data returned for month 2025-03 [2025-09-14T17:19:43.391798] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-14T17:19:43.758840] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-09-14T17:19:44.558811] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-09-14T17:19:44.797136] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-14T17:19:45.057319] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T17:19:45.061089] [INFO ] [REMOTE ] CBT: Full fetch complete (34533 records). [2025-09-14T17:19:45.061233] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-09-14T17:19:45.363968] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-04. [2025-09-14T17:19:45.439962] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-09-14T17:19:45.440093] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-09-14T17:19:45.440764] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-09-14T17:19:45.440841] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-09-14T17:19:45.442481] [DEBUG] [LOCAL ] CBT: Trimmed 34533 records to 23085 (keeping 150 days of data) [2025-09-14T17:19:45.587132] [DEBUG] [LOCAL ] CBT: Primary data saved (23085 records). [2025-09-14T17:19:45.587316] [INFO ] [MAIN ] CBT: Full history saved. [2025-09-14T17:19:45.587448] [INFO ] [MAIN ] Update Progress: 406/2370 symbols completed. CBT took 24.5s. Estimated remaining: 3h 25m 54s. Rate: 9.5 symbols/min [2025-09-14T17:19:45.667922] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:19:45.689326] [WARN ] [REMOTE ] CBX: No data returned for month 2025-04 [2025-09-14T17:19:45.759064] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:45.776868] [DEBUG] [LOCAL ] CBZ: Loaded 15564 existing records from primary storage. [2025-09-14T17:19:45.777047] [INFO ] [MAIN ] CBZ: Loaded 15564 existing records. [2025-09-14T17:19:45.959715] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:19:45.960061] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-09-14T17:19:45.960127] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-09-14T17:19:45.960713] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-09-14T17:19:45.960775] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-09-14T17:19:46.166441] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-09-14T17:19:46.336185] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:46.910627] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T17:19:46.915896] [INFO ] [REMOTE ] CBRE: Full fetch complete (55247 records). [2025-09-14T17:19:46.916035] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-09-14T17:19:46.963905] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-05. [2025-09-14T17:19:47.338752] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-09-14T17:19:47.338867] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-09-14T17:19:47.339540] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-09-14T17:19:47.339595] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-09-14T17:19:47.341078] [DEBUG] [LOCAL ] CBRE: Trimmed 55247 records to 37804 (keeping 150 days of data) [2025-09-14T17:19:47.575112] [DEBUG] [LOCAL ] CBRE: Primary data saved (37804 records). [2025-09-14T17:19:47.575297] [INFO ] [MAIN ] CBRE: Full history saved. [2025-09-14T17:19:47.575409] [INFO ] [MAIN ] Update Progress: 407/2370 symbols completed. CBRE took 28.5s. Estimated remaining: 3h 25m 27s. Rate: 9.6 symbols/min [2025-09-14T17:19:47.759824] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:47.758881] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-09-14T17:19:47.761425] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-14T17:19:47.789060] [DEBUG] [LOCAL ] CC: Loaded 23788 existing records from primary storage. [2025-09-14T17:19:47.789300] [INFO ] [MAIN ] CC: Loaded 23788 existing records. [2025-09-14T17:19:47.968626] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:19:47.968938] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-09-14T17:19:47.968999] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-09-14T17:19:47.969693] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-09-14T17:19:47.969757] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-09-14T17:19:48.326495] [INFO ] [REMOTE ] CC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:48.558854] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-06. [2025-09-14T17:19:48.770508] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-06 (0.21 seconds). [2025-09-14T17:19:49.066097] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T17:19:49.358846] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-09-14T17:19:50.158857] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-09-14T17:19:50.882777] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T17:19:50.958885] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-09-14T17:19:51.375522] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-14T17:19:51.758874] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-07. [2025-09-14T17:19:51.981676] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-14T17:19:52.117067] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-14T17:19:52.558843] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-09-14T17:19:53.358838] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-09-14T17:19:54.158946] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-08. [2025-09-14T17:19:54.409800] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:19:54.410196] [WARN ] [REMOTE ] CBX: No data returned for month 2025-08 [2025-09-14T17:19:54.454828] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T17:19:54.719149] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-14T17:19:54.958901] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-09. [2025-09-14T17:19:55.204583] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:19:55.205036] [WARN ] [REMOTE ] CBX: No data returned for month 2025-09 [2025-09-14T17:19:55.205138] [INFO ] [REMOTE ] CBX: Full fetch complete (1040 records). [2025-09-14T17:19:55.205224] [DEBUG] [VALIDATOR ] CBX: Validating primary data. [2025-09-14T17:19:55.206000] [FATAL] [VALIDATOR ] CBX: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-12). Symbol may be delisted or halted. [2025-09-14T17:19:55.206082] [FATAL] [MAIN ] CBX: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:19:55.206138] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:19:55.206196] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-14T17:19:55.206280] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-14T17:19:55.206337] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-09-14T17:19:55.206401] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-09-14T17:19:55.206489] [INFO ] [MAIN ] Update Progress: 408/2370 symbols completed. CBX took 20.8s. Estimated remaining: 3h 25m 28s. Rate: 9.5 symbols/min [2025-09-14T17:19:55.381069] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:55.404328] [DEBUG] [LOCAL ] CCI: Loaded 23854 existing records from primary storage. [2025-09-14T17:19:55.404510] [INFO ] [MAIN ] CCI: Loaded 23854 existing records. [2025-09-14T17:19:55.580509] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:19:55.580811] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-09-14T17:19:55.580876] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-09-14T17:19:55.581547] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-09-14T17:19:55.581610] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-09-14T17:19:55.766468] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-09-14T17:19:55.935628] [INFO ] [REMOTE ] CCI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:56.558838] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-09-14T17:19:57.358885] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-09-14T17:19:57.686716] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T17:19:57.719994] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-14T17:19:57.722463] [INFO ] [REMOTE ] CBU: Full fetch complete (24325 records). [2025-09-14T17:19:57.722567] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-09-14T17:19:58.096828] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-09-14T17:19:58.097015] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-09-14T17:19:58.097573] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-09-14T17:19:58.097725] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-09-14T17:19:58.106130] [DEBUG] [LOCAL ] CBU: Trimmed 24325 records to 16496 (keeping 150 days of data) [2025-09-14T17:19:58.119887] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-14T17:19:58.173304] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-09-14T17:19:58.237692] [DEBUG] [LOCAL ] CBU: Primary data saved (16496 records). [2025-09-14T17:19:58.237906] [INFO ] [MAIN ] CBU: Full history saved. [2025-09-14T17:19:58.238103] [INFO ] [MAIN ] Update Progress: 409/2370 symbols completed. CBU took 27.8s. Estimated remaining: 3h 25m 6s. Rate: 9.6 symbols/min [2025-09-14T17:19:58.406985] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:19:58.409425] [DEBUG] [LOCAL ] CCIA: Loaded 657 existing records from primary storage. [2025-09-14T17:19:58.409515] [INFO ] [MAIN ] CCIA: Loaded 657 existing records. [2025-09-14T17:19:58.583073] [WARN ] [MAIN ] CCIA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:19:58.583345] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-09-14T17:19:58.583406] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-14T17:19:58.583630] [DEBUG] [LOCAL ] CCIA: Deleted primary data file. [2025-09-14T17:19:58.583712] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-09-14T17:19:58.932842] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:19:58.958855] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-09-14T17:19:59.276010] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-14T17:19:59.758839] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-09-14T17:19:59.922484] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-14T17:20:00.558861] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-09-14T17:20:00.721129] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-14T17:20:01.358931] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-09-14T17:20:02.131802] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-14T17:20:02.158885] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-09-14T17:20:02.351313] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T17:20:02.958889] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-09-14T17:20:03.507918] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T17:20:03.758920] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-09-14T17:20:04.558838] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-09-14T17:20:04.775991] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-14T17:20:04.961214] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-14T17:20:05.324834] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T17:20:05.358854] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-09-14T17:20:06.158876] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-09-14T17:20:06.958860] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-09-14T17:20:07.282354] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T17:20:07.693438] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T17:20:07.758802] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-09-14T17:20:08.558840] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-09-14T17:20:08.811873] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-14T17:20:08.844151] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T17:20:08.932034] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-14T17:20:09.358848] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-09-14T17:20:10.158879] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-09-14T17:20:10.572044] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-14T17:20:10.576398] [INFO ] [REMOTE ] CBZ: Full fetch complete (35281 records). [2025-09-14T17:20:10.576493] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-09-14T17:20:10.956331] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-09-14T17:20:10.956470] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-09-14T17:20:10.957063] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-09-14T17:20:10.957128] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-09-14T17:20:10.958337] [DEBUG] [LOCAL ] CBZ: Trimmed 35281 records to 25154 (keeping 150 days of data) [2025-09-14T17:20:10.958879] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-09-14T17:20:11.112211] [DEBUG] [LOCAL ] CBZ: Primary data saved (25154 records). [2025-09-14T17:20:11.112405] [INFO ] [MAIN ] CBZ: Full history saved. [2025-09-14T17:20:11.112517] [INFO ] [MAIN ] Update Progress: 410/2370 symbols completed. CBZ took 25.5s. Estimated remaining: 3h 25m 31s. Rate: 9.5 symbols/min [2025-09-14T17:20:11.280447] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:20:11.289132] [DEBUG] [LOCAL ] CCIF: Loaded 6974 existing records from primary storage. [2025-09-14T17:20:11.289279] [INFO ] [MAIN ] CCIF: Loaded 6974 existing records. [2025-09-14T17:20:11.450615] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-14T17:20:11.469594] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:20:11.470709] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-09-14T17:20:11.470783] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-09-14T17:20:11.471156] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-09-14T17:20:11.471216] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-09-14T17:20:11.763987] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-09-14T17:20:11.825934] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:20:12.033577] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T17:20:12.246665] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-14T17:20:12.558826] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-09-14T17:20:13.058780] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-14T17:20:13.358904] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-09-14T17:20:14.158882] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-09-14T17:20:14.958880] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-14T17:20:15.187899] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-14T17:20:15.232527] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T17:20:15.345704] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T17:20:15.346518] [INFO ] [REMOTE ] CCIA: Full fetch complete (1539 records). [2025-09-14T17:20:15.346602] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-09-14T17:20:15.521223] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-14T17:20:15.521454] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:20:15.521505] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:20:15.521545] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-14T17:20:15.521611] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-14T17:20:15.521677] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-09-14T17:20:15.521742] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-09-14T17:20:15.521835] [INFO ] [MAIN ] Update Progress: 411/2370 symbols completed. CCIA took 17.3s. Estimated remaining: 3h 25m 16s. Rate: 9.5 symbols/min [2025-09-14T17:20:15.701364] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:20:15.727220] [DEBUG] [LOCAL ] CCJ: Loaded 24128 existing records from primary storage. [2025-09-14T17:20:15.727445] [INFO ] [MAIN ] CCJ: Loaded 24128 existing records. [2025-09-14T17:20:15.764026] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-09-14T17:20:15.920499] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:20:15.920878] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-09-14T17:20:15.920972] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-09-14T17:20:15.921728] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-09-14T17:20:15.921807] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-09-14T17:20:16.293992] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:20:16.558864] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-09-14T17:20:16.899913] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-14T17:20:17.358860] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-09-14T17:20:17.994915] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:20:18.000548] [INFO ] [REMOTE ] CC: Full fetch complete (57481 records). [2025-09-14T17:20:18.000711] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-09-14T17:20:18.158928] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-09-14T17:20:18.386829] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-09-14T17:20:18.387001] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-09-14T17:20:18.387942] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-09-14T17:20:18.388037] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-09-14T17:20:18.389606] [DEBUG] [LOCAL ] CC: Trimmed 57481 records to 39907 (keeping 150 days of data) [2025-09-14T17:20:18.528451] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-14T17:20:18.687882] [DEBUG] [LOCAL ] CC: Primary data saved (39907 records). [2025-09-14T17:20:18.688089] [INFO ] [MAIN ] CC: Full history saved. [2025-09-14T17:20:18.688208] [INFO ] [MAIN ] Update Progress: 412/2370 symbols completed. CC took 31.1s. Estimated remaining: 3h 24m 55s. Rate: 9.6 symbols/min [2025-09-14T17:20:18.877425] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:20:18.900972] [DEBUG] [LOCAL ] CCK: Loaded 20570 existing records from primary storage. [2025-09-14T17:20:18.901207] [INFO ] [MAIN ] CCK: Loaded 20570 existing records. [2025-09-14T17:20:18.965242] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-09-14T17:20:19.085801] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:20:19.086122] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-09-14T17:20:19.086198] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-09-14T17:20:19.086834] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-09-14T17:20:19.086901] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-09-14T17:20:19.439998] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T17:20:19.459059] [INFO ] [REMOTE ] CCK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:20:19.758869] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-09-14T17:20:20.558804] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-09-14T17:20:20.708228] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T17:20:20.855694] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-14T17:20:21.358910] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-09-14T17:20:22.158904] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-09-14T17:20:22.277404] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-14T17:20:22.344415] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-14T17:20:22.958833] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-09-14T17:20:23.758908] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-09-14T17:20:23.978258] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-14T17:20:24.145948] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-14T17:20:24.558861] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-09-14T17:20:25.358890] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-09-14T17:20:25.475278] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T17:20:25.722814] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T17:20:26.158887] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-09-14T17:20:26.958819] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-09-14T17:20:27.025188] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T17:20:27.042307] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T17:20:27.044399] [INFO ] [REMOTE ] CCIF: Full fetch complete (16575 records). [2025-09-14T17:20:27.044486] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-09-14T17:20:27.407860] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-09-14T17:20:27.407985] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-09-14T17:20:27.408462] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-09-14T17:20:27.408526] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-09-14T17:20:27.409120] [DEBUG] [LOCAL ] CCIF: Trimmed 16575 records to 11453 (keeping 150 days of data) [2025-09-14T17:20:27.477891] [DEBUG] [LOCAL ] CCIF: Primary data saved (11453 records). [2025-09-14T17:20:27.478051] [INFO ] [MAIN ] CCIF: Full history saved. [2025-09-14T17:20:27.478166] [INFO ] [MAIN ] Update Progress: 413/2370 symbols completed. CCIF took 16.4s. Estimated remaining: 3h 25m 0s. Rate: 9.5 symbols/min [2025-09-14T17:20:27.646361] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:20:27.669913] [DEBUG] [LOCAL ] CCL: Loaded 24211 existing records from primary storage. [2025-09-14T17:20:27.670133] [INFO ] [MAIN ] CCL: Loaded 24211 existing records. [2025-09-14T17:20:27.766629] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-09-14T17:20:27.848290] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:20:27.848552] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-09-14T17:20:27.848613] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-09-14T17:20:27.849296] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-09-14T17:20:27.849363] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-09-14T17:20:28.207425] [INFO ] [REMOTE ] CCL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:20:28.286300] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T17:20:28.292573] [INFO ] [REMOTE ] CCI: Full fetch complete (57789 records). [2025-09-14T17:20:28.292830] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-09-14T17:20:28.561196] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-09-14T17:20:28.673561] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-09-14T17:20:28.673733] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-09-14T17:20:28.674509] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-09-14T17:20:28.674605] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-09-14T17:20:28.678031] [DEBUG] [LOCAL ] CCI: Trimmed 57789 records to 39942 (keeping 150 days of data) [2025-09-14T17:20:28.797497] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-14T17:20:28.959528] [DEBUG] [LOCAL ] CCI: Primary data saved (39942 records). [2025-09-14T17:20:28.959761] [INFO ] [MAIN ] CCI: Full history saved. [2025-09-14T17:20:28.959907] [INFO ] [MAIN ] Update Progress: 414/2370 symbols completed. CCI took 33.8s. Estimated remaining: 3h 24m 31s. Rate: 9.6 symbols/min [2025-09-14T17:20:29.127744] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:20:29.149519] [DEBUG] [LOCAL ] CCO: Loaded 21598 existing records from primary storage. [2025-09-14T17:20:29.149728] [INFO ] [MAIN ] CCO: Loaded 21598 existing records. [2025-09-14T17:20:29.330765] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:20:29.331279] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-09-14T17:20:29.331353] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-09-14T17:20:29.331985] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-09-14T17:20:29.332057] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-09-14T17:20:29.363896] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-09-14T17:20:29.697354] [INFO ] [REMOTE ] CCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:20:30.158833] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-09-14T17:20:30.949432] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-14T17:20:30.959346] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-09-14T17:20:31.534537] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-14T17:20:31.586760] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T17:20:31.758848] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-09-14T17:20:32.558882] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-09-14T17:20:32.775471] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-14T17:20:33.358844] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-09-14T17:20:33.889170] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T17:20:33.935884] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-14T17:20:34.158829] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-09-14T17:20:34.953913] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-14T17:20:34.964037] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-09-14T17:20:35.472132] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-14T17:20:35.758877] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-09-14T17:20:36.558849] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-09-14T17:20:37.172827] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-14T17:20:37.358807] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-09-14T17:20:38.086043] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-14T17:20:38.158790] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-09-14T17:20:38.231358] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T17:20:38.958847] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-09-14T17:20:39.693891] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-14T17:20:39.758808] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-09-14T17:20:40.291449] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-14T17:20:40.330596] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-14T17:20:40.558826] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-09-14T17:20:41.358898] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-09-14T17:20:42.159383] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-09-14T17:20:42.162442] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-14T17:20:42.258452] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-14T17:20:42.924505] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T17:20:42.958793] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-09-14T17:20:43.758853] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-09-14T17:20:44.173343] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T17:20:44.178959] [INFO ] [REMOTE ] CCK: Full fetch complete (50777 records). [2025-09-14T17:20:44.179116] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-09-14T17:20:44.564933] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-09-14T17:20:44.592946] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-09-14T17:20:44.593962] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-09-14T17:20:44.597925] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-09-14T17:20:44.598293] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-09-14T17:20:44.601010] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-14T17:20:44.637257] [DEBUG] [LOCAL ] CCK: Trimmed 50777 records to 34738 (keeping 150 days of data) [2025-09-14T17:20:44.643750] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-14T17:20:44.877031] [DEBUG] [LOCAL ] CCK: Primary data saved (34738 records). [2025-09-14T17:20:44.877220] [INFO ] [MAIN ] CCK: Full history saved. [2025-09-14T17:20:44.877349] [INFO ] [MAIN ] Update Progress: 415/2370 symbols completed. CCK took 26.2s. Estimated remaining: 3h 25m 10s. Rate: 9.5 symbols/min [2025-09-14T17:20:45.049370] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:20:45.057213] [DEBUG] [LOCAL ] CCRD: Loaded 5568 existing records from primary storage. [2025-09-14T17:20:45.057338] [INFO ] [MAIN ] CCRD: Loaded 5568 existing records. [2025-09-14T17:20:45.232443] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:20:45.232742] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-09-14T17:20:45.232810] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-09-14T17:20:45.233127] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-09-14T17:20:45.233187] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-09-14T17:20:45.371748] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-09-14T17:20:45.596515] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:20:46.158910] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-09-14T17:20:46.959313] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-09-14T17:20:46.965205] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-14T17:20:47.153705] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-14T17:20:47.627731] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-14T17:20:47.758830] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-09-14T17:20:47.818372] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-14T17:20:47.824733] [INFO ] [REMOTE ] CCJ: Full fetch complete (58354 records). [2025-09-14T17:20:47.824866] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-09-14T17:20:48.201066] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-09-14T17:20:48.201228] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-09-14T17:20:48.201971] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-09-14T17:20:48.202034] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-09-14T17:20:48.203415] [DEBUG] [LOCAL ] CCJ: Trimmed 58354 records to 40437 (keeping 150 days of data) [2025-09-14T17:20:48.450256] [DEBUG] [LOCAL ] CCJ: Primary data saved (40437 records). [2025-09-14T17:20:48.450428] [INFO ] [MAIN ] CCJ: Full history saved. [2025-09-14T17:20:48.450538] [INFO ] [MAIN ] Update Progress: 416/2370 symbols completed. CCJ took 32.9s. Estimated remaining: 3h 24m 51s. Rate: 9.5 symbols/min [2025-09-14T17:20:48.558042] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-14T17:20:48.560766] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-09-14T17:20:48.639986] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:20:48.655511] [DEBUG] [LOCAL ] CCS: Loaded 13141 existing records from primary storage. [2025-09-14T17:20:48.655703] [INFO ] [MAIN ] CCS: Loaded 13141 existing records. [2025-09-14T17:20:48.830064] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:20:48.830374] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-09-14T17:20:48.830435] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-09-14T17:20:48.830932] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-09-14T17:20:48.830995] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-09-14T17:20:49.221055] [INFO ] [REMOTE ] CCS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:20:49.358833] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-09-14T17:20:50.158889] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-09-14T17:20:50.748867] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T17:20:50.937313] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-14T17:20:50.958879] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-09-14T17:20:51.235227] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-09-14T17:20:51.758883] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-09-14T17:20:52.481590] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-14T17:20:52.558851] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-09-14T17:20:52.593840] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T17:20:53.358854] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-09-14T17:20:54.027043] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T17:20:54.158882] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-09-14T17:20:54.244175] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-14T17:20:54.958836] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-09-14T17:20:55.495567] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-14T17:20:55.500717] [INFO ] [REMOTE ] CCO: Full fetch complete (50930 records). [2025-09-14T17:20:55.500878] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-09-14T17:20:55.763959] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-09-14T17:20:55.879423] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-09-14T17:20:55.879540] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-09-14T17:20:55.880224] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-09-14T17:20:55.880282] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-09-14T17:20:55.881358] [DEBUG] [LOCAL ] CCO: Trimmed 50930 records to 36522 (keeping 150 days of data) [2025-09-14T17:20:56.089901] [DEBUG] [LOCAL ] CCO: Primary data saved (36522 records). [2025-09-14T17:20:56.090103] [INFO ] [MAIN ] CCO: Full history saved. [2025-09-14T17:20:56.090204] [INFO ] [MAIN ] Update Progress: 417/2370 symbols completed. CCO took 27.1s. Estimated remaining: 3h 24m 51s. Rate: 9.5 symbols/min [2025-09-14T17:20:56.262076] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:20:56.273197] [DEBUG] [LOCAL ] CCU: Loaded 9467 existing records from primary storage. [2025-09-14T17:20:56.273399] [INFO ] [MAIN ] CCU: Loaded 9467 existing records. [2025-09-14T17:20:56.447628] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:20:56.447935] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-09-14T17:20:56.447997] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-09-14T17:20:56.448427] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-09-14T17:20:56.448489] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-09-14T17:20:56.563974] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-09-14T17:20:56.799418] [INFO ] [REMOTE ] CCU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:20:57.297341] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-14T17:20:57.366214] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-09-14T17:20:57.388636] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-14T17:20:57.651733] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-14T17:20:58.158845] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-09-14T17:20:58.508787] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T17:20:58.956033] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-14T17:20:58.960391] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-09-14T17:20:59.758889] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-09-14T17:21:00.060527] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-14T17:21:00.558829] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-09-14T17:21:00.938963] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-14T17:21:00.944669] [INFO ] [REMOTE ] CCL: Full fetch complete (58480 records). [2025-09-14T17:21:00.944844] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-09-14T17:21:01.325758] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-09-14T17:21:01.325966] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-09-14T17:21:01.326751] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-09-14T17:21:01.326888] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-09-14T17:21:01.344298] [DEBUG] [LOCAL ] CCL: Trimmed 58480 records to 40540 (keeping 150 days of data) [2025-09-14T17:21:01.344194] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T17:21:01.358789] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-09-14T17:21:01.607514] [DEBUG] [LOCAL ] CCL: Primary data saved (40540 records). [2025-09-14T17:21:01.607893] [INFO ] [MAIN ] CCL: Full history saved. [2025-09-14T17:21:01.608028] [INFO ] [MAIN ] Update Progress: 418/2370 symbols completed. CCL took 34.1s. Estimated remaining: 3h 24m 41s. Rate: 9.5 symbols/min [2025-09-14T17:21:01.780112] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:21:01.780371] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-09-14T17:21:01.780436] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-09-14T17:21:01.780617] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-09-14T17:21:01.780903] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-14T17:21:01.780999] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-14T17:21:01.781077] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-09-14T17:21:02.140029] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:21:02.158801] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-09-14T17:21:02.958847] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-09-14T17:21:03.019357] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T17:21:03.758830] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-09-14T17:21:03.981487] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-09-14T17:21:04.187489] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-14T17:21:04.359872] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-14T17:21:04.558895] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-09-14T17:21:04.774519] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-09-14T17:21:05.358833] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-09-14T17:21:06.158877] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-09-14T17:21:06.468895] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-14T17:21:06.468281] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-14T17:21:06.958891] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-09-14T17:21:07.758861] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-09-14T17:21:07.825480] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T17:21:07.827237] [INFO ] [REMOTE ] CCRD: Full fetch complete (9236 records). [2025-09-14T17:21:07.827321] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-09-14T17:21:08.075418] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-14T17:21:08.214210] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-09-14T17:21:08.214331] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-09-14T17:21:08.214617] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-09-14T17:21:08.214687] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-09-14T17:21:08.215173] [DEBUG] [LOCAL ] CCRD: Trimmed 9236 records to 7757 (keeping 150 days of data) [2025-09-14T17:21:08.262518] [DEBUG] [LOCAL ] CCRD: Primary data saved (7757 records). [2025-09-14T17:21:08.262704] [INFO ] [MAIN ] CCRD: Full history saved. [2025-09-14T17:21:08.262796] [INFO ] [MAIN ] Update Progress: 419/2370 symbols completed. CCRD took 23.4s. Estimated remaining: 3h 24m 37s. Rate: 9.5 symbols/min [2025-09-14T17:21:08.433178] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:21:08.456332] [DEBUG] [LOCAL ] CDE: Loaded 24062 existing records from primary storage. [2025-09-14T17:21:08.456515] [INFO ] [MAIN ] CDE: Loaded 24062 existing records. [2025-09-14T17:21:08.563968] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-09-14T17:21:08.635015] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:21:08.635243] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-09-14T17:21:08.635301] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-09-14T17:21:08.636128] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-09-14T17:21:08.636194] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-09-14T17:21:09.001624] [INFO ] [REMOTE ] CDE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:21:09.358833] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-09-14T17:21:09.909152] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-14T17:21:10.158889] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-09-14T17:21:10.958792] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-09-14T17:21:11.028274] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T17:21:11.169600] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T17:21:11.192600] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:21:11.192984] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-09-14T17:21:11.758867] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-09-14T17:21:12.558880] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-09-14T17:21:12.992121] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-14T17:21:13.358839] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-07. [2025-09-14T17:21:14.158890] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-09-14T17:21:14.846347] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-14T17:21:14.958862] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-09-14T17:21:15.758860] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-08. [2025-09-14T17:21:15.862727] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T17:21:15.983027] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-14T17:21:15.990360] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-09-14T17:21:15.992669] [INFO ] [REMOTE ] CCS: Full fetch complete (33545 records). [2025-09-14T17:21:15.992893] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-09-14T17:21:16.426001] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (3.87 seconds). [2025-09-14T17:21:16.426536] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-09-14T17:21:16.437691] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-09-14T17:21:16.438987] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-09-14T17:21:16.439460] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-09-14T17:21:16.440741] [DEBUG] [LOCAL ] CCS: Trimmed 33545 records to 22771 (keeping 150 days of data) [2025-09-14T17:21:16.559205] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-09-14T17:21:16.586971] [DEBUG] [LOCAL ] CCS: Primary data saved (22771 records). [2025-09-14T17:21:16.587177] [INFO ] [MAIN ] CCS: Full history saved. [2025-09-14T17:21:16.587299] [INFO ] [MAIN ] Update Progress: 420/2370 symbols completed. CCS took 28.1s. Estimated remaining: 3h 24m 40s. Rate: 9.5 symbols/min [2025-09-14T17:21:16.762329] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:21:16.768911] [DEBUG] [LOCAL ] CDLR: Loaded 4567 existing records from primary storage. [2025-09-14T17:21:16.769068] [INFO ] [MAIN ] CDLR: Loaded 4567 existing records. [2025-09-14T17:21:16.951919] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:21:16.952252] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-09-14T17:21:16.952322] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-09-14T17:21:16.952810] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-09-14T17:21:16.952885] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-09-14T17:21:17.327481] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:21:17.358860] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-09-14T17:21:17.382320] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T17:21:17.384837] [INFO ] [REMOTE ] CCU: Full fetch complete (26197 records). [2025-09-14T17:21:17.384956] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-09-14T17:21:17.760585] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-09-14T17:21:17.760781] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-09-14T17:21:17.761275] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-09-14T17:21:17.761332] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-09-14T17:21:17.762171] [DEBUG] [LOCAL ] CCU: Trimmed 26197 records to 16710 (keeping 150 days of data) [2025-09-14T17:21:17.864434] [DEBUG] [LOCAL ] CCU: Primary data saved (16710 records). [2025-09-14T17:21:17.864681] [INFO ] [MAIN ] CCU: Full history saved. [2025-09-14T17:21:17.864835] [INFO ] [MAIN ] Update Progress: 421/2370 symbols completed. CCU took 21.8s. Estimated remaining: 3h 24m 10s. Rate: 9.5 symbols/min [2025-09-14T17:21:18.045097] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:21:18.066018] [DEBUG] [LOCAL ] CDP: Loaded 18781 existing records from primary storage. [2025-09-14T17:21:18.066246] [INFO ] [MAIN ] CDP: Loaded 18781 existing records. [2025-09-14T17:21:18.167305] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-09-14T17:21:18.252030] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:21:18.252350] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-09-14T17:21:18.252509] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-09-14T17:21:18.253234] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-09-14T17:21:18.253311] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-09-14T17:21:18.610417] [INFO ] [REMOTE ] CDP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:21:18.950134] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-14T17:21:18.958776] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-09-14T17:21:19.419323] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-14T17:21:19.758861] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-09-14T17:21:19.887157] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-14T17:21:20.558883] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-09. [2025-09-14T17:21:20.803494] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:21:20.803919] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-09 [2025-09-14T17:21:20.804012] [INFO ] [REMOTE ] CCZ: Full fetch complete (75 records). [2025-09-14T17:21:20.804103] [DEBUG] [VALIDATOR ] CCZ: Validating primary data. [2025-09-14T17:21:20.804893] [FATAL] [VALIDATOR ] CCZ: Data is stale - most recent date (2025-08-08) is before last completed trading day (2025-09-12). Symbol may be delisted or halted. [2025-09-14T17:21:20.804973] [FATAL] [MAIN ] CCZ: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:21:20.805022] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:21:20.805071] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-14T17:21:20.805143] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-14T17:21:20.805194] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-09-14T17:21:20.805263] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-09-14T17:21:20.805355] [INFO ] [MAIN ] Update Progress: 422/2370 symbols completed. CCZ took 19.2s. Estimated remaining: 3h 23m 49s. Rate: 9.6 symbols/min [2025-09-14T17:21:20.985352] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:21:20.999219] [DEBUG] [LOCAL ] CDRE: Loaded 10636 existing records from primary storage. [2025-09-14T17:21:20.999438] [INFO ] [MAIN ] CDRE: Loaded 10636 existing records. [2025-09-14T17:21:21.176151] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:21:21.176423] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-09-14T17:21:21.176509] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-09-14T17:21:21.177003] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-09-14T17:21:21.177084] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-09-14T17:21:21.360867] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-09-14T17:21:21.549808] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:21:21.573199] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T17:21:22.158897] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-09-14T17:21:22.308971] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-14T17:21:22.958826] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-09-14T17:21:23.758809] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-09-14T17:21:23.831045] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T17:21:23.885432] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T17:21:24.558838] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-09-14T17:21:25.358865] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-09-14T17:21:25.495151] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-14T17:21:25.584786] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T17:21:26.158832] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-09-14T17:21:26.958841] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-09-14T17:21:27.230886] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-14T17:21:27.237913] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-14T17:21:27.758845] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-09-14T17:21:27.983840] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-14T17:21:28.558849] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-09-14T17:21:29.230549] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-14T17:21:29.358792] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-09-14T17:21:29.834993] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-14T17:21:30.158831] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-09-14T17:21:30.617126] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-14T17:21:30.958830] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-09-14T17:21:31.758802] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-09-14T17:21:32.105219] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-14T17:21:32.186658] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-14T17:21:32.558839] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-09-14T17:21:33.358852] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-09-14T17:21:33.496832] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-14T17:21:33.916821] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-14T17:21:34.158841] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-09-14T17:21:34.263965] [DEBUG] [REMOTE ] CDP: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-14T17:21:34.264407] [WARN ] [REMOTE ] CDP: No data returned for month 2025-05 [2025-09-14T17:21:34.958843] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-09-14T17:21:35.187012] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-14T17:21:35.193124] [INFO ] [REMOTE ] CDE: Full fetch complete (58320 records). [2025-09-14T17:21:35.193347] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-09-14T17:21:35.590130] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-09-14T17:21:35.590285] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-09-14T17:21:35.591106] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-09-14T17:21:35.591213] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-09-14T17:21:35.592663] [DEBUG] [LOCAL ] CDE: Trimmed 58320 records to 40384 (keeping 150 days of data) [2025-09-14T17:21:35.764041] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-09-14T17:21:35.842276] [DEBUG] [LOCAL ] CDE: Primary data saved (40384 records). [2025-09-14T17:21:35.842465] [INFO ] [MAIN ] CDE: Full history saved. [2025-09-14T17:21:35.842568] [INFO ] [MAIN ] Update Progress: 423/2370 symbols completed. CDE took 27.6s. Estimated remaining: 3h 24m 23s. Rate: 9.5 symbols/min [2025-09-14T17:21:36.015967] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:21:36.037147] [DEBUG] [LOCAL ] CE: Loaded 22797 existing records from primary storage. [2025-09-14T17:21:36.037325] [INFO ] [MAIN ] CE: Loaded 22797 existing records. [2025-09-14T17:21:36.213067] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:21:36.213380] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-09-14T17:21:36.213445] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-09-14T17:21:36.214136] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-09-14T17:21:36.214200] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-09-14T17:21:36.575605] [INFO ] [REMOTE ] CE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:21:36.575696] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-09-14T17:21:36.605908] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T17:21:37.085736] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-14T17:21:37.323484] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T17:21:37.325097] [INFO ] [REMOTE ] CDLR: Full fetch complete (10682 records). [2025-09-14T17:21:37.325188] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-09-14T17:21:37.364040] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-09-14T17:21:37.702526] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-09-14T17:21:37.702713] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-09-14T17:21:37.703002] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-09-14T17:21:37.703055] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-09-14T17:21:37.703545] [DEBUG] [LOCAL ] CDLR: Trimmed 10682 records to 7036 (keeping 150 days of data) [2025-09-14T17:21:37.745421] [DEBUG] [LOCAL ] CDLR: Primary data saved (7036 records). [2025-09-14T17:21:37.745599] [INFO ] [MAIN ] CDLR: Full history saved. [2025-09-14T17:21:37.745742] [INFO ] [MAIN ] Update Progress: 424/2370 symbols completed. CDLR took 21.2s. Estimated remaining: 3h 23m 56s. Rate: 9.5 symbols/min [2025-09-14T17:21:37.917922] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:21:37.922755] [DEBUG] [LOCAL ] CEE: Loaded 2501 existing records from primary storage. [2025-09-14T17:21:37.922856] [INFO ] [MAIN ] CEE: Loaded 2501 existing records. [2025-09-14T17:21:38.116062] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:21:38.117349] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-09-14T17:21:38.117421] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-09-14T17:21:38.117968] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-09-14T17:21:38.118034] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-09-14T17:21:38.163953] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-09-14T17:21:38.494013] [INFO ] [REMOTE ] CEE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:21:38.511806] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T17:21:38.958844] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-09-14T17:21:39.770271] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-09-14T17:21:39.777312] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T17:21:40.117435] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T17:21:40.558890] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-09-14T17:21:40.685492] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-14T17:21:41.358843] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-09-14T17:21:42.158871] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-09-14T17:21:42.289336] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-14T17:21:42.408599] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T17:21:42.958881] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-09-14T17:21:43.588670] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-14T17:21:43.758963] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-09-14T17:21:43.788493] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-14T17:21:44.558872] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-09-14T17:21:45.117779] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T17:21:45.122568] [INFO ] [REMOTE ] CDP: Full fetch complete (40307 records). [2025-09-14T17:21:45.122764] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-09-14T17:21:45.323635] [WARN ] [VALIDATOR ] CDP: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-14T17:21:45.324748] [FATAL] [MAIN ] CDP: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:21:45.324815] [WARN ] [MAIN ] CDP: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:21:45.324884] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-09-14T17:21:45.324999] [DEBUG] [LOCAL ] CDP: No primary data file found to delete. [2025-09-14T17:21:45.325054] [INFO ] [LOCAL ] CDP: Starting deletion of derivative data. [2025-09-14T17:21:45.325122] [DEBUG] [LOCAL ] CDP: No derivative data file found to delete. [2025-09-14T17:21:45.325225] [INFO ] [MAIN ] Update Progress: 425/2370 symbols completed. CDP took 27.5s. Estimated remaining: 3h 23m 56s. Rate: 9.5 symbols/min [2025-09-14T17:21:45.364016] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-09-14T17:21:45.507450] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:21:45.520496] [DEBUG] [LOCAL ] CEPU: Loaded 10879 existing records from primary storage. [2025-09-14T17:21:45.520706] [INFO ] [MAIN ] CEPU: Loaded 10879 existing records. [2025-09-14T17:21:45.701224] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:21:45.701620] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-09-14T17:21:45.701719] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-09-14T17:21:45.702615] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-09-14T17:21:45.702722] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-09-14T17:21:46.040003] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-14T17:21:46.077131] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-14T17:21:46.105201] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:21:46.158777] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-09-14T17:21:46.958916] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-09-14T17:21:47.768082] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-09-14T17:21:47.773867] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-14T17:21:47.838979] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-14T17:21:48.558833] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-09-14T17:21:48.952941] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T17:21:49.163173] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-14T17:21:49.358861] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-09-14T17:21:50.158824] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-09-14T17:21:50.476004] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T17:21:50.958853] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-09-14T17:21:51.748157] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T17:21:51.758977] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-09-14T17:21:51.781366] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T17:21:51.783992] [INFO ] [REMOTE ] CDRE: Full fetch complete (26460 records). [2025-09-14T17:21:51.784087] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-09-14T17:21:52.175041] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-09-14T17:21:52.175170] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-09-14T17:21:52.175742] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-09-14T17:21:52.175804] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-09-14T17:21:52.176809] [DEBUG] [LOCAL ] CDRE: Trimmed 26460 records to 18728 (keeping 150 days of data) [2025-09-14T17:21:52.294161] [DEBUG] [LOCAL ] CDRE: Primary data saved (18728 records). [2025-09-14T17:21:52.294348] [INFO ] [MAIN ] CDRE: Full history saved. [2025-09-14T17:21:52.294464] [INFO ] [MAIN ] Update Progress: 426/2370 symbols completed. CDRE took 31.5s. Estimated remaining: 3h 23m 53s. Rate: 9.5 symbols/min [2025-09-14T17:21:52.424886] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-14T17:21:52.484465] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:21:52.508277] [DEBUG] [LOCAL ] CF: Loaded 23447 existing records from primary storage. [2025-09-14T17:21:52.508476] [INFO ] [MAIN ] CF: Loaded 23447 existing records. [2025-09-14T17:21:52.563925] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-09-14T17:21:52.700351] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:21:52.700664] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-09-14T17:21:52.700736] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-09-14T17:21:52.701473] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-09-14T17:21:52.701540] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-09-14T17:21:53.066550] [INFO ] [REMOTE ] CF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:21:53.358844] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-09-14T17:21:54.158860] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-09-14T17:21:54.330412] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T17:21:54.958897] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-09-14T17:21:55.101385] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T17:21:55.328796] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-14T17:21:55.758831] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-09-14T17:21:56.558890] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-09-14T17:21:56.870475] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-14T17:21:57.358900] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-09-14T17:21:57.407958] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-14T17:21:57.654509] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T17:21:58.019421] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T17:21:58.024860] [INFO ] [REMOTE ] CE: Full fetch complete (56278 records). [2025-09-14T17:21:58.025029] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-09-14T17:21:58.171394] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-09-14T17:21:58.421948] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-09-14T17:21:58.422069] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-09-14T17:21:58.422790] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-09-14T17:21:58.422849] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-09-14T17:21:58.424085] [DEBUG] [LOCAL ] CE: Trimmed 56278 records to 38584 (keeping 150 days of data) [2025-09-14T17:21:58.667523] [DEBUG] [LOCAL ] CE: Primary data saved (38584 records). [2025-09-14T17:21:58.667744] [INFO ] [MAIN ] CE: Full history saved. [2025-09-14T17:21:58.667848] [INFO ] [MAIN ] Update Progress: 427/2370 symbols completed. CE took 22.8s. Estimated remaining: 3h 23m 47s. Rate: 9.5 symbols/min [2025-09-14T17:21:58.835268] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:21:58.859984] [DEBUG] [LOCAL ] CFG: Loaded 23999 existing records from primary storage. [2025-09-14T17:21:58.860159] [INFO ] [MAIN ] CFG: Loaded 23999 existing records. [2025-09-14T17:21:58.964088] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-09-14T17:21:59.035972] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:21:59.036167] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-09-14T17:21:59.036224] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-09-14T17:21:59.036988] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-09-14T17:21:59.037058] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-09-14T17:21:59.394134] [INFO ] [REMOTE ] CFG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:21:59.561539] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T17:21:59.758824] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-09-14T17:22:00.558803] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-09-14T17:22:00.598671] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-14T17:22:00.648473] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T17:22:01.241203] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:22:01.242852] [INFO ] [REMOTE ] CEE: Full fetch complete (8744 records). [2025-09-14T17:22:01.243040] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-09-14T17:22:01.363921] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-09-14T17:22:01.631996] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-09-14T17:22:01.632138] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-09-14T17:22:01.632406] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-09-14T17:22:01.632457] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-09-14T17:22:01.633008] [DEBUG] [LOCAL ] CEE: Trimmed 8744 records to 4013 (keeping 150 days of data) [2025-09-14T17:22:01.656652] [DEBUG] [LOCAL ] CEE: Primary data saved (4013 records). [2025-09-14T17:22:01.656748] [INFO ] [MAIN ] CEE: Full history saved. [2025-09-14T17:22:01.656838] [INFO ] [MAIN ] Update Progress: 428/2370 symbols completed. CEE took 23.9s. Estimated remaining: 3h 23m 25s. Rate: 9.5 symbols/min [2025-09-14T17:22:01.843114] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:22:01.847038] [DEBUG] [LOCAL ] CFND: Loaded 2189 existing records from primary storage. [2025-09-14T17:22:01.847133] [INFO ] [MAIN ] CFND: Loaded 2189 existing records. [2025-09-14T17:22:02.020823] [WARN ] [MAIN ] CFND: Insufficient historical data. Have data from 2025-08-07, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:22:02.021118] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-09-14T17:22:02.021176] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-14T17:22:02.021541] [DEBUG] [LOCAL ] CFND: Deleted primary data file. [2025-09-14T17:22:02.021605] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-09-14T17:22:02.163964] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-09-14T17:22:02.396333] [INFO ] [REMOTE ] CFND: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:22:02.958834] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-02. [2025-09-14T17:22:03.229199] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:22:03.229577] [WARN ] [REMOTE ] CFND: No data returned for month 2025-02 [2025-09-14T17:22:03.288777] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-14T17:22:03.650253] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-14T17:22:03.758860] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-09-14T17:22:04.558782] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-09-14T17:22:04.794243] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-14T17:22:05.358896] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-03. [2025-09-14T17:22:05.636343] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:22:05.636776] [WARN ] [REMOTE ] CFND: No data returned for month 2025-03 [2025-09-14T17:22:06.158849] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-04. [2025-09-14T17:22:06.405171] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:22:06.405618] [WARN ] [REMOTE ] CFND: No data returned for month 2025-04 [2025-09-14T17:22:06.495106] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-14T17:22:06.958898] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-09-14T17:22:07.758858] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-05. [2025-09-14T17:22:08.057321] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:22:08.057747] [WARN ] [REMOTE ] CFND: No data returned for month 2025-05 [2025-09-14T17:22:08.391038] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T17:22:08.558860] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-09-14T17:22:09.358859] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-06. [2025-09-14T17:22:09.617353] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:22:09.617733] [WARN ] [REMOTE ] CFND: No data returned for month 2025-06 [2025-09-14T17:22:10.158836] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-09-14T17:22:10.352572] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T17:22:10.958883] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-07. [2025-09-14T17:22:11.265632] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:22:11.266024] [WARN ] [REMOTE ] CFND: No data returned for month 2025-07 [2025-09-14T17:22:11.758876] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-09-14T17:22:12.052857] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-14T17:22:12.558848] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-09-14T17:22:13.240262] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-14T17:22:13.358891] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-09-14T17:22:14.014732] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-14T17:22:14.158883] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-09-14T17:22:14.958864] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-08. [2025-09-14T17:22:15.172670] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T17:22:15.251161] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-14T17:22:15.254548] [INFO ] [REMOTE ] CEPU: Full fetch complete (27886 records). [2025-09-14T17:22:15.254664] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-09-14T17:22:15.611860] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-14T17:22:15.643929] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-09-14T17:22:15.644017] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-09-14T17:22:15.644533] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-09-14T17:22:15.644597] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-09-14T17:22:15.645332] [DEBUG] [LOCAL ] CEPU: Trimmed 27886 records to 18775 (keeping 150 days of data) [2025-09-14T17:22:15.757393] [DEBUG] [LOCAL ] CEPU: Primary data saved (18775 records). [2025-09-14T17:22:15.757583] [INFO ] [MAIN ] CEPU: Full history saved. [2025-09-14T17:22:15.757713] [INFO ] [MAIN ] Update Progress: 429/2370 symbols completed. CEPU took 30.4s. Estimated remaining: 3h 23m 54s. Rate: 9.5 symbols/min [2025-09-14T17:22:15.768982] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-09-14T17:22:15.938219] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:22:15.954875] [DEBUG] [LOCAL ] CFR: Loaded 15003 existing records from primary storage. [2025-09-14T17:22:15.955039] [INFO ] [MAIN ] CFR: Loaded 15003 existing records. [2025-09-14T17:22:16.139046] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:22:16.139362] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-09-14T17:22:16.139433] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-09-14T17:22:16.139970] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-09-14T17:22:16.140034] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-09-14T17:22:16.517198] [INFO ] [REMOTE ] CFR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:22:16.530871] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T17:22:16.536443] [INFO ] [REMOTE ] CF: Full fetch complete (56911 records). [2025-09-14T17:22:16.536578] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-09-14T17:22:16.567086] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-09-14T17:22:16.921799] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-09-14T17:22:16.921913] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-09-14T17:22:16.922706] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-09-14T17:22:16.922782] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-09-14T17:22:16.924067] [DEBUG] [LOCAL ] CF: Trimmed 56911 records to 39355 (keeping 150 days of data) [2025-09-14T17:22:17.166461] [DEBUG] [LOCAL ] CF: Primary data saved (39355 records). [2025-09-14T17:22:17.166680] [INFO ] [MAIN ] CF: Full history saved. [2025-09-14T17:22:17.166822] [INFO ] [MAIN ] Update Progress: 430/2370 symbols completed. CF took 24.9s. Estimated remaining: 3h 23m 26s. Rate: 9.5 symbols/min [2025-09-14T17:22:17.350440] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:22:17.361625] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-09-14T17:22:17.372145] [DEBUG] [LOCAL ] CGAU: Loaded 19233 existing records from primary storage. [2025-09-14T17:22:17.372352] [INFO ] [MAIN ] CGAU: Loaded 19233 existing records. [2025-09-14T17:22:17.554876] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:22:17.555172] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-09-14T17:22:17.555233] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-09-14T17:22:17.555856] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-09-14T17:22:17.555926] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-09-14T17:22:17.904321] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:22:18.158799] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-09-14T17:22:18.418712] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T17:22:18.560120] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-14T17:22:18.958853] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-09. [2025-09-14T17:22:19.426106] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T17:22:19.427556] [INFO ] [REMOTE ] CFND: Full fetch complete (2189 records). [2025-09-14T17:22:19.427656] [DEBUG] [VALIDATOR ] CFND: Validating primary data. [2025-09-14T17:22:19.607509] [WARN ] [VALIDATOR ] CFND: Validation failed - insufficient historical data. Have 26 unique days, need 150 days [2025-09-14T17:22:19.607790] [FATAL] [MAIN ] CFND: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:22:19.607998] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:22:19.608162] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-14T17:22:19.608289] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-14T17:22:19.608493] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-14T17:22:19.608662] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-09-14T17:22:19.608828] [INFO ] [MAIN ] Update Progress: 431/2370 symbols completed. CFND took 18.0s. Estimated remaining: 3h 23m 2s. Rate: 9.5 symbols/min [2025-09-14T17:22:19.758855] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-09-14T17:22:19.782798] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-14T17:22:19.816737] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:22:19.827509] [DEBUG] [LOCAL ] CGV: Loaded 623 existing records from primary storage. [2025-09-14T17:22:19.827605] [INFO ] [MAIN ] CGV: Loaded 623 existing records. [2025-09-14T17:22:20.016251] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:22:20.016608] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-09-14T17:22:20.016706] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-14T17:22:20.016980] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-09-14T17:22:20.017054] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-09-14T17:22:20.367038] [INFO ] [REMOTE ] CGV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:22:20.558842] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-09-14T17:22:21.322379] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-14T17:22:21.358797] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-09-14T17:22:22.035185] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-14T17:22:22.158874] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-09-14T17:22:22.900353] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-14T17:22:22.958856] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-09-14T17:22:23.758904] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-09-14T17:22:24.031002] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T17:22:24.236891] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-14T17:22:24.549551] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T17:22:24.558765] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-09-14T17:22:25.358839] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-09-14T17:22:25.807608] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T17:22:26.027626] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T17:22:26.033877] [INFO ] [REMOTE ] CFG: Full fetch complete (58291 records). [2025-09-14T17:22:26.034119] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-09-14T17:22:26.165089] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-09-14T17:22:26.563104] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-14T17:22:26.588756] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-09-14T17:22:26.588939] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-09-14T17:22:26.591930] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-09-14T17:22:26.592215] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-09-14T17:22:26.596019] [DEBUG] [LOCAL ] CFG: Trimmed 58291 records to 40366 (keeping 150 days of data) [2025-09-14T17:22:26.951200] [DEBUG] [LOCAL ] CFG: Primary data saved (40366 records). [2025-09-14T17:22:26.951421] [INFO ] [MAIN ] CFG: Full history saved. [2025-09-14T17:22:26.951590] [INFO ] [MAIN ] Update Progress: 432/2370 symbols completed. CFG took 28.3s. Estimated remaining: 3h 23m 1s. Rate: 9.5 symbols/min [2025-09-14T17:22:26.964059] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-09-14T17:22:27.188176] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:22:27.202983] [DEBUG] [LOCAL ] CHCT: Loaded 11224 existing records from primary storage. [2025-09-14T17:22:27.203202] [INFO ] [MAIN ] CHCT: Loaded 11224 existing records. [2025-09-14T17:22:27.394537] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:22:27.394828] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-09-14T17:22:27.394898] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-09-14T17:22:27.395339] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-09-14T17:22:27.395439] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-09-14T17:22:27.508015] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-14T17:22:27.766383] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:22:27.762814] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-09-14T17:22:28.558840] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-09-14T17:22:29.352776] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T17:22:29.361844] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-09-14T17:22:29.780037] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-14T17:22:29.840746] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-14T17:22:30.158819] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-09-14T17:22:30.958826] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-09-14T17:22:31.757167] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-14T17:22:31.765815] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-09-14T17:22:31.835836] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-14T17:22:32.241395] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-14T17:22:32.558882] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-09-14T17:22:33.358843] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-09-14T17:22:34.120207] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-14T17:22:34.147287] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T17:22:34.158771] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-09-14T17:22:34.958899] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-09-14T17:22:35.686997] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T17:22:35.758848] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-09-14T17:22:36.394873] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T17:22:36.558894] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-09-14T17:22:37.358895] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-09-14T17:22:37.487670] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T17:22:37.552950] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-14T17:22:38.158893] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-09-14T17:22:38.510561] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-14T17:22:38.841522] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-14T17:22:38.958844] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-09-14T17:22:39.758889] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-09-14T17:22:40.225468] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-14T17:22:40.230547] [INFO ] [REMOTE ] CGAU: Full fetch complete (45793 records). [2025-09-14T17:22:40.230694] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-09-14T17:22:40.561408] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-09-14T17:22:40.605701] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-09-14T17:22:40.605808] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-09-14T17:22:40.606497] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-09-14T17:22:40.606588] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-09-14T17:22:40.607821] [DEBUG] [LOCAL ] CGAU: Trimmed 45793 records to 31557 (keeping 150 days of data) [2025-09-14T17:22:40.798832] [DEBUG] [LOCAL ] CGAU: Primary data saved (31557 records). [2025-09-14T17:22:40.799035] [INFO ] [MAIN ] CGAU: Full history saved. [2025-09-14T17:22:40.799183] [INFO ] [MAIN ] Update Progress: 433/2370 symbols completed. CGAU took 23.6s. Estimated remaining: 3h 23m 29s. Rate: 9.5 symbols/min [2025-09-14T17:22:40.979320] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:22:40.992516] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T17:22:41.012027] [INFO ] [REMOTE ] CFR: Full fetch complete (36738 records). [2025-09-14T17:22:41.013150] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-14T17:22:41.013337] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-09-14T17:22:41.149923] [DEBUG] [LOCAL ] CHD: Loaded 23484 existing records from primary storage. [2025-09-14T17:22:41.196259] [INFO ] [MAIN ] CHD: Loaded 23484 existing records. [2025-09-14T17:22:41.360606] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-09-14T17:22:41.599253] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:22:41.599698] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-09-14T17:22:41.599619] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-09-14T17:22:41.599825] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-09-14T17:22:41.599876] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-09-14T17:22:41.600508] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-09-14T17:22:41.600653] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-09-14T17:22:41.601231] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-09-14T17:22:41.601386] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-09-14T17:22:41.645827] [DEBUG] [LOCAL ] CFR: Trimmed 36738 records to 24399 (keeping 150 days of data) [2025-09-14T17:22:41.914659] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T17:22:41.938863] [INFO ] [REMOTE ] CGV: Full fetch complete (1630 records). [2025-09-14T17:22:41.960659] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-09-14T17:22:42.160822] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-09-14T17:22:42.207572] [INFO ] [REMOTE ] CHD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:22:42.462943] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-09-14T17:22:42.464155] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-09-14T17:22:42.464765] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-09-14T17:22:42.465749] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-09-14T17:22:42.466918] [DEBUG] [LOCAL ] CGV: Trimmed 1630 records to 953 (keeping 150 days of data) [2025-09-14T17:22:42.480419] [DEBUG] [LOCAL ] CGV: Primary data saved (953 records). [2025-09-14T17:22:42.481385] [INFO ] [MAIN ] CGV: Full history saved. [2025-09-14T17:22:42.481810] [INFO ] [MAIN ] Update Progress: 434/2370 symbols completed. CGV took 22.9s. Estimated remaining: 3h 23m 2s. Rate: 9.5 symbols/min [2025-09-14T17:22:42.681814] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:22:42.691168] [DEBUG] [LOCAL ] CFR: Primary data saved (24399 records). [2025-09-14T17:22:42.691350] [INFO ] [MAIN ] CFR: Full history saved. [2025-09-14T17:22:42.691496] [INFO ] [MAIN ] Update Progress: 435/2370 symbols completed. CFR took 26.9s. Estimated remaining: 3h 22m 28s. Rate: 9.6 symbols/min [2025-09-14T17:22:42.800228] [DEBUG] [LOCAL ] CHE: Loaded 7372 existing records from primary storage. [2025-09-14T17:22:42.821056] [INFO ] [MAIN ] CHE: Loaded 7372 existing records. [2025-09-14T17:22:42.960004] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-09-14T17:22:42.954765] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:22:43.065823] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:22:43.071017] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-09-14T17:22:43.071102] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-09-14T17:22:43.071543] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-09-14T17:22:43.071624] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-09-14T17:22:43.190501] [DEBUG] [LOCAL ] CHGG: Loaded 21362 existing records from primary storage. [2025-09-14T17:22:43.201341] [INFO ] [MAIN ] CHGG: Loaded 21362 existing records. [2025-09-14T17:22:43.534781] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:22:43.562243] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-09-14T17:22:43.597097] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-09-14T17:22:43.632626] [INFO ] [REMOTE ] CHE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:22:43.633435] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-09-14T17:22:43.645933] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-09-14T17:22:43.713369] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T17:22:43.763867] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-09-14T17:22:44.007937] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:22:44.558798] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-09-14T17:22:44.640572] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T17:22:44.699240] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-14T17:22:45.149347] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-14T17:22:45.358869] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-09-14T17:22:46.158848] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-09-14T17:22:46.354171] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-14T17:22:46.958850] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-09-14T17:22:47.758826] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-09-14T17:22:47.992523] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T17:22:48.055352] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T17:22:48.558840] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-09-14T17:22:49.256444] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-14T17:22:49.358792] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-09-14T17:22:50.158801] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-09-14T17:22:50.208439] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-14T17:22:50.958826] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-09-14T17:22:51.156893] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T17:22:51.210117] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-14T17:22:51.758829] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-09-14T17:22:52.558842] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-09-14T17:22:52.691916] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T17:22:53.073223] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T17:22:53.348572] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-14T17:22:53.358769] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-09-14T17:22:54.158811] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-09-14T17:22:54.394515] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-14T17:22:54.958848] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-09-14T17:22:55.758881] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-09-14T17:22:55.836689] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T17:22:56.558924] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-09-14T17:22:56.779596] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T17:22:56.845920] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T17:22:57.358839] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-09-14T17:22:57.880673] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T17:22:57.883259] [INFO ] [REMOTE ] CHCT: Full fetch complete (26383 records). [2025-09-14T17:22:57.883384] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-09-14T17:22:58.163449] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-09-14T17:22:58.217803] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T17:22:58.312483] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-09-14T17:22:58.312600] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-09-14T17:22:58.313150] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-09-14T17:22:58.313210] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-09-14T17:22:58.313954] [DEBUG] [LOCAL ] CHCT: Trimmed 26383 records to 18123 (keeping 150 days of data) [2025-09-14T17:22:58.431560] [DEBUG] [LOCAL ] CHCT: Primary data saved (18123 records). [2025-09-14T17:22:58.431762] [INFO ] [MAIN ] CHCT: Full history saved. [2025-09-14T17:22:58.431881] [INFO ] [MAIN ] Update Progress: 436/2370 symbols completed. CHCT took 31.5s. Estimated remaining: 3h 23m 4s. Rate: 9.5 symbols/min [2025-09-14T17:22:58.600694] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:22:58.616302] [DEBUG] [LOCAL ] CHH: Loaded 13701 existing records from primary storage. [2025-09-14T17:22:58.616459] [INFO ] [MAIN ] CHH: Loaded 13701 existing records. [2025-09-14T17:22:58.807347] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:22:58.807671] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-09-14T17:22:58.807734] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-09-14T17:22:58.808175] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-09-14T17:22:58.808234] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-09-14T17:22:58.966462] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-09-14T17:22:59.196204] [INFO ] [REMOTE ] CHH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:22:59.758895] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-09-14T17:23:00.178062] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-14T17:23:00.558870] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-09-14T17:23:01.358875] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-09-14T17:23:04.443281] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (5.48 seconds). [2025-09-14T17:23:04.447055] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-09-14T17:23:05.002172] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (5.24 seconds). [2025-09-14T17:23:05.010586] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-09-14T17:23:05.020416] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T17:23:05.023108] [INFO ] [REMOTE ] CHE: Full fetch complete (15310 records). [2025-09-14T17:23:05.023224] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-09-14T17:23:05.396881] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-09-14T17:23:05.397078] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-09-14T17:23:05.397632] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-09-14T17:23:05.397904] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-09-14T17:23:05.399146] [DEBUG] [LOCAL ] CHE: Trimmed 15310 records to 11232 (keeping 150 days of data) [2025-09-14T17:23:05.491075] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (4.93 seconds). [2025-09-14T17:23:05.505629] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-09-14T17:23:05.522856] [DEBUG] [LOCAL ] CHE: Primary data saved (11232 records). [2025-09-14T17:23:05.523078] [INFO ] [MAIN ] CHE: Full history saved. [2025-09-14T17:23:05.523192] [INFO ] [MAIN ] Update Progress: 437/2370 symbols completed. CHE took 23.0s. Estimated remaining: 3h 23m 1s. Rate: 9.5 symbols/min [2025-09-14T17:23:05.819955] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T17:23:05.825489] [INFO ] [REMOTE ] CHD: Full fetch complete (56330 records). [2025-09-14T17:23:05.825701] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-09-14T17:23:06.231069] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-09-14T17:23:06.231270] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-09-14T17:23:06.232281] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-09-14T17:23:06.232390] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-09-14T17:23:06.234468] [DEBUG] [LOCAL ] CHD: Trimmed 56330 records to 39567 (keeping 150 days of data) [2025-09-14T17:23:06.366774] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (5.01 seconds). [2025-09-14T17:23:06.379938] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-09-14T17:23:06.558119] [DEBUG] [LOCAL ] CHD: Primary data saved (39567 records). [2025-09-14T17:23:06.558351] [INFO ] [MAIN ] CHD: Full history saved. [2025-09-14T17:23:06.558476] [INFO ] [MAIN ] Update Progress: 438/2370 symbols completed. CHD took 25.8s. Estimated remaining: 3h 22m 32s. Rate: 9.5 symbols/min [2025-09-14T17:23:07.111270] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-14T17:23:07.119943] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-09-14T17:23:08.342809] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-14T17:23:08.353895] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-09-14T17:23:08.667945] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T17:23:08.676195] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-09-14T17:23:10.140076] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T17:23:10.148331] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-09-14T17:23:10.238781] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-14T17:23:10.248964] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-09-14T17:23:11.538367] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T17:23:11.545192] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-09-14T17:23:11.817296] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-14T17:23:11.822555] [INFO ] [REMOTE ] CHGG: Full fetch complete (52226 records). [2025-09-14T17:23:11.822731] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-09-14T17:23:12.199991] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-09-14T17:23:12.200110] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-09-14T17:23:12.200793] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-09-14T17:23:12.200851] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-09-14T17:23:12.201994] [DEBUG] [LOCAL ] CHGG: Trimmed 52226 records to 35858 (keeping 150 days of data) [2025-09-14T17:23:12.412455] [DEBUG] [LOCAL ] CHGG: Primary data saved (35858 records). [2025-09-14T17:23:12.412631] [INFO ] [MAIN ] CHGG: Full history saved. [2025-09-14T17:23:12.412752] [INFO ] [MAIN ] Update Progress: 439/2370 symbols completed. CHGG took 29.7s. Estimated remaining: 3h 22m 23s. Rate: 9.5 symbols/min [2025-09-14T17:23:12.641991] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-14T17:23:12.649605] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-09-14T17:23:13.991558] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-14T17:23:13.998719] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-09-14T17:23:14.518420] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T17:23:14.521703] [INFO ] [REMOTE ] CHH: Full fetch complete (35496 records). [2025-09-14T17:23:14.521806] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-09-14T17:23:14.901941] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-09-14T17:23:14.902048] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-09-14T17:23:14.902585] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-09-14T17:23:14.902654] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-09-14T17:23:14.903479] [DEBUG] [LOCAL ] CHH: Trimmed 35496 records to 23681 (keeping 150 days of data) [2025-09-14T17:23:15.050658] [DEBUG] [LOCAL ] CHH: Primary data saved (23681 records). [2025-09-14T17:23:15.050842] [INFO ] [MAIN ] CHH: Full history saved. [2025-09-14T17:23:15.050940] [INFO ] [MAIN ] Update Progress: 440/2370 symbols completed. CHH took 16.6s. Estimated remaining: 3h 22m 1s. Rate: 9.6 symbols/min [2025-09-14T17:23:15.653853] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:23:15.706108] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:23:15.722337] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:23:15.791438] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:23:15.799082] [DEBUG] [LOCAL ] CHN: Loaded 2331 existing records from primary storage. [2025-09-14T17:23:15.801435] [INFO ] [MAIN ] CHN: Loaded 2331 existing records. [2025-09-14T17:23:15.843448] [DEBUG] [LOCAL ] CHMI: Loaded 9203 existing records from primary storage. [2025-09-14T17:23:15.881376] [DEBUG] [LOCAL ] CHT: Loaded 8305 existing records from primary storage. [2025-09-14T17:23:15.886854] [INFO ] [MAIN ] CHMI: Loaded 9203 existing records. [2025-09-14T17:23:15.907929] [INFO ] [MAIN ] CHT: Loaded 8305 existing records. [2025-09-14T17:23:16.088629] [DEBUG] [LOCAL ] CHPT: Loaded 20838 existing records from primary storage. [2025-09-14T17:23:16.147571] [INFO ] [MAIN ] CHPT: Loaded 20838 existing records. [2025-09-14T17:23:16.207313] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:23:16.359061] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-09-14T17:23:16.428578] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:23:16.487918] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:23:16.492974] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-09-14T17:23:16.499343] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-09-14T17:23:16.499722] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-09-14T17:23:16.505360] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-09-14T17:23:16.500049] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-09-14T17:23:16.500143] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-09-14T17:23:16.545029] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-09-14T17:23:16.597291] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:23:16.597104] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-09-14T17:23:16.643775] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-09-14T17:23:16.675586] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-09-14T17:23:16.659335] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-09-14T17:23:16.675479] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-09-14T17:23:16.775751] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-09-14T17:23:16.956853] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-09-14T17:23:17.019851] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-09-14T17:23:17.560955] [INFO ] [REMOTE ] CHN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:23:17.670799] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-09-14T17:23:17.982228] [INFO ] [REMOTE ] CHT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:23:18.033555] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:23:18.044749] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-09-14T17:23:18.050288] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-09-14T17:23:18.126525] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:23:18.127364] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-09-14T17:23:18.534479] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T17:23:18.540288] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-09-14T17:23:19.114555] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T17:23:19.119430] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-09-14T17:23:19.182435] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-14T17:23:19.184398] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-09-14T17:23:19.226743] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T17:23:19.233817] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-09-14T17:23:19.847467] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-14T17:23:19.849450] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-09-14T17:23:20.224296] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-14T17:23:20.257743] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-09-14T17:23:20.259546] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-14T17:23:20.270806] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-09-14T17:23:20.303711] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-14T17:23:20.314099] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-14T17:23:20.558880] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-09-14T17:23:20.989902] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-14T17:23:21.103443] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-14T17:23:21.358831] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-09-14T17:23:22.030304] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-14T17:23:22.158825] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-09-14T17:23:22.334804] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-14T17:23:22.958807] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-09-14T17:23:23.236779] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-14T17:23:23.758830] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-09-14T17:23:24.317131] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-14T17:23:24.558866] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-09-14T17:23:24.664189] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T17:23:25.090527] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-14T17:23:25.358837] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-09-14T17:23:26.158839] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-09-14T17:23:26.958830] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-09-14T17:23:27.216996] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-14T17:23:27.403748] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-14T17:23:27.758827] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-09-14T17:23:28.116562] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T17:23:28.558844] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-09-14T17:23:29.358824] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-09-14T17:23:29.665569] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-14T17:23:30.037444] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-14T17:23:30.158831] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-09-14T17:23:30.557713] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T17:23:30.907317] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T17:23:30.909717] [INFO ] [REMOTE ] CHT: Full fetch complete (21469 records). [2025-09-14T17:23:30.909804] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-09-14T17:23:30.963952] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-09-14T17:23:31.291052] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-09-14T17:23:31.291170] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-09-14T17:23:31.291661] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-09-14T17:23:31.291737] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-09-14T17:23:31.292414] [DEBUG] [LOCAL ] CHT: Trimmed 21469 records to 14550 (keeping 150 days of data) [2025-09-14T17:23:31.378538] [DEBUG] [LOCAL ] CHT: Primary data saved (14550 records). [2025-09-14T17:23:31.378727] [INFO ] [MAIN ] CHT: Full history saved. [2025-09-14T17:23:31.378831] [INFO ] [MAIN ] Update Progress: 441/2370 symbols completed. CHT took 16.3s. Estimated remaining: 3h 22m 39s. Rate: 9.5 symbols/min [2025-09-14T17:23:31.554996] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:23:31.578552] [DEBUG] [LOCAL ] CHWY: Loaded 24036 existing records from primary storage. [2025-09-14T17:23:31.578744] [INFO ] [MAIN ] CHWY: Loaded 24036 existing records. [2025-09-14T17:23:31.757803] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:23:31.758119] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-09-14T17:23:31.758180] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-09-14T17:23:31.758791] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-09-14T17:23:31.759613] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-09-14T17:23:31.759699] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-09-14T17:23:32.115808] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:23:32.201670] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-14T17:23:32.402044] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:23:32.403243] [INFO ] [REMOTE ] CHN: Full fetch complete (5471 records). [2025-09-14T17:23:32.403328] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-09-14T17:23:32.560667] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-09-14T17:23:32.758128] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-09-14T17:23:32.758248] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-09-14T17:23:32.758464] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-09-14T17:23:32.758519] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-09-14T17:23:32.758924] [DEBUG] [LOCAL ] CHN: Trimmed 5471 records to 3676 (keeping 150 days of data) [2025-09-14T17:23:32.780588] [DEBUG] [LOCAL ] CHN: Primary data saved (3676 records). [2025-09-14T17:23:32.780726] [INFO ] [MAIN ] CHN: Full history saved. [2025-09-14T17:23:32.780827] [INFO ] [MAIN ] Update Progress: 442/2370 symbols completed. CHN took 17.7s. Estimated remaining: 3h 22m 11s. Rate: 9.5 symbols/min [2025-09-14T17:23:32.954726] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:23:32.977220] [DEBUG] [LOCAL ] CI: Loaded 22466 existing records from primary storage. [2025-09-14T17:23:32.977463] [INFO ] [MAIN ] CI: Loaded 22466 existing records. [2025-09-14T17:23:33.151823] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:23:33.152136] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-09-14T17:23:33.152198] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-09-14T17:23:33.152919] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-09-14T17:23:33.152991] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-09-14T17:23:33.364045] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-09-14T17:23:33.516479] [INFO ] [REMOTE ] CI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:23:34.158894] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-09-14T17:23:34.919923] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-14T17:23:34.944148] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-14T17:23:34.958774] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-09-14T17:23:35.347715] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-14T17:23:35.758826] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-09-14T17:23:35.984765] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-14T17:23:35.987499] [INFO ] [REMOTE ] CHMI: Full fetch complete (23601 records). [2025-09-14T17:23:35.987676] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-09-14T17:23:36.394977] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-09-14T17:23:36.395187] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-09-14T17:23:36.395818] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-09-14T17:23:36.395888] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-09-14T17:23:36.396873] [DEBUG] [LOCAL ] CHMI: Trimmed 23601 records to 15383 (keeping 150 days of data) [2025-09-14T17:23:36.491191] [DEBUG] [LOCAL ] CHMI: Primary data saved (15383 records). [2025-09-14T17:23:36.491402] [INFO ] [MAIN ] CHMI: Full history saved. [2025-09-14T17:23:36.491537] [INFO ] [MAIN ] Update Progress: 443/2370 symbols completed. CHMI took 21.4s. Estimated remaining: 3h 21m 54s. Rate: 9.5 symbols/min [2025-09-14T17:23:36.568135] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-09-14T17:23:36.673283] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:23:36.683756] [DEBUG] [LOCAL ] CIA: Loaded 8329 existing records from primary storage. [2025-09-14T17:23:36.683942] [INFO ] [MAIN ] CIA: Loaded 8329 existing records. [2025-09-14T17:23:36.863254] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:23:36.863544] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-09-14T17:23:36.863606] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-09-14T17:23:36.864040] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-09-14T17:23:36.864115] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-09-14T17:23:37.224499] [INFO ] [REMOTE ] CIA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:23:37.358843] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-09-14T17:23:38.106150] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-14T17:23:38.158868] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-09-14T17:23:38.295917] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-14T17:23:38.654056] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-14T17:23:38.958885] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-09-14T17:23:39.448549] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-14T17:23:39.758858] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-09-14T17:23:40.558793] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-09-14T17:23:40.584995] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T17:23:40.738768] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-14T17:23:41.358869] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-09-14T17:23:41.799705] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-14T17:23:41.805616] [INFO ] [REMOTE ] CHPT: Full fetch complete (54878 records). [2025-09-14T17:23:41.805847] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-09-14T17:23:42.178549] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-09-14T17:23:42.197539] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-09-14T17:23:42.197909] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-09-14T17:23:42.199471] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-09-14T17:23:42.199546] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-09-14T17:23:42.200731] [DEBUG] [LOCAL ] CHPT: Trimmed 54878 records to 37016 (keeping 150 days of data) [2025-09-14T17:23:42.439995] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T17:23:42.467290] [DEBUG] [LOCAL ] CHPT: Primary data saved (37016 records). [2025-09-14T17:23:42.467473] [INFO ] [MAIN ] CHPT: Full history saved. [2025-09-14T17:23:42.467628] [INFO ] [MAIN ] Update Progress: 444/2370 symbols completed. CHPT took 27.4s. Estimated remaining: 3h 21m 46s. Rate: 9.5 symbols/min [2025-09-14T17:23:42.635210] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:23:42.649262] [DEBUG] [LOCAL ] CIB: Loaded 12900 existing records from primary storage. [2025-09-14T17:23:42.649422] [INFO ] [MAIN ] CIB: Loaded 12900 existing records. [2025-09-14T17:23:42.828022] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:23:42.828314] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-09-14T17:23:42.828388] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-09-14T17:23:42.829126] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-09-14T17:23:42.829204] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-09-14T17:23:42.967751] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-09-14T17:23:43.186863] [INFO ] [REMOTE ] CIB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:23:43.758832] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-09-14T17:23:43.891554] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-14T17:23:44.274131] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-14T17:23:44.558843] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-09-14T17:23:44.742630] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-14T17:23:45.358869] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-09-14T17:23:46.158845] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-09-14T17:23:46.498828] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-14T17:23:46.882049] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T17:23:46.947812] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-14T17:23:46.958781] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-09-14T17:23:47.712303] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-14T17:23:47.758778] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-09-14T17:23:48.558897] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-09-14T17:23:48.669299] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-14T17:23:49.358836] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-09-14T17:23:50.153552] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-14T17:23:50.155447] [INFO ] [REMOTE ] CIA: Full fetch complete (18268 records). [2025-09-14T17:23:50.155549] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-09-14T17:23:50.167072] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-09-14T17:23:50.523403] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-09-14T17:23:50.523575] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-09-14T17:23:50.524082] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-09-14T17:23:50.524206] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-09-14T17:23:50.524899] [DEBUG] [LOCAL ] CIA: Trimmed 18268 records to 12924 (keeping 150 days of data) [2025-09-14T17:23:50.615806] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-14T17:23:50.641812] [DEBUG] [LOCAL ] CIA: Primary data saved (12924 records). [2025-09-14T17:23:50.642011] [INFO ] [MAIN ] CIA: Full history saved. [2025-09-14T17:23:50.642122] [INFO ] [MAIN ] Update Progress: 445/2370 symbols completed. CIA took 14.2s. Estimated remaining: 3h 21m 48s. Rate: 9.5 symbols/min [2025-09-14T17:23:50.815687] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:23:50.818234] [DEBUG] [LOCAL ] CICB: Loaded 562 existing records from primary storage. [2025-09-14T17:23:50.818341] [INFO ] [MAIN ] CICB: Loaded 562 existing records. [2025-09-14T17:23:50.967690] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-09-14T17:23:51.010246] [WARN ] [MAIN ] CICB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:23:51.010710] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-09-14T17:23:51.010804] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-14T17:23:51.011013] [DEBUG] [LOCAL ] CICB: Deleted primary data file. [2025-09-14T17:23:51.011070] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-09-14T17:23:51.361256] [INFO ] [REMOTE ] CICB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:23:51.758811] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-09-14T17:23:52.142932] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T17:23:52.160989] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-14T17:23:52.543545] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T17:23:52.558768] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-09-14T17:23:53.358842] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-09-14T17:23:53.552177] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T17:23:54.158858] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-09-14T17:23:54.562412] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-14T17:23:54.958871] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-09-14T17:23:55.294385] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-14T17:23:55.447914] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-14T17:23:55.758875] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-09-14T17:23:56.149768] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-14T17:23:56.558845] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-09-14T17:23:57.358826] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-09-14T17:23:58.158781] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-09-14T17:23:58.201563] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-14T17:23:58.343151] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T17:23:58.619411] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-14T17:23:58.958860] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-09-14T17:23:59.438053] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-14T17:23:59.758835] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-09-14T17:24:00.558888] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-09-14T17:24:01.358889] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-09-14T17:24:01.980350] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-14T17:24:02.018424] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T17:24:02.158882] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-09-14T17:24:02.958826] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-09-14T17:24:03.758859] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-09-14T17:24:04.183108] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-14T17:24:04.194228] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-14T17:24:04.445926] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (3.09 seconds). [2025-09-14T17:24:04.558824] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-09-14T17:24:04.796943] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-14T17:24:05.358837] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-09-14T17:24:05.681150] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-14T17:24:05.685201] [INFO ] [REMOTE ] CIB: Full fetch complete (34169 records). [2025-09-14T17:24:05.685332] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-09-14T17:24:06.058951] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-09-14T17:24:06.059140] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-09-14T17:24:06.059774] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-09-14T17:24:06.059839] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-09-14T17:24:06.060732] [DEBUG] [LOCAL ] CIB: Trimmed 34169 records to 22339 (keeping 150 days of data) [2025-09-14T17:24:06.161989] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-09-14T17:24:06.197630] [DEBUG] [LOCAL ] CIB: Primary data saved (22339 records). [2025-09-14T17:24:06.197805] [INFO ] [MAIN ] CIB: Full history saved. [2025-09-14T17:24:06.197949] [INFO ] [MAIN ] Update Progress: 446/2370 symbols completed. CIB took 23.7s. Estimated remaining: 3h 22m 22s. Rate: 9.5 symbols/min [2025-09-14T17:24:06.366334] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:24:06.388685] [DEBUG] [LOCAL ] CIEN: Loaded 23257 existing records from primary storage. [2025-09-14T17:24:06.388880] [INFO ] [MAIN ] CIEN: Loaded 23257 existing records. [2025-09-14T17:24:06.580085] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:24:06.580402] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-09-14T17:24:06.580479] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-09-14T17:24:06.581258] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-09-14T17:24:06.581327] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-09-14T17:24:06.895261] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T17:24:06.944596] [INFO ] [REMOTE ] CI: Full fetch complete (54296 records). [2025-09-14T17:24:06.960423] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-14T17:24:06.964066] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:24:06.964358] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-09-14T17:24:07.343841] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-09-14T17:24:07.344083] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-09-14T17:24:07.344945] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-09-14T17:24:07.345021] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-09-14T17:24:07.346785] [DEBUG] [LOCAL ] CI: Trimmed 54296 records to 37661 (keeping 150 days of data) [2025-09-14T17:24:07.479491] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T17:24:07.480794] [INFO ] [REMOTE ] CICB: Full fetch complete (1456 records). [2025-09-14T17:24:07.482544] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-09-14T17:24:07.496847] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-14T17:24:07.682170] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-14T17:24:07.683932] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:24:07.685544] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:24:07.686115] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-14T17:24:07.686741] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-14T17:24:07.687045] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-09-14T17:24:07.688749] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-09-14T17:24:07.689320] [INFO ] [MAIN ] Update Progress: 447/2370 symbols completed. CICB took 17.0s. Estimated remaining: 3h 21m 54s. Rate: 9.5 symbols/min [2025-09-14T17:24:07.761208] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-09-14T17:24:07.872290] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:24:07.965507] [DEBUG] [LOCAL ] CIF: Loaded 1654 existing records from primary storage. [2025-09-14T17:24:07.969843] [INFO ] [MAIN ] CIF: Loaded 1654 existing records. [2025-09-14T17:24:08.159570] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:24:08.161186] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-09-14T17:24:08.162266] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-09-14T17:24:08.163588] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-09-14T17:24:08.164738] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-09-14T17:24:08.520884] [DEBUG] [LOCAL ] CI: Primary data saved (37661 records). [2025-09-14T17:24:08.539619] [INFO ] [REMOTE ] CIF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:24:08.539736] [INFO ] [MAIN ] CI: Full history saved. [2025-09-14T17:24:08.540264] [INFO ] [MAIN ] Update Progress: 448/2370 symbols completed. CI took 35.8s. Estimated remaining: 3h 21m 25s. Rate: 9.5 symbols/min [2025-09-14T17:24:08.563921] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-09-14T17:24:08.725669] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:24:08.746260] [DEBUG] [LOCAL ] CIG: Loaded 20147 existing records from primary storage. [2025-09-14T17:24:08.746440] [INFO ] [MAIN ] CIG: Loaded 20147 existing records. [2025-09-14T17:24:08.921356] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:24:08.921686] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-09-14T17:24:08.921748] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-09-14T17:24:08.922355] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-09-14T17:24:08.922416] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-09-14T17:24:09.281232] [INFO ] [REMOTE ] CIG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:24:09.345903] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T17:24:09.358769] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-09-14T17:24:10.158834] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-09-14T17:24:10.750497] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-14T17:24:10.958859] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-09-14T17:24:11.141723] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-14T17:24:11.261693] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-14T17:24:11.271356] [INFO ] [REMOTE ] CHWY: Full fetch complete (58297 records). [2025-09-14T17:24:11.271634] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-09-14T17:24:11.767767] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-09-14T17:24:11.894136] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T17:24:11.962820] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-09-14T17:24:11.963049] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-09-14T17:24:11.964464] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-09-14T17:24:11.964581] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-09-14T17:24:11.966558] [DEBUG] [LOCAL ] CHWY: Trimmed 58297 records to 40401 (keeping 150 days of data) [2025-09-14T17:24:12.337121] [DEBUG] [LOCAL ] CHWY: Primary data saved (40401 records). [2025-09-14T17:24:12.337317] [INFO ] [MAIN ] CHWY: Full history saved. [2025-09-14T17:24:12.337473] [INFO ] [MAIN ] Update Progress: 449/2370 symbols completed. CHWY took 41.0s. Estimated remaining: 3h 21m 8s. Rate: 9.6 symbols/min [2025-09-14T17:24:12.513764] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:24:12.521817] [DEBUG] [LOCAL ] CII: Loaded 5976 existing records from primary storage. [2025-09-14T17:24:12.521981] [INFO ] [MAIN ] CII: Loaded 5976 existing records. [2025-09-14T17:24:12.565095] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-09-14T17:24:12.706405] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:24:12.706746] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-09-14T17:24:12.706822] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-09-14T17:24:12.707140] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-09-14T17:24:12.707225] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-09-14T17:24:12.812540] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-14T17:24:13.086043] [INFO ] [REMOTE ] CII: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:24:13.358850] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-09-14T17:24:14.066236] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-14T17:24:14.158830] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-09-14T17:24:14.928282] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-14T17:24:14.958780] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-09-14T17:24:15.372683] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-14T17:24:15.758827] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-09-14T17:24:16.558804] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-09-14T17:24:16.850169] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-14T17:24:16.944132] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T17:24:17.020701] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-14T17:24:17.358847] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-09-14T17:24:18.158829] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-09-14T17:24:18.281364] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-14T17:24:18.958828] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-09-14T17:24:19.758827] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-09-14T17:24:19.817383] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T17:24:19.979180] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T17:24:20.558865] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-09-14T17:24:21.358796] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-09-14T17:24:21.416518] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-14T17:24:21.464393] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-14T17:24:21.888276] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-14T17:24:22.158841] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-09-14T17:24:22.958828] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-09-14T17:24:23.060461] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T17:24:23.529575] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-14T17:24:23.758842] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-09-14T17:24:24.558826] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-09-14T17:24:25.358819] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-09-14T17:24:25.790127] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-14T17:24:26.009607] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-14T17:24:26.116734] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-14T17:24:26.158802] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-09-14T17:24:26.664882] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-14T17:24:26.958856] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-09-14T17:24:27.586821] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-14T17:24:27.758828] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-09-14T17:24:28.287275] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T17:24:28.288335] [INFO ] [REMOTE ] CIF: Full fetch complete (5124 records). [2025-09-14T17:24:28.288423] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-09-14T17:24:28.563960] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-09-14T17:24:28.668014] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-09-14T17:24:28.668143] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-09-14T17:24:28.668393] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-09-14T17:24:28.668452] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-09-14T17:24:28.668899] [DEBUG] [LOCAL ] CIF: Trimmed 5124 records to 2998 (keeping 150 days of data) [2025-09-14T17:24:28.687350] [DEBUG] [LOCAL ] CIF: Primary data saved (2998 records). [2025-09-14T17:24:28.687478] [INFO ] [MAIN ] CIF: Full history saved. [2025-09-14T17:24:28.687652] [INFO ] [MAIN ] Update Progress: 450/2370 symbols completed. CIF took 21.0s. Estimated remaining: 3h 21m 45s. Rate: 9.5 symbols/min [2025-09-14T17:24:28.859681] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:24:28.879964] [DEBUG] [LOCAL ] CIM: Loaded 15669 existing records from primary storage. [2025-09-14T17:24:28.880181] [INFO ] [MAIN ] CIM: Loaded 15669 existing records. [2025-09-14T17:24:29.060683] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:24:29.060958] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-09-14T17:24:29.061034] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-09-14T17:24:29.061583] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-09-14T17:24:29.061667] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-09-14T17:24:29.363917] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-09-14T17:24:29.419811] [INFO ] [REMOTE ] CIM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:24:30.158841] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-09-14T17:24:30.286145] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-14T17:24:30.285963] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T17:24:30.300610] [INFO ] [REMOTE ] CII: Full fetch complete (16967 records). [2025-09-14T17:24:30.301278] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-09-14T17:24:30.676154] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-09-14T17:24:30.676286] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-09-14T17:24:30.676750] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-09-14T17:24:30.676816] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-09-14T17:24:30.677353] [DEBUG] [LOCAL ] CII: Trimmed 16967 records to 10502 (keeping 150 days of data) [2025-09-14T17:24:30.741295] [DEBUG] [LOCAL ] CII: Primary data saved (10502 records). [2025-09-14T17:24:30.741470] [INFO ] [MAIN ] CII: Full history saved. [2025-09-14T17:24:30.741589] [INFO ] [MAIN ] Update Progress: 451/2370 symbols completed. CII took 18.4s. Estimated remaining: 3h 21m 20s. Rate: 9.5 symbols/min [2025-09-14T17:24:30.919000] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:24:30.921888] [DEBUG] [LOCAL ] CIMN: Loaded 993 existing records from primary storage. [2025-09-14T17:24:30.922008] [INFO ] [MAIN ] CIMN: Loaded 993 existing records. [2025-09-14T17:24:30.965361] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-09-14T17:24:31.103309] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:24:31.103625] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-09-14T17:24:31.103710] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-09-14T17:24:31.103929] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-09-14T17:24:31.103995] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-09-14T17:24:31.523254] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:24:31.678614] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:24:31.684328] [INFO ] [REMOTE ] CIEN: Full fetch complete (56641 records). [2025-09-14T17:24:31.684479] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-09-14T17:24:31.760996] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-09-14T17:24:31.820600] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T17:24:32.113780] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-09-14T17:24:32.113909] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-09-14T17:24:32.114883] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-09-14T17:24:32.114968] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-09-14T17:24:32.116420] [DEBUG] [LOCAL ] CIEN: Trimmed 56641 records to 39027 (keeping 150 days of data) [2025-09-14T17:24:32.338343] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-14T17:24:32.371472] [DEBUG] [LOCAL ] CIEN: Primary data saved (39027 records). [2025-09-14T17:24:32.371681] [INFO ] [MAIN ] CIEN: Full history saved. [2025-09-14T17:24:32.371810] [INFO ] [MAIN ] Update Progress: 452/2370 symbols completed. CIEN took 26.2s. Estimated remaining: 3h 20m 54s. Rate: 9.5 symbols/min [2025-09-14T17:24:32.551574] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:24:32.555049] [DEBUG] [LOCAL ] CIMO: Loaded 1450 existing records from primary storage. [2025-09-14T17:24:32.555145] [INFO ] [MAIN ] CIMO: Loaded 1450 existing records. [2025-09-14T17:24:32.565897] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-09-14T17:24:32.734686] [WARN ] [MAIN ] CIMO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:24:32.734953] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-09-14T17:24:32.735012] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-14T17:24:32.735239] [DEBUG] [LOCAL ] CIMO: Deleted primary data file. [2025-09-14T17:24:32.735298] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-09-14T17:24:33.089966] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:24:33.358850] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-09-14T17:24:33.844066] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-14T17:24:34.158884] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-09-14T17:24:34.397704] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-14T17:24:34.656041] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-14T17:24:34.958904] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-09-14T17:24:35.758880] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-09-14T17:24:36.444407] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-14T17:24:36.558837] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-09-14T17:24:36.885477] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-14T17:24:37.358894] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-09-14T17:24:37.739204] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-14T17:24:38.158851] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-09-14T17:24:38.627738] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-14T17:24:38.958829] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-09-14T17:24:39.144886] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (4.19 seconds). [2025-09-14T17:24:39.495866] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-14T17:24:39.758881] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-09-14T17:24:40.558869] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-09-14T17:24:41.323825] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-14T17:24:41.358832] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-09-14T17:24:41.842251] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T17:24:41.957007] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-14T17:24:42.158822] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-09-14T17:24:42.623632] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-14T17:24:42.958886] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-09-14T17:24:43.553717] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-14T17:24:43.758828] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-09-14T17:24:44.272457] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-14T17:24:44.558835] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-14T17:24:45.063454] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T17:24:45.064590] [INFO ] [REMOTE ] CIMO: Full fetch complete (3136 records). [2025-09-14T17:24:45.064708] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-09-14T17:24:45.363964] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-09-14T17:24:45.434828] [DEBUG] [VALIDATOR ] CIMO: All expected trading days are present. [2025-09-14T17:24:45.435046] [DEBUG] [VALIDATOR ] CIMO: Primary data validation passed. [2025-09-14T17:24:45.435222] [INFO ] [MAIN ] CIMO: Fetched primary data is valid. [2025-09-14T17:24:45.435301] [DEBUG] [LOCAL ] CIMO: Saving primary data. [2025-09-14T17:24:45.436079] [DEBUG] [LOCAL ] CIMO: Trimmed 3136 records to 2054 (keeping 150 days of data) [2025-09-14T17:24:45.450474] [DEBUG] [LOCAL ] CIMO: Primary data saved (2054 records). [2025-09-14T17:24:45.450662] [INFO ] [MAIN ] CIMO: Full history saved. [2025-09-14T17:24:45.450810] [INFO ] [MAIN ] Update Progress: 453/2370 symbols completed. CIMO took 13.1s. Estimated remaining: 3h 21m 17s. Rate: 9.5 symbols/min [2025-09-14T17:24:45.626618] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:24:45.637414] [DEBUG] [LOCAL ] CINT: Loaded 7896 existing records from primary storage. [2025-09-14T17:24:45.637600] [INFO ] [MAIN ] CINT: Loaded 7896 existing records. [2025-09-14T17:24:45.814237] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:24:45.814510] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-09-14T17:24:45.814568] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-09-14T17:24:45.814924] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-09-14T17:24:45.814994] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-09-14T17:24:46.162222] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-09-14T17:24:46.165463] [INFO ] [REMOTE ] CINT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:24:46.507915] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-14T17:24:46.958881] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-09-14T17:24:47.060184] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-14T17:24:47.758807] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-09-14T17:24:48.020328] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-14T17:24:48.558880] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-09-14T17:24:49.261320] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-14T17:24:49.358873] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-09-14T17:24:49.734068] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-14T17:24:50.158883] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-09-14T17:24:50.412851] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-14T17:24:50.417869] [INFO ] [REMOTE ] CIG: Full fetch complete (46762 records). [2025-09-14T17:24:50.417982] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-09-14T17:24:50.792312] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-09-14T17:24:50.792428] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-09-14T17:24:50.793102] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-09-14T17:24:50.793163] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-09-14T17:24:50.794321] [DEBUG] [LOCAL ] CIG: Trimmed 46762 records to 33103 (keeping 150 days of data) [2025-09-14T17:24:50.971296] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-09-14T17:24:51.007085] [DEBUG] [LOCAL ] CIG: Primary data saved (33103 records). [2025-09-14T17:24:51.007269] [INFO ] [MAIN ] CIG: Full history saved. [2025-09-14T17:24:51.007450] [INFO ] [MAIN ] Update Progress: 454/2370 symbols completed. CIG took 42.5s. Estimated remaining: 3h 21m 7s. Rate: 9.5 symbols/min [2025-09-14T17:24:51.180306] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:24:51.191955] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-14T17:24:51.205426] [DEBUG] [LOCAL ] CIO: Loaded 10012 existing records from primary storage. [2025-09-14T17:24:51.205632] [INFO ] [MAIN ] CIO: Loaded 10012 existing records. [2025-09-14T17:24:51.412039] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:24:51.412529] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-09-14T17:24:51.412606] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-09-14T17:24:51.413229] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-09-14T17:24:51.413323] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-09-14T17:24:51.504895] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-14T17:24:51.767484] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-09-14T17:24:51.788912] [INFO ] [REMOTE ] CIO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:24:52.558831] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-09-14T17:24:52.812794] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-14T17:24:53.358884] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-09-14T17:24:53.723808] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-14T17:24:53.732875] [INFO ] [REMOTE ] CIMN: Full fetch complete (2884 records). [2025-09-14T17:24:53.745047] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-09-14T17:24:53.746407] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T17:24:54.113325] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-09-14T17:24:54.113436] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-09-14T17:24:54.113554] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-09-14T17:24:54.113605] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-09-14T17:24:54.114023] [DEBUG] [LOCAL ] CIMN: Trimmed 2884 records to 2000 (keeping 150 days of data) [2025-09-14T17:24:54.127620] [DEBUG] [LOCAL ] CIMN: Primary data saved (2000 records). [2025-09-14T17:24:54.127744] [INFO ] [MAIN ] CIMN: Full history saved. [2025-09-14T17:24:54.127869] [INFO ] [MAIN ] Update Progress: 455/2370 symbols completed. CIMN took 23.4s. Estimated remaining: 3h 20m 47s. Rate: 9.5 symbols/min [2025-09-14T17:24:54.164073] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-09-14T17:24:54.303969] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:24:54.321130] [DEBUG] [LOCAL ] CION: Loaded 11783 existing records from primary storage. [2025-09-14T17:24:54.321339] [INFO ] [MAIN ] CION: Loaded 11783 existing records. [2025-09-14T17:24:54.494177] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:24:54.494463] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-09-14T17:24:54.494526] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-09-14T17:24:54.494953] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-09-14T17:24:54.495017] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-09-14T17:24:54.862429] [INFO ] [REMOTE ] CION: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:24:54.958818] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-09-14T17:24:55.677700] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-14T17:24:55.734187] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-14T17:24:55.758831] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-09-14T17:24:56.558905] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-09-14T17:24:57.027844] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-14T17:24:57.358852] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-09-14T17:24:57.562394] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-14T17:24:57.972877] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-14T17:24:58.158852] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-09-14T17:24:58.958866] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-09-14T17:24:59.039831] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-14T17:24:59.758793] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-09-14T17:24:59.901667] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-14T17:25:00.519527] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-14T17:25:00.558807] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-09-14T17:25:01.358831] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-09-14T17:25:01.844844] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-14T17:25:01.851002] [INFO ] [REMOTE ] CIM: Full fetch complete (40697 records). [2025-09-14T17:25:01.851287] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-09-14T17:25:02.167555] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-09-14T17:25:02.310068] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-09-14T17:25:02.310259] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-09-14T17:25:02.311374] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-09-14T17:25:02.311445] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-09-14T17:25:02.313272] [DEBUG] [LOCAL ] CIM: Trimmed 40697 records to 27047 (keeping 150 days of data) [2025-09-14T17:25:02.455027] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T17:25:02.527243] [DEBUG] [LOCAL ] CIM: Primary data saved (27047 records). [2025-09-14T17:25:02.527506] [INFO ] [MAIN ] CIM: Full history saved. [2025-09-14T17:25:02.527782] [INFO ] [MAIN ] Update Progress: 456/2370 symbols completed. CIM took 33.8s. Estimated remaining: 3h 20m 50s. Rate: 9.5 symbols/min [2025-09-14T17:25:02.706138] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:25:02.732010] [DEBUG] [LOCAL ] CIVI: Loaded 23663 existing records from primary storage. [2025-09-14T17:25:02.732241] [INFO ] [MAIN ] CIVI: Loaded 23663 existing records. [2025-09-14T17:25:02.935205] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:25:02.935554] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-09-14T17:25:02.935623] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-09-14T17:25:02.936411] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-09-14T17:25:02.936482] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-09-14T17:25:02.967945] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-09-14T17:25:03.312862] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:25:03.328600] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T17:25:03.758847] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-09-14T17:25:04.214664] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T17:25:04.558940] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-09-14T17:25:04.937023] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-14T17:25:05.358874] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-09-14T17:25:06.100700] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-14T17:25:06.158848] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-09-14T17:25:06.169024] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T17:25:06.172408] [INFO ] [REMOTE ] CINT: Full fetch complete (19704 records). [2025-09-14T17:25:06.172617] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-09-14T17:25:06.549692] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-09-14T17:25:06.549806] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-09-14T17:25:06.550202] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-09-14T17:25:06.550256] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-09-14T17:25:06.550863] [DEBUG] [LOCAL ] CINT: Trimmed 19704 records to 13273 (keeping 150 days of data) [2025-09-14T17:25:06.627990] [DEBUG] [LOCAL ] CINT: Primary data saved (13273 records). [2025-09-14T17:25:06.628182] [INFO ] [MAIN ] CINT: Full history saved. [2025-09-14T17:25:06.628298] [INFO ] [MAIN ] Update Progress: 457/2370 symbols completed. CINT took 21.2s. Estimated remaining: 3h 20m 34s. Rate: 9.5 symbols/min [2025-09-14T17:25:06.803250] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:25:06.829607] [DEBUG] [LOCAL ] CL: Loaded 24068 existing records from primary storage. [2025-09-14T17:25:06.829804] [INFO ] [MAIN ] CL: Loaded 24068 existing records. [2025-09-14T17:25:06.964058] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-09-14T17:25:07.021836] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:25:07.022186] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-09-14T17:25:07.022296] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-09-14T17:25:07.023349] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-09-14T17:25:07.023623] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-09-14T17:25:07.394589] [INFO ] [REMOTE ] CL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:25:07.739988] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T17:25:07.758778] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-09-14T17:25:08.558906] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-09-14T17:25:08.783329] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T17:25:08.907505] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-14T17:25:09.358843] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-09-14T17:25:09.550079] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T17:25:10.158825] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-09-14T17:25:10.958799] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-09-14T17:25:11.320139] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-14T17:25:11.422979] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T17:25:11.758838] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-09-14T17:25:12.558877] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-09-14T17:25:12.661920] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T17:25:12.689728] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T17:25:13.358832] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-09-14T17:25:14.158865] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-09-14T17:25:14.468205] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T17:25:14.958804] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-09-14T17:25:15.090447] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-14T17:25:15.415210] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T17:25:15.758783] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-09-14T17:25:16.211829] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T17:25:16.558799] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-09-14T17:25:16.914801] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T17:25:17.272996] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:25:17.275994] [INFO ] [REMOTE ] CION: Full fetch complete (31319 records). [2025-09-14T17:25:17.276099] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-09-14T17:25:17.364023] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-09-14T17:25:17.648469] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-09-14T17:25:17.648576] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-09-14T17:25:17.649139] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-09-14T17:25:17.649198] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-09-14T17:25:17.650006] [DEBUG] [LOCAL ] CION: Trimmed 31319 records to 20633 (keeping 150 days of data) [2025-09-14T17:25:17.779106] [DEBUG] [LOCAL ] CION: Primary data saved (20633 records). [2025-09-14T17:25:17.779275] [INFO ] [MAIN ] CION: Full history saved. [2025-09-14T17:25:17.779365] [INFO ] [MAIN ] Update Progress: 458/2370 symbols completed. CION took 23.7s. Estimated remaining: 3h 20m 48s. Rate: 9.5 symbols/min [2025-09-14T17:25:17.947757] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:25:17.965462] [DEBUG] [LOCAL ] CLB: Loaded 14776 existing records from primary storage. [2025-09-14T17:25:17.965661] [INFO ] [MAIN ] CLB: Loaded 14776 existing records. [2025-09-14T17:25:18.142675] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:25:18.149017] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-14T17:25:18.149152] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-09-14T17:25:18.151337] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-09-14T17:25:18.151935] [INFO ] [REMOTE ] CIO: Full fetch complete (21194 records). [2025-09-14T17:25:18.152027] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-09-14T17:25:18.163862] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-09-14T17:25:18.163909] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-09-14T17:25:18.229327] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-09-14T17:25:18.868225] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-09-14T17:25:18.883819] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-09-14T17:25:18.890050] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-09-14T17:25:18.889387] [INFO ] [REMOTE ] CLB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:25:18.890215] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-09-14T17:25:18.891354] [DEBUG] [LOCAL ] CIO: Trimmed 21194 records to 14685 (keeping 150 days of data) [2025-09-14T17:25:18.958811] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-09-14T17:25:18.979149] [DEBUG] [LOCAL ] CIO: Primary data saved (14685 records). [2025-09-14T17:25:18.979675] [INFO ] [MAIN ] CIO: Full history saved. [2025-09-14T17:25:18.979794] [INFO ] [MAIN ] Update Progress: 459/2370 symbols completed. CIO took 28.0s. Estimated remaining: 3h 20m 21s. Rate: 9.5 symbols/min [2025-09-14T17:25:19.150531] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:25:19.156415] [DEBUG] [LOCAL ] CLCO: Loaded 4165 existing records from primary storage. [2025-09-14T17:25:19.156551] [INFO ] [MAIN ] CLCO: Loaded 4165 existing records. [2025-09-14T17:25:19.333664] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:25:19.333927] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-09-14T17:25:19.333988] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-09-14T17:25:19.334283] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-09-14T17:25:19.334341] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-09-14T17:25:19.724129] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:25:19.758787] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-09-14T17:25:19.817535] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-14T17:25:20.558806] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-09-14T17:25:20.701651] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T17:25:20.756312] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-14T17:25:21.358826] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-09-14T17:25:22.158833] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-09-14T17:25:22.522318] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-14T17:25:22.551032] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-14T17:25:22.958853] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-09-14T17:25:23.758866] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-09-14T17:25:24.056725] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-14T17:25:24.558840] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-09-14T17:25:24.804815] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T17:25:25.203774] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-14T17:25:25.358823] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-09-14T17:25:25.764818] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-14T17:25:26.158878] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-09-14T17:25:26.958794] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-09-14T17:25:27.406058] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-14T17:25:27.619887] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-14T17:25:27.758785] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-09-14T17:25:28.044813] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T17:25:28.394864] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:25:28.400384] [INFO ] [REMOTE ] CIVI: Full fetch complete (57099 records). [2025-09-14T17:25:28.400525] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-09-14T17:25:28.560899] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-09-14T17:25:28.787470] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-09-14T17:25:28.787581] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-09-14T17:25:28.788337] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-09-14T17:25:28.788399] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-09-14T17:25:28.789665] [DEBUG] [LOCAL ] CIVI: Trimmed 57099 records to 39579 (keeping 150 days of data) [2025-09-14T17:25:29.040829] [DEBUG] [LOCAL ] CIVI: Primary data saved (39579 records). [2025-09-14T17:25:29.041016] [INFO ] [MAIN ] CIVI: Full history saved. [2025-09-14T17:25:29.041119] [INFO ] [MAIN ] Update Progress: 460/2370 symbols completed. CIVI took 26.5s. Estimated remaining: 3h 20m 30s. Rate: 9.5 symbols/min [2025-09-14T17:25:29.209062] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:25:29.219864] [DEBUG] [LOCAL ] CLDT: Loaded 9785 existing records from primary storage. [2025-09-14T17:25:29.220018] [INFO ] [MAIN ] CLDT: Loaded 9785 existing records. [2025-09-14T17:25:29.364019] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-09-14T17:25:29.400124] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:25:29.400447] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-09-14T17:25:29.400512] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-09-14T17:25:29.400966] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-09-14T17:25:29.401029] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-09-14T17:25:29.765969] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:25:30.158880] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-09-14T17:25:30.371206] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-14T17:25:30.585779] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-14T17:25:30.958814] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-09-14T17:25:31.081007] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-14T17:25:31.582996] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T17:25:31.758828] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-09-14T17:25:32.350904] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-14T17:25:32.558864] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-09-14T17:25:33.358829] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-09-14T17:25:33.720088] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T17:25:34.158861] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-09-14T17:25:34.965000] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-09-14T17:25:34.976466] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-14T17:25:35.154017] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-14T17:25:35.554578] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T17:25:35.560308] [INFO ] [REMOTE ] CL: Full fetch complete (58319 records). [2025-09-14T17:25:35.560467] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-09-14T17:25:35.767579] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-09-14T17:25:35.952015] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-09-14T17:25:35.952168] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-09-14T17:25:35.952925] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-09-14T17:25:35.953009] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-09-14T17:25:35.954365] [DEBUG] [LOCAL ] CL: Trimmed 58319 records to 40389 (keeping 150 days of data) [2025-09-14T17:25:36.208613] [DEBUG] [LOCAL ] CL: Primary data saved (40389 records). [2025-09-14T17:25:36.208818] [INFO ] [MAIN ] CL: Full history saved. [2025-09-14T17:25:36.208975] [INFO ] [MAIN ] Update Progress: 461/2370 symbols completed. CL took 29.6s. Estimated remaining: 3h 20m 28s. Rate: 9.5 symbols/min [2025-09-14T17:25:36.378895] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:25:36.402134] [DEBUG] [LOCAL ] CLF: Loaded 24103 existing records from primary storage. [2025-09-14T17:25:36.402329] [INFO ] [MAIN ] CLF: Loaded 24103 existing records. [2025-09-14T17:25:36.567509] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-09-14T17:25:36.588455] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:25:36.589559] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-09-14T17:25:36.589661] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-14T17:25:36.590503] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-09-14T17:25:36.590621] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-09-14T17:25:36.941706] [INFO ] [REMOTE ] CLF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:25:37.118029] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-14T17:25:37.358810] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-09-14T17:25:37.491323] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-14T17:25:38.158893] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-09-14T17:25:38.453268] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-14T17:25:38.958845] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-09-14T17:25:39.758811] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-09-14T17:25:40.085239] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-14T17:25:40.267205] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-14T17:25:40.558803] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-09-14T17:25:40.840802] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T17:25:41.281978] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T17:25:41.283365] [INFO ] [REMOTE ] CLCO: Full fetch complete (15682 records). [2025-09-14T17:25:41.283457] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-09-14T17:25:41.363923] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-09-14T17:25:41.660203] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-09-14T17:25:41.660695] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-09-14T17:25:41.661152] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-09-14T17:25:41.661220] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-09-14T17:25:41.661777] [DEBUG] [LOCAL ] CLCO: Trimmed 15682 records to 8144 (keeping 150 days of data) [2025-09-14T17:25:41.707441] [DEBUG] [LOCAL ] CLCO: Primary data saved (8144 records). [2025-09-14T17:25:41.707607] [INFO ] [MAIN ] CLCO: Full history saved. [2025-09-14T17:25:41.707725] [INFO ] [MAIN ] Update Progress: 462/2370 symbols completed. CLCO took 22.7s. Estimated remaining: 3h 20m 18s. Rate: 9.5 symbols/min [2025-09-14T17:25:41.876030] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:25:41.888860] [DEBUG] [LOCAL ] CLH: Loaded 11741 existing records from primary storage. [2025-09-14T17:25:41.889006] [INFO ] [MAIN ] CLH: Loaded 11741 existing records. [2025-09-14T17:25:42.063065] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:25:42.063336] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-09-14T17:25:42.063400] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-14T17:25:42.064013] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-09-14T17:25:42.064077] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-09-14T17:25:42.161829] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-09-14T17:25:42.419889] [INFO ] [REMOTE ] CLH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:25:42.958808] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-09-14T17:25:43.302141] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-14T17:25:43.643276] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-14T17:25:43.758787] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-09-14T17:25:44.066629] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-14T17:25:44.558830] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-09-14T17:25:45.358801] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-09-14T17:25:45.544535] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T17:25:45.648034] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T17:25:46.158878] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-09-14T17:25:46.781451] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-14T17:25:46.958826] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-09-14T17:25:47.758848] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-09-14T17:25:47.920517] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-14T17:25:47.923571] [INFO ] [REMOTE ] CLDT: Full fetch complete (28559 records). [2025-09-14T17:25:47.923700] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-09-14T17:25:48.292117] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-09-14T17:25:48.292237] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-09-14T17:25:48.292823] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-09-14T17:25:48.292882] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-09-14T17:25:48.293633] [DEBUG] [LOCAL ] CLDT: Trimmed 28559 records to 18061 (keeping 150 days of data) [2025-09-14T17:25:48.397217] [DEBUG] [LOCAL ] CLDT: Primary data saved (18061 records). [2025-09-14T17:25:48.397538] [INFO ] [MAIN ] CLDT: Full history saved. [2025-09-14T17:25:48.397779] [INFO ] [MAIN ] Update Progress: 463/2370 symbols completed. CLDT took 19.4s. Estimated remaining: 3h 20m 13s. Rate: 9.5 symbols/min [2025-09-14T17:25:48.580138] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:25:48.580358] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-09-14T17:25:48.621265] [DEBUG] [LOCAL ] CLPR: Loaded 4720 existing records from primary storage. [2025-09-14T17:25:48.624006] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-14T17:25:48.624278] [INFO ] [MAIN ] CLPR: Loaded 4720 existing records. [2025-09-14T17:25:48.822783] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:25:48.823388] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-09-14T17:25:48.823535] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-09-14T17:25:48.824249] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-09-14T17:25:48.824328] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-09-14T17:25:48.975670] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-14T17:25:49.223634] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:25:49.358801] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-09-14T17:25:50.067991] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-14T17:25:50.132192] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-14T17:25:50.158860] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-09-14T17:25:50.958838] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-09-14T17:25:51.758831] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-09-14T17:25:51.911190] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T17:25:52.343574] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-14T17:25:52.558880] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-09-14T17:25:52.879818] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-14T17:25:52.883798] [INFO ] [REMOTE ] CLB: Full fetch complete (35798 records). [2025-09-14T17:25:52.883926] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-09-14T17:25:53.262285] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-09-14T17:25:53.268141] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-09-14T17:25:53.277724] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-09-14T17:25:53.277831] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-09-14T17:25:53.279039] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-14T17:25:53.286007] [DEBUG] [LOCAL ] CLB: Trimmed 35798 records to 24690 (keeping 150 days of data) [2025-09-14T17:25:53.377133] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-09-14T17:25:53.444284] [DEBUG] [LOCAL ] CLB: Primary data saved (24690 records). [2025-09-14T17:25:53.444466] [INFO ] [MAIN ] CLB: Full history saved. [2025-09-14T17:25:53.444669] [INFO ] [MAIN ] Update Progress: 464/2370 symbols completed. CLB took 35.7s. Estimated remaining: 3h 20m 2s. Rate: 9.5 symbols/min [2025-09-14T17:25:53.618265] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:25:53.642879] [DEBUG] [LOCAL ] CLS: Loaded 24046 existing records from primary storage. [2025-09-14T17:25:53.643061] [INFO ] [MAIN ] CLS: Loaded 24046 existing records. [2025-09-14T17:25:53.822460] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:25:53.822773] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-09-14T17:25:53.822870] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-09-14T17:25:53.823532] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-09-14T17:25:53.823597] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-09-14T17:25:54.169322] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-09-14T17:25:54.187547] [INFO ] [REMOTE ] CLS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:25:54.307473] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T17:25:54.958835] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-09-14T17:25:55.158537] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-14T17:25:55.758864] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-09-14T17:25:56.558863] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-09-14T17:25:57.123481] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-14T17:25:57.233766] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-14T17:25:57.358832] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-09-14T17:25:57.550203] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-14T17:25:58.158885] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-09-14T17:25:58.958858] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-09-14T17:25:59.600109] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T17:25:59.653797] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-14T17:25:59.758797] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-09-14T17:25:59.877993] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-14T17:26:00.240744] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-14T17:26:00.243630] [INFO ] [REMOTE ] CLH: Full fetch complete (31825 records). [2025-09-14T17:26:00.243742] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-09-14T17:26:00.563999] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-09-14T17:26:00.631882] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-09-14T17:26:00.632122] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-09-14T17:26:00.632885] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-09-14T17:26:00.632950] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-09-14T17:26:00.634267] [DEBUG] [LOCAL ] CLH: Trimmed 31825 records to 20164 (keeping 150 days of data) [2025-09-14T17:26:00.762834] [DEBUG] [LOCAL ] CLH: Primary data saved (20164 records). [2025-09-14T17:26:00.763008] [INFO ] [MAIN ] CLH: Full history saved. [2025-09-14T17:26:00.763121] [INFO ] [MAIN ] Update Progress: 465/2370 symbols completed. CLH took 19.1s. Estimated remaining: 3h 19m 60s. Rate: 9.5 symbols/min [2025-09-14T17:26:00.933865] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:26:00.960132] [DEBUG] [LOCAL ] CLVT: Loaded 23363 existing records from primary storage. [2025-09-14T17:26:00.960359] [INFO ] [MAIN ] CLVT: Loaded 23363 existing records. [2025-09-14T17:26:01.140031] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:26:01.140335] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-09-14T17:26:01.140402] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-09-14T17:26:01.141074] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-09-14T17:26:01.141145] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-09-14T17:26:01.367984] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-09-14T17:26:01.494692] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:26:02.158868] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-09-14T17:26:02.229374] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T17:26:02.958890] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-09-14T17:26:03.054111] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-14T17:26:03.716813] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T17:26:03.756446] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-14T17:26:03.759465] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-09-14T17:26:04.558918] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-09-14T17:26:05.354188] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T17:26:05.364743] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-09-14T17:26:06.158900] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-09-14T17:26:06.212941] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-14T17:26:06.958810] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-09-14T17:26:07.028129] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-14T17:26:07.684900] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T17:26:07.686347] [INFO ] [REMOTE ] CLPR: Full fetch complete (12546 records). [2025-09-14T17:26:07.686443] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-09-14T17:26:07.763955] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-09-14T17:26:08.055679] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-09-14T17:26:08.055845] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-09-14T17:26:08.056244] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-09-14T17:26:08.056419] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-09-14T17:26:08.057140] [DEBUG] [LOCAL ] CLPR: Trimmed 12546 records to 7910 (keeping 150 days of data) [2025-09-14T17:26:08.133459] [DEBUG] [LOCAL ] CLPR: Primary data saved (7910 records). [2025-09-14T17:26:08.134879] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-14T17:26:08.146185] [INFO ] [MAIN ] CLPR: Full history saved. [2025-09-14T17:26:08.146728] [INFO ] [MAIN ] Update Progress: 466/2370 symbols completed. CLPR took 19.7s. Estimated remaining: 3h 19m 58s. Rate: 9.5 symbols/min [2025-09-14T17:26:08.314143] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:26:08.328347] [DEBUG] [LOCAL ] CLW: Loaded 9293 existing records from primary storage. [2025-09-14T17:26:08.328520] [INFO ] [MAIN ] CLW: Loaded 9293 existing records. [2025-09-14T17:26:08.503542] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:26:08.503863] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-09-14T17:26:08.503934] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-09-14T17:26:08.504257] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-09-14T17:26:08.504316] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-09-14T17:26:08.565710] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-09-14T17:26:08.888415] [INFO ] [REMOTE ] CLW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:26:09.358835] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-09-14T17:26:10.060032] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-14T17:26:10.086160] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T17:26:10.091717] [INFO ] [REMOTE ] CLF: Full fetch complete (58422 records). [2025-09-14T17:26:10.091868] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-09-14T17:26:10.165171] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-09-14T17:26:10.476331] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-09-14T17:26:10.476546] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-09-14T17:26:10.477411] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-09-14T17:26:10.477576] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-09-14T17:26:10.479264] [DEBUG] [LOCAL ] CLF: Trimmed 58422 records to 40482 (keeping 150 days of data) [2025-09-14T17:26:10.593367] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-14T17:26:10.759210] [DEBUG] [LOCAL ] CLF: Primary data saved (40482 records). [2025-09-14T17:26:10.759390] [INFO ] [MAIN ] CLF: Full history saved. [2025-09-14T17:26:10.759504] [INFO ] [MAIN ] Update Progress: 467/2370 symbols completed. CLF took 34.6s. Estimated remaining: 3h 19m 37s. Rate: 9.5 symbols/min [2025-09-14T17:26:10.932716] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:26:10.955906] [DEBUG] [LOCAL ] CLX: Loaded 23523 existing records from primary storage. [2025-09-14T17:26:10.956064] [INFO ] [MAIN ] CLX: Loaded 23523 existing records. [2025-09-14T17:26:10.961703] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-09-14T17:26:11.133136] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:26:11.133406] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-09-14T17:26:11.133468] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-09-14T17:26:11.134347] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-09-14T17:26:11.134416] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-09-14T17:26:11.497331] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T17:26:11.516070] [INFO ] [REMOTE ] CLX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:26:11.758824] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-09-14T17:26:12.558836] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-09-14T17:26:13.335019] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-14T17:26:13.358791] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-09-14T17:26:13.483909] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T17:26:14.158846] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-09-14T17:26:14.222988] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T17:26:14.958896] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-09-14T17:26:15.362777] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-14T17:26:15.390869] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-14T17:26:15.758959] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-09-14T17:26:16.558910] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-09-14T17:26:16.756765] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T17:26:17.358859] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-09-14T17:26:18.016601] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-14T17:26:18.063603] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T17:26:18.158783] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-09-14T17:26:18.958854] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-09-14T17:26:19.271809] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-14T17:26:19.758861] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-09-14T17:26:20.010255] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T17:26:20.558905] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-09-14T17:26:20.613150] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-14T17:26:20.618836] [INFO ] [REMOTE ] CLS: Full fetch complete (58325 records). [2025-09-14T17:26:20.619009] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-09-14T17:26:21.004859] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-09-14T17:26:21.004962] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-09-14T17:26:21.009008] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-09-14T17:26:21.009142] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-09-14T17:26:21.010540] [DEBUG] [LOCAL ] CLS: Trimmed 58325 records to 40398 (keeping 150 days of data) [2025-09-14T17:26:21.131382] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-14T17:26:21.293345] [DEBUG] [LOCAL ] CLS: Primary data saved (40398 records). [2025-09-14T17:26:21.293513] [INFO ] [MAIN ] CLS: Full history saved. [2025-09-14T17:26:21.293614] [INFO ] [MAIN ] Update Progress: 468/2370 symbols completed. CLS took 27.8s. Estimated remaining: 3h 19m 47s. Rate: 9.5 symbols/min [2025-09-14T17:26:21.368132] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-09-14T17:26:21.464631] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:26:21.485577] [DEBUG] [LOCAL ] CM: Loaded 22350 existing records from primary storage. [2025-09-14T17:26:21.485852] [INFO ] [MAIN ] CM: Loaded 22350 existing records. [2025-09-14T17:26:21.659858] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:26:21.660140] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-09-14T17:26:21.660200] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-14T17:26:21.660844] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-09-14T17:26:21.660912] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-09-14T17:26:22.017891] [INFO ] [REMOTE ] CM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:26:22.158870] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-09-14T17:26:22.335244] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T17:26:22.493223] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-14T17:26:22.958841] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-09-14T17:26:23.758888] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-09-14T17:26:23.865840] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T17:26:24.022611] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T17:26:24.558832] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-09-14T17:26:25.138316] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-14T17:26:25.358845] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-09-14T17:26:26.136990] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-14T17:26:26.143102] [INFO ] [REMOTE ] CLVT: Full fetch complete (56682 records). [2025-09-14T17:26:26.143289] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-09-14T17:26:26.165517] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-09-14T17:26:26.546078] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-09-14T17:26:26.546312] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-09-14T17:26:26.547104] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-09-14T17:26:26.547250] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-09-14T17:26:26.561376] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T17:26:26.566244] [DEBUG] [LOCAL ] CLVT: Trimmed 56682 records to 39160 (keeping 150 days of data) [2025-09-14T17:26:26.807091] [DEBUG] [LOCAL ] CLVT: Primary data saved (39160 records). [2025-09-14T17:26:26.807303] [INFO ] [MAIN ] CLVT: Full history saved. [2025-09-14T17:26:26.807412] [INFO ] [MAIN ] Update Progress: 469/2370 symbols completed. CLVT took 26.0s. Estimated remaining: 3h 19m 38s. Rate: 9.5 symbols/min [2025-09-14T17:26:26.967377] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-09-14T17:26:27.008013] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:26:27.038953] [DEBUG] [LOCAL ] CMA: Loaded 22691 existing records from primary storage. [2025-09-14T17:26:27.039165] [INFO ] [MAIN ] CMA: Loaded 22691 existing records. [2025-09-14T17:26:27.233835] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:26:27.234293] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-09-14T17:26:27.234364] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-09-14T17:26:27.235076] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-09-14T17:26:27.235171] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-09-14T17:26:27.612181] [INFO ] [REMOTE ] CMA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:26:27.758870] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-09-14T17:26:27.878583] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-14T17:26:28.252671] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-14T17:26:28.558838] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-09-14T17:26:29.102015] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T17:26:29.105857] [INFO ] [REMOTE ] CLW: Full fetch complete (24670 records). [2025-09-14T17:26:29.105960] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-09-14T17:26:29.364590] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-09-14T17:26:29.509231] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-09-14T17:26:29.510223] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-09-14T17:26:29.511018] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-09-14T17:26:29.511091] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-09-14T17:26:29.512470] [DEBUG] [LOCAL ] CLW: Trimmed 24670 records to 15967 (keeping 150 days of data) [2025-09-14T17:26:29.628316] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-14T17:26:29.663009] [DEBUG] [LOCAL ] CLW: Primary data saved (15967 records). [2025-09-14T17:26:29.663208] [INFO ] [MAIN ] CLW: Full history saved. [2025-09-14T17:26:29.663376] [INFO ] [MAIN ] Update Progress: 470/2370 symbols completed. CLW took 21.5s. Estimated remaining: 3h 19m 18s. Rate: 9.5 symbols/min [2025-09-14T17:26:29.833742] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:26:29.846445] [DEBUG] [LOCAL ] CMBT: Loaded 11271 existing records from primary storage. [2025-09-14T17:26:29.846631] [INFO ] [MAIN ] CMBT: Loaded 11271 existing records. [2025-09-14T17:26:30.026225] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:26:30.026488] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-09-14T17:26:30.026546] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-09-14T17:26:30.026998] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-09-14T17:26:30.027060] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-09-14T17:26:30.173792] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-09-14T17:26:30.398427] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:26:30.958868] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-09-14T17:26:31.088036] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T17:26:31.548246] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T17:26:31.758912] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-09-14T17:26:31.835557] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T17:26:32.558913] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-09-14T17:26:33.358907] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-09-14T17:26:33.712771] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-14T17:26:34.086697] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-14T17:26:34.158792] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-09-14T17:26:34.262435] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T17:26:34.958915] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-09-14T17:26:35.242764] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T17:26:35.758874] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-09-14T17:26:36.558843] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-09-14T17:26:36.809552] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T17:26:37.358887] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-09-14T17:26:37.652132] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T17:26:37.676831] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T17:26:38.158838] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-09-14T17:26:38.588504] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-14T17:26:38.807923] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T17:26:38.814540] [INFO ] [REMOTE ] CLX: Full fetch complete (55656 records). [2025-09-14T17:26:38.814791] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-09-14T17:26:38.965390] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-09-14T17:26:39.193689] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-09-14T17:26:39.193797] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-09-14T17:26:39.194517] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-09-14T17:26:39.194584] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-09-14T17:26:39.195846] [DEBUG] [LOCAL ] CLX: Trimmed 55656 records to 39046 (keeping 150 days of data) [2025-09-14T17:26:39.452140] [DEBUG] [LOCAL ] CLX: Primary data saved (39046 records). [2025-09-14T17:26:39.452339] [INFO ] [MAIN ] CLX: Full history saved. [2025-09-14T17:26:39.452461] [INFO ] [MAIN ] Update Progress: 471/2370 symbols completed. CLX took 28.7s. Estimated remaining: 3h 19m 26s. Rate: 9.5 symbols/min [2025-09-14T17:26:39.618246] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:26:39.638769] [DEBUG] [LOCAL ] CMC: Loaded 19969 existing records from primary storage. [2025-09-14T17:26:39.638939] [INFO ] [MAIN ] CMC: Loaded 19969 existing records. [2025-09-14T17:26:39.763882] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-09-14T17:26:39.812584] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:26:39.812791] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-09-14T17:26:39.812849] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-09-14T17:26:39.813534] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-09-14T17:26:39.813598] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-09-14T17:26:40.164314] [INFO ] [REMOTE ] CMC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:26:40.558799] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-09-14T17:26:40.702894] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T17:26:41.338304] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-14T17:26:41.358772] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-09-14T17:26:41.484310] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-14T17:26:42.086662] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-14T17:26:42.158798] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-09-14T17:26:42.958831] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-09-14T17:26:43.653584] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T17:26:43.758789] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-09-14T17:26:44.536984] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-14T17:26:44.558779] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-09-14T17:26:44.950181] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-14T17:26:44.955354] [INFO ] [REMOTE ] CMBT: Full fetch complete (21467 records). [2025-09-14T17:26:44.955490] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-09-14T17:26:45.321933] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-09-14T17:26:45.322044] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-09-14T17:26:45.322469] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-09-14T17:26:45.322523] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-09-14T17:26:45.323187] [DEBUG] [LOCAL ] CMBT: Trimmed 21467 records to 16797 (keeping 150 days of data) [2025-09-14T17:26:45.364395] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-09-14T17:26:45.428676] [DEBUG] [LOCAL ] CMBT: Primary data saved (16797 records). [2025-09-14T17:26:45.428942] [INFO ] [MAIN ] CMBT: Full history saved. [2025-09-14T17:26:45.429060] [INFO ] [MAIN ] Update Progress: 472/2370 symbols completed. CMBT took 15.8s. Estimated remaining: 3h 19m 18s. Rate: 9.5 symbols/min [2025-09-14T17:26:45.601553] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:26:45.606357] [DEBUG] [LOCAL ] CMCM: Loaded 2696 existing records from primary storage. [2025-09-14T17:26:45.606539] [INFO ] [MAIN ] CMCM: Loaded 2696 existing records. [2025-09-14T17:26:45.789891] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:26:45.790211] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-09-14T17:26:45.790282] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-09-14T17:26:45.790562] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-09-14T17:26:45.790631] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-09-14T17:26:46.137833] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:26:46.158791] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-09-14T17:26:46.327303] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T17:26:46.806436] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-14T17:26:46.958839] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-09-14T17:26:47.100738] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T17:26:47.604972] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-14T17:26:47.758860] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-09-14T17:26:48.259707] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-14T17:26:48.558864] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-09-14T17:26:49.358874] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-09-14T17:26:50.158901] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-09-14T17:26:50.322374] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-14T17:26:50.462689] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T17:26:50.958833] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-09-14T17:26:51.360446] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-14T17:26:51.758885] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-09-14T17:26:52.558876] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-09-14T17:26:52.868499] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T17:26:53.199840] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:26:53.205054] [INFO ] [REMOTE ] CMA: Full fetch complete (54828 records). [2025-09-14T17:26:53.205188] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-09-14T17:26:53.360776] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-09-14T17:26:53.512841] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-14T17:26:53.538363] [INFO ] [REMOTE ] CM: Full fetch complete (52616 records). [2025-09-14T17:26:53.579398] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-09-14T17:26:53.630037] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-09-14T17:26:53.630288] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-09-14T17:26:53.631089] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-09-14T17:26:53.631167] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-09-14T17:26:53.715577] [DEBUG] [LOCAL ] CMA: Trimmed 54828 records to 37599 (keeping 150 days of data) [2025-09-14T17:26:54.154898] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-09-14T17:26:54.156395] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-09-14T17:26:54.157572] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-09-14T17:26:54.157952] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-09-14T17:26:54.159110] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-09-14T17:26:54.163442] [DEBUG] [LOCAL ] CM: Trimmed 52616 records to 36406 (keeping 150 days of data) [2025-09-14T17:26:54.474273] [DEBUG] [LOCAL ] CMA: Primary data saved (37599 records). [2025-09-14T17:26:54.495141] [INFO ] [MAIN ] CMA: Full history saved. [2025-09-14T17:26:54.495700] [INFO ] [MAIN ] Update Progress: 473/2370 symbols completed. CMA took 27.7s. Estimated remaining: 3h 19m 23s. Rate: 9.5 symbols/min [2025-09-14T17:26:54.682036] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:26:54.692722] [DEBUG] [LOCAL ] CMDB: Loaded 6216 existing records from primary storage. [2025-09-14T17:26:54.694294] [INFO ] [MAIN ] CMDB: Loaded 6216 existing records. [2025-09-14T17:26:54.767246] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-14T17:26:54.887381] [WARN ] [MAIN ] CMDB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:26:54.889944] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-09-14T17:26:54.891604] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-14T17:26:54.893181] [DEBUG] [LOCAL ] CMDB: Deleted primary data file. [2025-09-14T17:26:54.893826] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-09-14T17:26:54.896236] [DEBUG] [LOCAL ] CM: Primary data saved (36406 records). [2025-09-14T17:26:54.960695] [INFO ] [MAIN ] CM: Full history saved. [2025-09-14T17:26:54.960765] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-09-14T17:26:54.988182] [INFO ] [MAIN ] Update Progress: 474/2370 symbols completed. CM took 33.7s. Estimated remaining: 3h 18m 53s. Rate: 9.5 symbols/min [2025-09-14T17:26:55.358131] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:26:55.438664] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:26:55.484036] [DEBUG] [LOCAL ] CMG: Loaded 24089 existing records from primary storage. [2025-09-14T17:26:55.484548] [INFO ] [MAIN ] CMG: Loaded 24089 existing records. [2025-09-14T17:26:55.486437] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-14T17:26:55.674737] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:26:55.675072] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-09-14T17:26:55.678339] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-09-14T17:26:55.678475] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-14T17:26:55.679849] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-09-14T17:26:55.680131] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-09-14T17:26:55.764013] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-09-14T17:26:56.035530] [INFO ] [REMOTE ] CMG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:26:56.558881] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-09-14T17:26:57.100968] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-14T17:26:57.151932] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T17:26:57.358820] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-09-14T17:26:57.791010] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-14T17:26:58.158871] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-09-14T17:26:58.958831] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-02. [2025-09-14T17:26:59.210787] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:26:59.211128] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-02 [2025-09-14T17:26:59.758817] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-09-14T17:27:00.117459] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-14T17:27:00.558869] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-09-14T17:27:01.351950] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T17:27:01.355916] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T17:27:01.364587] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-03. [2025-09-14T17:27:01.367149] [INFO ] [REMOTE ] CMCM: Full fetch complete (5262 records). [2025-09-14T17:27:01.368413] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-09-14T17:27:01.750088] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-09-14T17:27:01.750206] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-09-14T17:27:01.750431] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-09-14T17:27:01.750520] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-09-14T17:27:01.751000] [DEBUG] [LOCAL ] CMCM: Trimmed 5262 records to 3310 (keeping 150 days of data) [2025-09-14T17:27:01.771432] [DEBUG] [LOCAL ] CMCM: Primary data saved (3310 records). [2025-09-14T17:27:01.771614] [INFO ] [MAIN ] CMCM: Full history saved. [2025-09-14T17:27:01.771737] [INFO ] [MAIN ] Update Progress: 475/2370 symbols completed. CMCM took 16.3s. Estimated remaining: 3h 18m 49s. Rate: 9.5 symbols/min [2025-09-14T17:27:01.950850] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:27:01.972581] [DEBUG] [LOCAL ] CMI: Loaded 18264 existing records from primary storage. [2025-09-14T17:27:01.972780] [INFO ] [MAIN ] CMI: Loaded 18264 existing records. [2025-09-14T17:27:02.158627] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:27:02.158862] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-09-14T17:27:02.159437] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-09-14T17:27:02.160608] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-09-14T17:27:02.161364] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-09-14T17:27:02.161434] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-09-14T17:27:02.355603] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:27:02.440520] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-03 [2025-09-14T17:27:02.550531] [INFO ] [REMOTE ] CMI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:27:02.958895] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-09-14T17:27:03.758928] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-09-14T17:27:04.558885] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-04. [2025-09-14T17:27:04.838560] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:27:04.839047] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-04 [2025-09-14T17:27:05.311331] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-14T17:27:05.370475] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-09-14T17:27:05.373370] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T17:27:06.156268] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (4.00 seconds). [2025-09-14T17:27:06.167149] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-05. [2025-09-14T17:27:06.958823] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-09-14T17:27:07.015201] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-14T17:27:07.066982] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T17:27:07.758934] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-09-14T17:27:08.373540] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T17:27:08.379304] [INFO ] [REMOTE ] CMC: Full fetch complete (49847 records). [2025-09-14T17:27:08.379508] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-09-14T17:27:08.561793] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-06. [2025-09-14T17:27:08.930829] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-09-14T17:27:08.931221] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-09-14T17:27:08.932713] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-09-14T17:27:08.932956] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-09-14T17:27:08.935221] [DEBUG] [LOCAL ] CMC: Trimmed 49847 records to 33573 (keeping 150 days of data) [2025-09-14T17:27:09.118376] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-14T17:27:09.313884] [DEBUG] [LOCAL ] CMC: Primary data saved (33573 records). [2025-09-14T17:27:09.314147] [INFO ] [MAIN ] CMC: Full history saved. [2025-09-14T17:27:09.314309] [INFO ] [MAIN ] Update Progress: 476/2370 symbols completed. CMC took 29.9s. Estimated remaining: 3h 18m 48s. Rate: 9.5 symbols/min [2025-09-14T17:27:09.366141] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-09-14T17:27:09.532969] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:27:09.548105] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T17:27:09.566212] [DEBUG] [LOCAL ] CMP: Loaded 15689 existing records from primary storage. [2025-09-14T17:27:09.566415] [INFO ] [MAIN ] CMP: Loaded 15689 existing records. [2025-09-14T17:27:09.755568] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:27:09.755873] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-09-14T17:27:09.755941] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-14T17:27:09.756501] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-09-14T17:27:09.756571] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-09-14T17:27:10.127626] [INFO ] [REMOTE ] CMP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:27:10.158808] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-09-14T17:27:10.958908] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-07. [2025-09-14T17:27:11.078764] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-14T17:27:11.674045] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T17:27:11.760350] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-09-14T17:27:11.761305] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-14T17:27:12.558844] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-08. [2025-09-14T17:27:13.358842] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-09-14T17:27:13.391296] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-14T17:27:13.633612] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T17:27:14.158845] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-09-14T17:27:14.958824] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-09. [2025-09-14T17:27:14.984808] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T17:27:15.758833] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-09-14T17:27:16.091386] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-14T17:27:16.093448] [INFO ] [REMOTE ] CMDB: Full fetch complete (10179 records). [2025-09-14T17:27:16.093534] [DEBUG] [VALIDATOR ] CMDB: Validating primary data. [2025-09-14T17:27:16.271557] [WARN ] [VALIDATOR ] CMDB: Validation failed - insufficient historical data. Have 89 unique days, need 150 days [2025-09-14T17:27:16.271833] [FATAL] [MAIN ] CMDB: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:27:16.271885] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:27:16.271933] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-14T17:27:16.272002] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-14T17:27:16.272058] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-09-14T17:27:16.272125] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-09-14T17:27:16.272203] [INFO ] [MAIN ] Update Progress: 477/2370 symbols completed. CMDB took 21.8s. Estimated remaining: 3h 18m 44s. Rate: 9.5 symbols/min [2025-09-14T17:27:16.558916] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-09-14T17:27:16.696934] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-14T17:27:17.075835] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-14T17:27:17.358853] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-09-14T17:27:18.158857] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-09-14T17:27:18.450783] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-14T17:27:18.958863] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-09-14T17:27:19.115233] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-14T17:27:19.366076] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-14T17:27:19.758851] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-09-14T17:27:20.558837] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-09-14T17:27:21.009428] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-14T17:27:21.166510] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-14T17:27:21.358832] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-09-14T17:27:21.664708] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T17:27:22.158837] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-09-14T17:27:22.958843] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-09-14T17:27:23.475532] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-14T17:27:23.758886] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-09-14T17:27:23.839975] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T17:27:24.075534] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-14T17:27:24.082262] [INFO ] [REMOTE ] CMG: Full fetch complete (58398 records). [2025-09-14T17:27:24.082540] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-09-14T17:27:24.324882] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-14T17:27:24.566268] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-09-14T17:27:24.569627] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-09-14T17:27:24.570829] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-09-14T17:27:24.571769] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-09-14T17:27:24.571995] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-09-14T17:27:24.573615] [DEBUG] [LOCAL ] CMG: Trimmed 58398 records to 40465 (keeping 150 days of data) [2025-09-14T17:27:24.817011] [DEBUG] [LOCAL ] CMG: Primary data saved (40465 records). [2025-09-14T17:27:24.817176] [INFO ] [MAIN ] CMG: Full history saved. [2025-09-14T17:27:24.817270] [INFO ] [MAIN ] Update Progress: 478/2370 symbols completed. CMG took 29.8s. Estimated remaining: 3h 18m 46s. Rate: 9.5 symbols/min [2025-09-14T17:27:25.358841] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-09-14T17:27:25.829581] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T17:27:26.158888] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-09-14T17:27:26.679363] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T17:27:26.682955] [INFO ] [REMOTE ] CMP: Full fetch complete (40468 records). [2025-09-14T17:27:26.683105] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-09-14T17:27:27.079777] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-09-14T17:27:27.079984] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-09-14T17:27:27.080683] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-09-14T17:27:27.080860] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-09-14T17:27:27.106836] [DEBUG] [LOCAL ] CMP: Trimmed 40468 records to 28011 (keeping 150 days of data) [2025-09-14T17:27:27.108782] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T17:27:27.178002] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-09-14T17:27:27.286163] [DEBUG] [LOCAL ] CMP: Primary data saved (28011 records). [2025-09-14T17:27:27.286358] [INFO ] [MAIN ] CMP: Full history saved. [2025-09-14T17:27:27.286514] [INFO ] [MAIN ] Update Progress: 479/2370 symbols completed. CMP took 18.0s. Estimated remaining: 3h 18m 25s. Rate: 9.5 symbols/min [2025-09-14T17:27:27.829155] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T17:27:27.833606] [INFO ] [REMOTE ] CMI: Full fetch complete (45420 records). [2025-09-14T17:27:27.833773] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-09-14T17:27:28.212070] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-09-14T17:27:28.212253] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-09-14T17:27:28.212861] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-09-14T17:27:28.212919] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-09-14T17:27:28.213902] [DEBUG] [LOCAL ] CMI: Trimmed 45420 records to 30752 (keeping 150 days of data) [2025-09-14T17:27:28.412576] [DEBUG] [LOCAL ] CMI: Primary data saved (30752 records). [2025-09-14T17:27:28.412761] [INFO ] [MAIN ] CMI: Full history saved. [2025-09-14T17:27:28.412863] [INFO ] [MAIN ] Update Progress: 480/2370 symbols completed. CMI took 26.6s. Estimated remaining: 3h 17m 58s. Rate: 9.5 symbols/min [2025-09-14T17:27:29.003470] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:27:29.072073] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:27:29.123674] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:27:29.144468] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:27:29.151300] [DEBUG] [LOCAL ] CMSC: Loaded 2148 existing records from primary storage. [2025-09-14T17:27:29.153296] [DEBUG] [LOCAL ] CMSA: Loaded 1368 existing records from primary storage. [2025-09-14T17:27:29.153614] [INFO ] [MAIN ] CMSC: Loaded 2148 existing records. [2025-09-14T17:27:29.166165] [INFO ] [MAIN ] CMSA: Loaded 1368 existing records. [2025-09-14T17:27:29.394441] [DEBUG] [LOCAL ] CMS: Loaded 23540 existing records from primary storage. [2025-09-14T17:27:29.393879] [DEBUG] [LOCAL ] CMRE: Loaded 15761 existing records from primary storage. [2025-09-14T17:27:29.410107] [INFO ] [MAIN ] CMS: Loaded 23540 existing records. [2025-09-14T17:27:29.429801] [INFO ] [MAIN ] CMRE: Loaded 15761 existing records. [2025-09-14T17:27:29.519074] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:27:29.666577] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-09-14T17:27:29.704155] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:27:29.729086] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-09-14T17:27:29.745516] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-09-14T17:27:29.755945] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-09-14T17:27:29.761630] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-09-14T17:27:29.777255] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-09-14T17:27:29.777430] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-09-14T17:27:29.772069] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-09-14T17:27:30.004034] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:27:30.056171] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:27:30.139814] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-09-14T17:27:30.149902] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-09-14T17:27:30.149995] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-09-14T17:27:30.186891] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-09-14T17:27:30.236116] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-14T17:27:30.271790] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-09-14T17:27:30.379568] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-09-14T17:27:30.496271] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-09-14T17:27:31.029526] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:27:31.025715] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:27:31.095041] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-09-14T17:27:31.105064] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-09-14T17:27:31.471053] [INFO ] [REMOTE ] CMS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:27:31.475050] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:27:31.476180] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-09-14T17:27:31.476537] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-09-14T17:27:31.801103] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-14T17:27:31.802719] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-09-14T17:27:31.808172] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-14T17:27:31.810010] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-09-14T17:27:32.327033] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-14T17:27:32.407379] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-14T17:27:32.555613] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-14T17:27:32.562708] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-09-14T17:27:33.123516] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-14T17:27:33.284243] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-14T17:27:33.358831] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-09-14T17:27:33.763305] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-14T17:27:34.158935] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-09-14T17:27:34.780554] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-14T17:27:34.958845] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-09-14T17:27:35.758820] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-09-14T17:27:36.558863] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-09-14T17:27:36.815982] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T17:27:37.172968] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-14T17:27:37.265832] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T17:27:37.358787] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-09-14T17:27:38.158874] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-09-14T17:27:38.667758] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-14T17:27:38.935754] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T17:27:38.958809] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-09-14T17:27:39.536419] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-14T17:27:39.758869] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-09-14T17:27:40.334002] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-14T17:27:40.558831] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-09-14T17:27:41.165155] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-14T17:27:41.358840] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-09-14T17:27:42.051665] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-14T17:27:42.158852] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-09-14T17:27:42.646413] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-14T17:27:42.958887] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-09-14T17:27:43.758869] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-09-14T17:27:44.444846] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-14T17:27:44.558889] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-09-14T17:27:44.909314] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-14T17:27:44.910257] [INFO ] [REMOTE ] CMSA: Full fetch complete (3530 records). [2025-09-14T17:27:44.910344] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-09-14T17:27:45.287403] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-09-14T17:27:45.287678] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-09-14T17:27:45.287908] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-09-14T17:27:45.288118] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-09-14T17:27:45.288703] [DEBUG] [LOCAL ] CMSA: Trimmed 3530 records to 2560 (keeping 150 days of data) [2025-09-14T17:27:45.307407] [DEBUG] [LOCAL ] CMSA: Primary data saved (2560 records). [2025-09-14T17:27:45.307710] [INFO ] [MAIN ] CMSA: Full history saved. [2025-09-14T17:27:45.308003] [INFO ] [MAIN ] Update Progress: 481/2370 symbols completed. CMSA took 16.9s. Estimated remaining: 3h 18m 34s. Rate: 9.5 symbols/min [2025-09-14T17:27:45.378491] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-09-14T17:27:45.444880] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T17:27:45.542712] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:27:45.548328] [DEBUG] [LOCAL ] CMSD: Loaded 3309 existing records from primary storage. [2025-09-14T17:27:45.548452] [INFO ] [MAIN ] CMSD: Loaded 3309 existing records. [2025-09-14T17:27:45.728992] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:27:45.729273] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-09-14T17:27:45.729337] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-09-14T17:27:45.729711] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-09-14T17:27:45.729777] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-09-14T17:27:46.083315] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:27:46.158797] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-09-14T17:27:46.818632] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-14T17:27:46.932723] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T17:27:46.958854] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-09-14T17:27:47.758897] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-09-14T17:27:48.471739] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T17:27:48.558828] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-09-14T17:27:48.632513] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T17:27:49.027750] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T17:27:49.028811] [INFO ] [REMOTE ] CMSC: Full fetch complete (5332 records). [2025-09-14T17:27:49.028897] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-09-14T17:27:49.365987] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-09-14T17:27:49.389680] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-09-14T17:27:49.389809] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-09-14T17:27:49.390073] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-09-14T17:27:49.390139] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-09-14T17:27:49.390567] [DEBUG] [LOCAL ] CMSC: Trimmed 5332 records to 3570 (keeping 150 days of data) [2025-09-14T17:27:49.412412] [DEBUG] [LOCAL ] CMSC: Primary data saved (3570 records). [2025-09-14T17:27:49.412516] [INFO ] [MAIN ] CMSC: Full history saved. [2025-09-14T17:27:49.412659] [INFO ] [MAIN ] Update Progress: 482/2370 symbols completed. CMSC took 21.0s. Estimated remaining: 3h 18m 19s. Rate: 9.5 symbols/min [2025-09-14T17:27:49.580312] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:27:49.595553] [DEBUG] [LOCAL ] CMTG: Loaded 15108 existing records from primary storage. [2025-09-14T17:27:49.595738] [INFO ] [MAIN ] CMTG: Loaded 15108 existing records. [2025-09-14T17:27:49.770267] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:27:49.770534] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-09-14T17:27:49.770596] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-09-14T17:27:49.771088] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-09-14T17:27:49.771150] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-09-14T17:27:50.120335] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:27:50.158803] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-09-14T17:27:50.523374] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T17:27:50.958842] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-09-14T17:27:51.622262] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T17:27:51.763032] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-09-14T17:27:51.765574] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-14T17:27:52.558847] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-09-14T17:27:53.358845] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-09-14T17:27:53.588518] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-14T17:27:53.651376] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T17:27:54.124746] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-14T17:27:54.158797] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-09-14T17:27:54.958804] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-09-14T17:27:55.339489] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-14T17:27:55.343949] [INFO ] [REMOTE ] CMRE: Full fetch complete (38999 records). [2025-09-14T17:27:55.344126] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-09-14T17:27:55.486094] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-14T17:27:55.748929] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-09-14T17:27:55.749033] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-09-14T17:27:55.749589] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-09-14T17:27:55.749659] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-09-14T17:27:55.750544] [DEBUG] [LOCAL ] CMRE: Trimmed 38999 records to 26592 (keeping 150 days of data) [2025-09-14T17:27:55.804117] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-09-14T17:27:55.916578] [DEBUG] [LOCAL ] CMRE: Primary data saved (26592 records). [2025-09-14T17:27:55.916796] [INFO ] [MAIN ] CMRE: Full history saved. [2025-09-14T17:27:55.916929] [INFO ] [MAIN ] Update Progress: 483/2370 symbols completed. CMRE took 27.5s. Estimated remaining: 3h 18m 13s. Rate: 9.5 symbols/min [2025-09-14T17:27:56.090058] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:27:56.095137] [DEBUG] [LOCAL ] CMU: Loaded 3151 existing records from primary storage. [2025-09-14T17:27:56.095275] [INFO ] [MAIN ] CMU: Loaded 3151 existing records. [2025-09-14T17:27:56.282577] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:27:56.282895] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-09-14T17:27:56.282973] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-09-14T17:27:56.283237] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-09-14T17:27:56.283296] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-09-14T17:27:56.565399] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-09-14T17:27:56.660447] [INFO ] [REMOTE ] CMU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:27:56.667396] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-14T17:27:57.358839] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-09-14T17:27:58.017700] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-14T17:27:58.158851] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-09-14T17:27:58.534228] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-14T17:27:58.958852] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-09-14T17:27:59.424104] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T17:27:59.758946] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-09-14T17:27:59.785044] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-14T17:28:00.558839] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-09-14T17:28:01.373439] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-09-14T17:28:01.386674] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T17:28:02.017102] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-14T17:28:02.158881] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-09-14T17:28:02.385472] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T17:28:02.625723] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-14T17:28:02.958837] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-09-14T17:28:03.589220] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-14T17:28:03.758868] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-09-14T17:28:04.558858] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-09-14T17:28:04.902077] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T17:28:05.192711] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T17:28:05.198168] [INFO ] [REMOTE ] CMS: Full fetch complete (57303 records). [2025-09-14T17:28:05.198291] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-09-14T17:28:05.364713] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-09-14T17:28:05.596512] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-09-14T17:28:05.596719] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-09-14T17:28:05.597625] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-09-14T17:28:05.597726] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-09-14T17:28:05.599148] [DEBUG] [LOCAL ] CMS: Trimmed 57303 records to 39684 (keeping 150 days of data) [2025-09-14T17:28:05.855798] [DEBUG] [LOCAL ] CMS: Primary data saved (39684 records). [2025-09-14T17:28:05.856040] [INFO ] [MAIN ] CMS: Full history saved. [2025-09-14T17:28:05.856168] [INFO ] [MAIN ] Update Progress: 484/2370 symbols completed. CMS took 37.4s. Estimated remaining: 3h 18m 21s. Rate: 9.5 symbols/min [2025-09-14T17:28:06.029378] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:28:06.046019] [DEBUG] [LOCAL ] CNA: Loaded 16480 existing records from primary storage. [2025-09-14T17:28:06.046202] [INFO ] [MAIN ] CNA: Loaded 16480 existing records. [2025-09-14T17:28:06.163684] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-09-14T17:28:06.170313] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-14T17:28:06.238543] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:28:06.238870] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-09-14T17:28:06.238959] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-09-14T17:28:06.239616] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-09-14T17:28:06.239718] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-09-14T17:28:06.593907] [INFO ] [REMOTE ] CNA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:28:06.958842] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-09-14T17:28:07.424278] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T17:28:07.426350] [INFO ] [REMOTE ] CMSD: Full fetch complete (8706 records). [2025-09-14T17:28:07.426507] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-09-14T17:28:07.758954] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-09-14T17:28:07.815159] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-09-14T17:28:07.815382] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-09-14T17:28:07.815768] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-09-14T17:28:07.815956] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-09-14T17:28:07.824586] [DEBUG] [LOCAL ] CMSD: Trimmed 8706 records to 5819 (keeping 150 days of data) [2025-09-14T17:28:07.840944] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-14T17:28:07.887244] [DEBUG] [LOCAL ] CMSD: Primary data saved (5819 records). [2025-09-14T17:28:07.887402] [INFO ] [MAIN ] CMSD: Full history saved. [2025-09-14T17:28:07.887521] [INFO ] [MAIN ] Update Progress: 485/2370 symbols completed. CMSD took 22.6s. Estimated remaining: 3h 17m 58s. Rate: 9.5 symbols/min [2025-09-14T17:28:08.054739] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:28:08.078533] [DEBUG] [LOCAL ] CNC: Loaded 24221 existing records from primary storage. [2025-09-14T17:28:08.078726] [INFO ] [MAIN ] CNC: Loaded 24221 existing records. [2025-09-14T17:28:08.251859] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:28:08.252131] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-09-14T17:28:08.252192] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-14T17:28:08.252901] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-09-14T17:28:08.252968] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-09-14T17:28:08.563997] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-09-14T17:28:08.625952] [INFO ] [REMOTE ] CNC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:28:08.787974] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-14T17:28:09.358849] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-09-14T17:28:09.467728] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-14T17:28:10.158849] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-09-14T17:28:10.749362] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-14T17:28:10.958860] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-09-14T17:28:11.746096] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T17:28:11.758788] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-09-14T17:28:12.336406] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-14T17:28:12.383611] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-14T17:28:12.558822] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-09-14T17:28:13.358848] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-09-14T17:28:13.609754] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-14T17:28:14.158852] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-09-14T17:28:14.726393] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T17:28:14.727953] [INFO ] [REMOTE ] CMU: Full fetch complete (7611 records). [2025-09-14T17:28:14.728244] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-09-14T17:28:14.964064] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-09-14T17:28:15.154033] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-14T17:28:15.154312] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-09-14T17:28:15.154540] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-09-14T17:28:15.161880] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-09-14T17:28:15.162084] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-09-14T17:28:15.162986] [DEBUG] [LOCAL ] CMU: Trimmed 7611 records to 4747 (keeping 150 days of data) [2025-09-14T17:28:15.191713] [DEBUG] [LOCAL ] CMU: Primary data saved (4747 records). [2025-09-14T17:28:15.191810] [INFO ] [MAIN ] CMU: Full history saved. [2025-09-14T17:28:15.191908] [INFO ] [MAIN ] Update Progress: 486/2370 symbols completed. CMU took 19.3s. Estimated remaining: 3h 17m 56s. Rate: 9.5 symbols/min [2025-09-14T17:28:15.368632] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:28:15.375991] [DEBUG] [LOCAL ] CNF: Loaded 5867 existing records from primary storage. [2025-09-14T17:28:15.376119] [INFO ] [MAIN ] CNF: Loaded 5867 existing records. [2025-09-14T17:28:15.556534] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:28:15.556853] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-09-14T17:28:15.556915] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-09-14T17:28:15.557240] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-09-14T17:28:15.557298] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-09-14T17:28:15.764027] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-09-14T17:28:15.912003] [INFO ] [REMOTE ] CNF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:28:16.429322] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T17:28:16.558833] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-09-14T17:28:16.848778] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-14T17:28:16.854080] [INFO ] [REMOTE ] CMTG: Full fetch complete (41540 records). [2025-09-14T17:28:16.854255] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-09-14T17:28:16.974215] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-14T17:28:17.256499] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-09-14T17:28:17.256599] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-09-14T17:28:17.257270] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-09-14T17:28:17.257325] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-09-14T17:28:17.258301] [DEBUG] [LOCAL ] CMTG: Trimmed 41540 records to 27084 (keeping 150 days of data) [2025-09-14T17:28:17.361262] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-09-14T17:28:17.415388] [DEBUG] [LOCAL ] CMTG: Primary data saved (27084 records). [2025-09-14T17:28:17.415610] [INFO ] [MAIN ] CMTG: Full history saved. [2025-09-14T17:28:17.415750] [INFO ] [MAIN ] Update Progress: 487/2370 symbols completed. CMTG took 28.0s. Estimated remaining: 3h 17m 34s. Rate: 9.5 symbols/min [2025-09-14T17:28:17.581787] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:28:17.610047] [DEBUG] [LOCAL ] CNH: Loaded 23957 existing records from primary storage. [2025-09-14T17:28:17.610255] [INFO ] [MAIN ] CNH: Loaded 23957 existing records. [2025-09-14T17:28:17.783707] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:28:17.783972] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-09-14T17:28:17.784032] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-09-14T17:28:17.784700] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-09-14T17:28:17.784767] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-09-14T17:28:18.119296] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-14T17:28:18.141050] [INFO ] [REMOTE ] CNH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:28:18.158788] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-09-14T17:28:18.958894] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-09-14T17:28:19.532773] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-14T17:28:19.758847] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-09-14T17:28:20.184027] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-14T17:28:20.234951] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-14T17:28:20.558857] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-09-14T17:28:21.358872] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-09-14T17:28:21.394980] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-14T17:28:22.158869] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-09-14T17:28:22.958858] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-09-14T17:28:23.157890] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T17:28:23.758852] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-09-14T17:28:24.102604] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-14T17:28:24.139459] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-14T17:28:24.558840] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-09-14T17:28:24.725700] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T17:28:25.358824] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-09-14T17:28:26.158827] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-09-14T17:28:26.293828] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T17:28:26.958815] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-09-14T17:28:26.980885] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-14T17:28:27.343080] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-14T17:28:27.758816] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-09-14T17:28:28.558848] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-09-14T17:28:28.736192] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-14T17:28:28.799909] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T17:28:29.358892] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-09-14T17:28:30.158881] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-09-14T17:28:30.495044] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-14T17:28:30.913081] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T17:28:30.916108] [INFO ] [REMOTE ] CNF: Full fetch complete (10819 records). [2025-09-14T17:28:30.916201] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-09-14T17:28:30.969738] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-09-14T17:28:31.277110] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-09-14T17:28:31.277364] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-09-14T17:28:31.277728] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-09-14T17:28:31.294129] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-09-14T17:28:31.306264] [DEBUG] [LOCAL ] CNF: Trimmed 10819 records to 8737 (keeping 150 days of data) [2025-09-14T17:28:31.307692] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-14T17:28:31.369402] [DEBUG] [LOCAL ] CNF: Primary data saved (8737 records). [2025-09-14T17:28:31.369597] [INFO ] [MAIN ] CNF: Full history saved. [2025-09-14T17:28:31.369729] [INFO ] [MAIN ] Update Progress: 488/2370 symbols completed. CNF took 16.2s. Estimated remaining: 3h 17m 57s. Rate: 9.5 symbols/min [2025-09-14T17:28:31.548927] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:28:31.572636] [DEBUG] [LOCAL ] CNI: Loaded 23250 existing records from primary storage. [2025-09-14T17:28:31.572828] [INFO ] [MAIN ] CNI: Loaded 23250 existing records. [2025-09-14T17:28:31.748806] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:28:31.749057] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-09-14T17:28:31.749157] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-09-14T17:28:31.750104] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-09-14T17:28:31.750181] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-09-14T17:28:31.764043] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-09-14T17:28:32.104683] [INFO ] [REMOTE ] CNI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:28:32.558888] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-09-14T17:28:33.358843] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-09-14T17:28:33.805456] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-14T17:28:33.852525] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-09-14T17:28:33.896319] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T17:28:34.158819] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-09-14T17:28:34.958852] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-09-14T17:28:35.053733] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T17:28:35.758875] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-09-14T17:28:36.262599] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-14T17:28:36.400583] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T17:28:36.558841] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-09-14T17:28:36.844493] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-14T17:28:36.850254] [INFO ] [REMOTE ] CNC: Full fetch complete (58391 records). [2025-09-14T17:28:36.850446] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-09-14T17:28:37.229891] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-09-14T17:28:37.230004] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-09-14T17:28:37.230745] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-09-14T17:28:37.230802] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-09-14T17:28:37.232476] [DEBUG] [LOCAL ] CNC: Trimmed 58391 records to 40524 (keeping 150 days of data) [2025-09-14T17:28:37.407885] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-09-14T17:28:37.480694] [DEBUG] [LOCAL ] CNC: Primary data saved (40524 records). [2025-09-14T17:28:37.480857] [INFO ] [MAIN ] CNC: Full history saved. [2025-09-14T17:28:37.480986] [INFO ] [MAIN ] Update Progress: 489/2370 symbols completed. CNC took 29.6s. Estimated remaining: 3h 17m 50s. Rate: 9.5 symbols/min [2025-09-14T17:28:37.669455] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:28:37.702013] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-14T17:28:37.732495] [DEBUG] [LOCAL ] CNK: Loaded 23871 existing records from primary storage. [2025-09-14T17:28:37.732707] [INFO ] [MAIN ] CNK: Loaded 23871 existing records. [2025-09-14T17:28:37.925210] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:28:37.925707] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-09-14T17:28:37.925779] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-09-14T17:28:37.926555] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-09-14T17:28:37.926621] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-09-14T17:28:38.164034] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-09-14T17:28:38.306187] [INFO ] [REMOTE ] CNK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:28:38.380910] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-14T17:28:38.384279] [INFO ] [REMOTE ] CNA: Full fetch complete (35929 records). [2025-09-14T17:28:38.384405] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-09-14T17:28:38.752469] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-09-14T17:28:38.752578] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-09-14T17:28:38.753166] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-09-14T17:28:38.753223] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-09-14T17:28:38.754105] [DEBUG] [LOCAL ] CNA: Trimmed 35929 records to 24776 (keeping 150 days of data) [2025-09-14T17:28:38.914220] [DEBUG] [LOCAL ] CNA: Primary data saved (24776 records). [2025-09-14T17:28:38.914391] [INFO ] [MAIN ] CNA: Full history saved. [2025-09-14T17:28:38.914510] [INFO ] [MAIN ] Update Progress: 490/2370 symbols completed. CNA took 33.1s. Estimated remaining: 3h 17m 25s. Rate: 9.5 symbols/min [2025-09-14T17:28:38.969205] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-09-14T17:28:39.089516] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:28:39.112260] [DEBUG] [LOCAL ] CNM: Loaded 22599 existing records from primary storage. [2025-09-14T17:28:39.112449] [INFO ] [MAIN ] CNM: Loaded 22599 existing records. [2025-09-14T17:28:39.290230] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:28:39.290521] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-09-14T17:28:39.290607] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-09-14T17:28:39.291273] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-09-14T17:28:39.291335] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-09-14T17:28:39.654072] [INFO ] [REMOTE ] CNM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:28:39.688594] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T17:28:39.695168] [INFO ] [REMOTE ] CNH: Full fetch complete (58242 records). [2025-09-14T17:28:39.695344] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-09-14T17:28:39.764031] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-09-14T17:28:40.087751] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-09-14T17:28:40.087996] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-09-14T17:28:40.088912] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-09-14T17:28:40.088986] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-09-14T17:28:40.090475] [DEBUG] [LOCAL ] CNH: Trimmed 58242 records to 40307 (keeping 150 days of data) [2025-09-14T17:28:40.214126] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-14T17:28:40.389354] [DEBUG] [LOCAL ] CNH: Primary data saved (40307 records). [2025-09-14T17:28:40.389543] [INFO ] [MAIN ] CNH: Full history saved. [2025-09-14T17:28:40.389757] [INFO ] [MAIN ] Update Progress: 491/2370 symbols completed. CNH took 23.0s. Estimated remaining: 3h 17m 0s. Rate: 9.5 symbols/min [2025-09-14T17:28:40.559685] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:28:40.559769] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-09-14T17:28:40.577125] [DEBUG] [LOCAL ] CNMD: Loaded 14538 existing records from primary storage. [2025-09-14T17:28:40.577368] [INFO ] [MAIN ] CNMD: Loaded 14538 existing records. [2025-09-14T17:28:40.750003] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:28:40.750274] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-09-14T17:28:40.750355] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-09-14T17:28:40.750802] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-09-14T17:28:40.750861] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-09-14T17:28:41.096599] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:28:41.215334] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T17:28:41.358810] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-09-14T17:28:42.161412] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-09-14T17:28:42.166990] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T17:28:42.796881] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T17:28:42.958840] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-09-14T17:28:43.598817] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-14T17:28:43.758815] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-09-14T17:28:44.223961] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T17:28:44.558846] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-09-14T17:28:45.358831] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-09-14T17:28:45.409204] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-14T17:28:46.158836] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-09-14T17:28:46.282836] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T17:28:46.965399] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-09-14T17:28:46.982520] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-14T17:28:47.693853] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-14T17:28:47.758781] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-09-14T17:28:48.558829] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-09-14T17:28:48.865369] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T17:28:49.358889] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-09-14T17:28:49.771157] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-14T17:28:50.158828] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-09-14T17:28:50.371096] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T17:28:50.476557] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T17:28:50.958834] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-09-14T17:28:51.758855] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-09-14T17:28:51.855909] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-14T17:28:52.504475] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T17:28:52.558820] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-09-14T17:28:52.685206] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T17:28:53.358862] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-09-14T17:28:54.158900] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-09-14T17:28:54.357736] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T17:28:54.868093] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-14T17:28:54.958788] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-09-14T17:28:55.670550] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-14T17:28:55.758848] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-09-14T17:28:56.509052] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-14T17:28:56.514584] [INFO ] [REMOTE ] CNI: Full fetch complete (56120 records). [2025-09-14T17:28:56.514730] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-09-14T17:28:56.570763] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-09-14T17:28:56.900024] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-09-14T17:28:56.900175] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-09-14T17:28:56.900925] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-09-14T17:28:56.900990] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-09-14T17:28:56.902734] [DEBUG] [LOCAL ] CNI: Trimmed 56120 records to 38895 (keeping 150 days of data) [2025-09-14T17:28:57.186544] [DEBUG] [LOCAL ] CNI: Primary data saved (38895 records). [2025-09-14T17:28:57.186892] [INFO ] [MAIN ] CNI: Full history saved. [2025-09-14T17:28:57.187267] [INFO ] [MAIN ] Update Progress: 492/2370 symbols completed. CNI took 25.8s. Estimated remaining: 3h 17m 34s. Rate: 9.5 symbols/min [2025-09-14T17:28:57.367982] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-09-14T17:28:57.383274] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:28:57.407487] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-14T17:28:57.439973] [DEBUG] [LOCAL ] CNNE: Loaded 17059 existing records from primary storage. [2025-09-14T17:28:57.440215] [INFO ] [MAIN ] CNNE: Loaded 17059 existing records. [2025-09-14T17:28:57.628176] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:28:57.628526] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-09-14T17:28:57.628594] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-09-14T17:28:57.629174] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-09-14T17:28:57.629255] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-09-14T17:28:57.987484] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-14T17:28:58.006778] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:28:58.158785] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-09-14T17:28:58.554713] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-14T17:28:58.558095] [INFO ] [REMOTE ] CNMD: Full fetch complete (35930 records). [2025-09-14T17:28:58.558206] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-09-14T17:28:58.924721] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-09-14T17:28:58.924856] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-09-14T17:28:58.925523] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-09-14T17:28:58.925621] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-09-14T17:28:58.926824] [DEBUG] [LOCAL ] CNMD: Trimmed 35930 records to 23985 (keeping 150 days of data) [2025-09-14T17:28:58.980687] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-09-14T17:28:59.107947] [DEBUG] [LOCAL ] CNMD: Primary data saved (23985 records). [2025-09-14T17:28:59.109554] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T17:28:59.109747] [INFO ] [MAIN ] CNMD: Full history saved. [2025-09-14T17:28:59.120636] [INFO ] [MAIN ] Update Progress: 493/2370 symbols completed. CNMD took 18.7s. Estimated remaining: 3h 17m 11s. Rate: 9.5 symbols/min [2025-09-14T17:28:59.291033] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:28:59.310138] [DEBUG] [LOCAL ] CNO: Loaded 18423 existing records from primary storage. [2025-09-14T17:28:59.310327] [INFO ] [MAIN ] CNO: Loaded 18423 existing records. [2025-09-14T17:28:59.505375] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:28:59.513296] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-09-14T17:28:59.513411] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-09-14T17:28:59.514015] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-09-14T17:28:59.514081] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-09-14T17:28:59.763889] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-09-14T17:28:59.867293] [INFO ] [REMOTE ] CNO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:29:00.293267] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-14T17:29:00.558845] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-09-14T17:29:01.358862] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-09-14T17:29:01.707261] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-14T17:29:02.158804] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-09-14T17:29:02.224704] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T17:29:02.493499] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T17:29:02.499242] [INFO ] [REMOTE ] CNM: Full fetch complete (55063 records). [2025-09-14T17:29:02.499395] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-09-14T17:29:02.963956] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-09-14T17:29:02.967193] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-09-14T17:29:02.969012] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-09-14T17:29:02.970111] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-09-14T17:29:02.970316] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-09-14T17:29:02.972038] [DEBUG] [LOCAL ] CNM: Trimmed 55063 records to 38006 (keeping 150 days of data) [2025-09-14T17:29:03.092127] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T17:29:03.246786] [DEBUG] [LOCAL ] CNM: Primary data saved (38006 records). [2025-09-14T17:29:03.246994] [INFO ] [MAIN ] CNM: Full history saved. [2025-09-14T17:29:03.247111] [INFO ] [MAIN ] Update Progress: 494/2370 symbols completed. CNM took 24.3s. Estimated remaining: 3h 16m 56s. Rate: 9.5 symbols/min [2025-09-14T17:29:03.420155] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:29:03.443417] [DEBUG] [LOCAL ] CNP: Loaded 23931 existing records from primary storage. [2025-09-14T17:29:03.443606] [INFO ] [MAIN ] CNP: Loaded 23931 existing records. [2025-09-14T17:29:03.618197] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:29:03.618492] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-09-14T17:29:03.618552] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-09-14T17:29:03.619353] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-09-14T17:29:03.619418] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-09-14T17:29:03.760829] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-09-14T17:29:03.967453] [INFO ] [REMOTE ] CNP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:29:04.539291] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-14T17:29:04.558788] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-09-14T17:29:05.019351] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-14T17:29:05.358859] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-09-14T17:29:06.036314] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T17:29:06.158846] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-09-14T17:29:06.909353] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T17:29:06.958856] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-09-14T17:29:07.760451] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-09-14T17:29:07.767144] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T17:29:08.534584] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T17:29:08.558793] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-09-14T17:29:09.018262] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-14T17:29:09.358828] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-09-14T17:29:09.874517] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-14T17:29:10.158826] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-09-14T17:29:10.751581] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T17:29:10.958819] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-09-14T17:29:11.643169] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T17:29:11.758855] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-09-14T17:29:12.327803] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-14T17:29:12.558836] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-09-14T17:29:12.913249] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T17:29:13.358898] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-09-14T17:29:14.158865] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-09-14T17:29:14.236480] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T17:29:14.793413] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-14T17:29:14.817144] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T17:29:14.822593] [INFO ] [REMOTE ] CNK: Full fetch complete (57418 records). [2025-09-14T17:29:14.822777] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-09-14T17:29:14.965337] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-09-14T17:29:15.214158] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-09-14T17:29:15.214271] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-09-14T17:29:15.215007] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-09-14T17:29:15.215067] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-09-14T17:29:15.216257] [DEBUG] [LOCAL ] CNK: Trimmed 57418 records to 39750 (keeping 150 days of data) [2025-09-14T17:29:15.461503] [DEBUG] [LOCAL ] CNK: Primary data saved (39750 records). [2025-09-14T17:29:15.461694] [INFO ] [MAIN ] CNK: Full history saved. [2025-09-14T17:29:15.461805] [INFO ] [MAIN ] Update Progress: 495/2370 symbols completed. CNK took 38.0s. Estimated remaining: 3h 17m 12s. Rate: 9.5 symbols/min [2025-09-14T17:29:15.630987] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:29:15.653955] [DEBUG] [LOCAL ] CNQ: Loaded 23980 existing records from primary storage. [2025-09-14T17:29:15.654168] [INFO ] [MAIN ] CNQ: Loaded 23980 existing records. [2025-09-14T17:29:15.764005] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-09-14T17:29:15.833185] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:29:15.833434] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-09-14T17:29:15.833492] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-09-14T17:29:15.834189] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-09-14T17:29:15.834253] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-09-14T17:29:16.183809] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:29:16.325307] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T17:29:16.329847] [INFO ] [REMOTE ] CNO: Full fetch complete (45831 records). [2025-09-14T17:29:16.329969] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-09-14T17:29:16.564052] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-09-14T17:29:16.716731] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-09-14T17:29:16.716977] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-09-14T17:29:16.717792] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-09-14T17:29:16.717991] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-09-14T17:29:16.737516] [DEBUG] [LOCAL ] CNO: Trimmed 45831 records to 30210 (keeping 150 days of data) [2025-09-14T17:29:16.739027] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T17:29:16.934497] [DEBUG] [LOCAL ] CNO: Primary data saved (30210 records). [2025-09-14T17:29:16.934713] [INFO ] [MAIN ] CNO: Full history saved. [2025-09-14T17:29:16.934835] [INFO ] [MAIN ] Update Progress: 496/2370 symbols completed. CNO took 17.8s. Estimated remaining: 3h 16m 48s. Rate: 9.5 symbols/min [2025-09-14T17:29:17.104827] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:29:17.123960] [DEBUG] [LOCAL ] CNR: Loaded 19452 existing records from primary storage. [2025-09-14T17:29:17.124132] [INFO ] [MAIN ] CNR: Loaded 19452 existing records. [2025-09-14T17:29:17.306331] [WARN ] [MAIN ] CNR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:29:17.306603] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-09-14T17:29:17.306701] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-14T17:29:17.307254] [DEBUG] [LOCAL ] CNR: Deleted primary data file. [2025-09-14T17:29:17.307318] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-09-14T17:29:17.370127] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-09-14T17:29:17.668895] [INFO ] [REMOTE ] CNR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:29:18.158897] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-09-14T17:29:18.281587] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-14T17:29:18.958862] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-09-14T17:29:19.172369] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T17:29:19.444992] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-14T17:29:19.758838] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-09-14T17:29:20.558829] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-09-14T17:29:20.863531] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T17:29:21.358826] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-09-14T17:29:21.481548] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T17:29:21.940224] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-14T17:29:22.158840] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-09-14T17:29:22.958890] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-09-14T17:29:23.342372] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T17:29:23.569633] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-14T17:29:23.573830] [INFO ] [REMOTE ] CNNE: Full fetch complete (39702 records). [2025-09-14T17:29:23.573929] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-09-14T17:29:23.769182] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-09-14T17:29:23.949178] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-09-14T17:29:23.949399] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-09-14T17:29:23.950338] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-09-14T17:29:23.950416] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-09-14T17:29:23.952092] [DEBUG] [LOCAL ] CNNE: Trimmed 39702 records to 26922 (keeping 150 days of data) [2025-09-14T17:29:24.127743] [DEBUG] [LOCAL ] CNNE: Primary data saved (26922 records). [2025-09-14T17:29:24.127982] [INFO ] [MAIN ] CNNE: Full history saved. [2025-09-14T17:29:24.128121] [INFO ] [MAIN ] Update Progress: 497/2370 symbols completed. CNNE took 26.9s. Estimated remaining: 3h 16m 45s. Rate: 9.5 symbols/min [2025-09-14T17:29:24.305497] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:29:24.318917] [DEBUG] [LOCAL ] CNS: Loaded 9132 existing records from primary storage. [2025-09-14T17:29:24.319108] [INFO ] [MAIN ] CNS: Loaded 9132 existing records. [2025-09-14T17:29:24.501694] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:29:24.501999] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-09-14T17:29:24.502062] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-09-14T17:29:24.502474] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-09-14T17:29:24.502535] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-09-14T17:29:24.566517] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-09-14T17:29:24.884887] [INFO ] [REMOTE ] CNS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:29:24.929186] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-14T17:29:25.021752] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-14T17:29:25.358833] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-09-14T17:29:26.158910] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-09-14T17:29:26.541392] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-14T17:29:26.654405] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-14T17:29:26.958843] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-09-14T17:29:26.999026] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-14T17:29:27.758813] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-09-14T17:29:28.353813] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-14T17:29:28.558816] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-09-14T17:29:28.811304] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T17:29:29.358868] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-09-14T17:29:29.988213] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-14T17:29:30.158864] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-09-14T17:29:30.958838] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-09-14T17:29:31.149676] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T17:29:31.758825] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-09-14T17:29:31.897843] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-14T17:29:31.951798] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T17:29:32.558845] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-09-14T17:29:33.358867] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-09-14T17:29:33.496117] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T17:29:33.518696] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-14T17:29:34.158872] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-09-14T17:29:34.698419] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-14T17:29:34.814668] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T17:29:34.820311] [INFO ] [REMOTE ] CNP: Full fetch complete (58105 records). [2025-09-14T17:29:34.820439] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-09-14T17:29:34.964001] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-09-14T17:29:35.214940] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-09-14T17:29:35.215120] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-09-14T17:29:35.215938] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-09-14T17:29:35.216003] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-09-14T17:29:35.217275] [DEBUG] [LOCAL ] CNP: Trimmed 58105 records to 40238 (keeping 150 days of data) [2025-09-14T17:29:35.476754] [DEBUG] [LOCAL ] CNP: Primary data saved (40238 records). [2025-09-14T17:29:35.476919] [INFO ] [MAIN ] CNP: Full history saved. [2025-09-14T17:29:35.477044] [INFO ] [MAIN ] Update Progress: 498/2370 symbols completed. CNP took 32.2s. Estimated remaining: 3h 16m 58s. Rate: 9.5 symbols/min [2025-09-14T17:29:35.651914] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:29:35.674074] [DEBUG] [LOCAL ] CNX: Loaded 22844 existing records from primary storage. [2025-09-14T17:29:35.674237] [INFO ] [MAIN ] CNX: Loaded 22844 existing records. [2025-09-14T17:29:35.763955] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-09-14T17:29:35.858964] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:29:35.859237] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-09-14T17:29:35.859313] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-09-14T17:29:35.860119] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-09-14T17:29:35.860208] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-09-14T17:29:36.228680] [INFO ] [REMOTE ] CNX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:29:36.558801] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-09-14T17:29:36.606901] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T17:29:36.832204] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T17:29:37.358830] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-09-14T17:29:38.158807] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-09-14T17:29:38.242462] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T17:29:38.526246] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-14T17:29:38.531942] [INFO ] [REMOTE ] CNQ: Full fetch complete (58258 records). [2025-09-14T17:29:38.532090] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-09-14T17:29:38.935585] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-09-14T17:29:38.935717] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-09-14T17:29:38.936440] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-09-14T17:29:38.936497] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-09-14T17:29:38.937745] [DEBUG] [LOCAL ] CNQ: Trimmed 58258 records to 40333 (keeping 150 days of data) [2025-09-14T17:29:38.993033] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-09-14T17:29:39.189022] [DEBUG] [LOCAL ] CNQ: Primary data saved (40333 records). [2025-09-14T17:29:39.189411] [INFO ] [MAIN ] CNQ: Full history saved. [2025-09-14T17:29:39.189529] [INFO ] [MAIN ] Update Progress: 499/2370 symbols completed. CNQ took 23.7s. Estimated remaining: 3h 16m 42s. Rate: 9.5 symbols/min [2025-09-14T17:29:39.379126] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:29:39.399448] [DEBUG] [LOCAL ] CODI: Loaded 19001 existing records from primary storage. [2025-09-14T17:29:39.399685] [INFO ] [MAIN ] CODI: Loaded 19001 existing records. [2025-09-14T17:29:39.586198] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:29:39.586666] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-09-14T17:29:39.586842] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-09-14T17:29:39.596498] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-09-14T17:29:39.614145] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-09-14T17:29:39.687257] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T17:29:39.771353] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-09-14T17:29:39.992436] [INFO ] [REMOTE ] CODI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:29:40.558848] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-09-14T17:29:40.821129] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T17:29:41.358859] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-09-14T17:29:41.619562] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-14T17:29:42.154003] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-14T17:29:42.159381] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-09-14T17:29:42.958841] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-09-14T17:29:43.720397] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T17:29:43.743949] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-14T17:29:43.758811] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-09-14T17:29:44.272063] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T17:29:44.274783] [INFO ] [REMOTE ] CNS: Full fetch complete (22785 records). [2025-09-14T17:29:44.274874] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-09-14T17:29:44.564003] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-09-14T17:29:44.651558] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-09-14T17:29:44.651721] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-09-14T17:29:44.652195] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-09-14T17:29:44.652252] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-09-14T17:29:44.652942] [DEBUG] [LOCAL ] CNS: Trimmed 22785 records to 14962 (keeping 150 days of data) [2025-09-14T17:29:44.749259] [DEBUG] [LOCAL ] CNS: Primary data saved (14962 records). [2025-09-14T17:29:44.749459] [INFO ] [MAIN ] CNS: Full history saved. [2025-09-14T17:29:44.749567] [INFO ] [MAIN ] Update Progress: 500/2370 symbols completed. CNS took 20.6s. Estimated remaining: 3h 16m 32s. Rate: 9.5 symbols/min [2025-09-14T17:29:44.924555] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:29:44.964581] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (5.19 seconds). [2025-09-14T17:29:44.993447] [DEBUG] [LOCAL ] COF: Loaded 24010 existing records from primary storage. [2025-09-14T17:29:44.993632] [INFO ] [MAIN ] COF: Loaded 24010 existing records. [2025-09-14T17:29:45.183395] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:29:45.183725] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-09-14T17:29:45.183790] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-09-14T17:29:45.184542] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-09-14T17:29:45.184606] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-09-14T17:29:45.361136] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-09-14T17:29:45.541073] [INFO ] [REMOTE ] COF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:29:45.885528] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-14T17:29:46.158848] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-09-14T17:29:46.804933] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T17:29:46.809608] [INFO ] [REMOTE ] CNR: Full fetch complete (48405 records). [2025-09-14T17:29:46.809773] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-09-14T17:29:46.964010] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-09-14T17:29:47.215454] [DEBUG] [VALIDATOR ] CNR: All expected trading days are present. [2025-09-14T17:29:47.215720] [DEBUG] [VALIDATOR ] CNR: Primary data validation passed. [2025-09-14T17:29:47.216677] [INFO ] [MAIN ] CNR: Fetched primary data is valid. [2025-09-14T17:29:47.216816] [DEBUG] [LOCAL ] CNR: Saving primary data. [2025-09-14T17:29:47.218553] [DEBUG] [LOCAL ] CNR: Trimmed 48405 records to 32616 (keeping 150 days of data) [2025-09-14T17:29:47.379423] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-14T17:29:47.487938] [DEBUG] [LOCAL ] CNR: Primary data saved (32616 records). [2025-09-14T17:29:47.488198] [INFO ] [MAIN ] CNR: Full history saved. [2025-09-14T17:29:47.488337] [INFO ] [MAIN ] Update Progress: 501/2370 symbols completed. CNR took 30.6s. Estimated remaining: 3h 16m 13s. Rate: 9.5 symbols/min [2025-09-14T17:29:47.661764] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:29:47.693078] [DEBUG] [LOCAL ] COHR: Loaded 23926 existing records from primary storage. [2025-09-14T17:29:47.693323] [INFO ] [MAIN ] COHR: Loaded 23926 existing records. [2025-09-14T17:29:47.764043] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-09-14T17:29:47.887004] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:29:47.887330] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-09-14T17:29:47.887460] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-09-14T17:29:47.888129] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-09-14T17:29:47.888193] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-09-14T17:29:48.251563] [INFO ] [REMOTE ] COHR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:29:48.558909] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-09-14T17:29:48.971856] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-14T17:29:49.358896] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-09-14T17:29:49.609539] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T17:29:50.158847] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-09-14T17:29:50.646682] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-14T17:29:50.958871] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-09-14T17:29:51.289153] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T17:29:51.758818] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-09-14T17:29:51.817626] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T17:29:52.558924] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-09-14T17:29:53.042542] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-14T17:29:53.358853] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-09-14T17:29:53.936595] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-14T17:29:54.158864] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-09-14T17:29:54.351714] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T17:29:54.801724] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-14T17:29:54.958823] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-09-14T17:29:55.758877] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-09-14T17:29:56.290429] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-14T17:29:56.558947] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-09-14T17:29:56.700367] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T17:29:57.358846] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-09-14T17:29:57.729976] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-14T17:29:58.158843] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-09-14T17:29:58.191900] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T17:29:58.621905] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T17:29:58.958842] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-09-14T17:29:59.758799] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-09-14T17:30:00.119678] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-14T17:30:00.558889] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-09-14T17:30:00.853287] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-14T17:30:01.052967] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-14T17:30:01.058137] [INFO ] [REMOTE ] CNX: Full fetch complete (55980 records). [2025-09-14T17:30:01.058263] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-09-14T17:30:01.359173] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-09-14T17:30:01.452763] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-09-14T17:30:01.452965] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-09-14T17:30:01.453744] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-09-14T17:30:01.472783] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-09-14T17:30:01.481995] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T17:30:01.491120] [DEBUG] [LOCAL ] CNX: Trimmed 55980 records to 38562 (keeping 150 days of data) [2025-09-14T17:30:01.723983] [DEBUG] [LOCAL ] CNX: Primary data saved (38562 records). [2025-09-14T17:30:01.724204] [INFO ] [MAIN ] CNX: Full history saved. [2025-09-14T17:30:01.724387] [INFO ] [MAIN ] Update Progress: 502/2370 symbols completed. CNX took 26.2s. Estimated remaining: 3h 16m 36s. Rate: 9.5 symbols/min [2025-09-14T17:30:01.911847] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:30:01.938378] [DEBUG] [LOCAL ] COLD: Loaded 23639 existing records from primary storage. [2025-09-14T17:30:01.938580] [INFO ] [MAIN ] COLD: Loaded 23639 existing records. [2025-09-14T17:30:02.124790] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:30:02.125107] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-09-14T17:30:02.125186] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-09-14T17:30:02.125845] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-09-14T17:30:02.125913] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-09-14T17:30:02.163921] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-09-14T17:30:02.520560] [INFO ] [REMOTE ] COLD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:30:02.958839] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-09-14T17:30:03.758831] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-09-14T17:30:04.947128] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-14T17:30:04.950904] [INFO ] [REMOTE ] CODI: Full fetch complete (41301 records). [2025-09-14T17:30:04.951016] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-09-14T17:30:05.399987] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-09-14T17:30:05.400543] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-09-14T17:30:05.401902] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-09-14T17:30:05.402154] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-09-14T17:30:05.404151] [DEBUG] [LOCAL ] CODI: Trimmed 41301 records to 31566 (keeping 150 days of data) [2025-09-14T17:30:05.586434] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (4.23 seconds). [2025-09-14T17:30:05.632312] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-09-14T17:30:05.751712] [DEBUG] [LOCAL ] CODI: Primary data saved (31566 records). [2025-09-14T17:30:05.752043] [INFO ] [MAIN ] CODI: Full history saved. [2025-09-14T17:30:05.752229] [INFO ] [MAIN ] Update Progress: 503/2370 symbols completed. CODI took 26.6s. Estimated remaining: 3h 16m 21s. Rate: 9.5 symbols/min [2025-09-14T17:30:06.037638] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:30:06.076038] [DEBUG] [LOCAL ] COMP: Loaded 23846 existing records from primary storage. [2025-09-14T17:30:06.076271] [INFO ] [MAIN ] COMP: Loaded 23846 existing records. [2025-09-14T17:30:06.309430] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:30:06.310057] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-09-14T17:30:06.310167] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-14T17:30:06.311251] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-09-14T17:30:06.311350] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-09-14T17:30:06.633125] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (2.87 seconds). [2025-09-14T17:30:06.707547] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-09-14T17:30:06.818919] [INFO ] [REMOTE ] COMP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:30:06.820040] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-09-14T17:30:06.855729] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (4.69 seconds). [2025-09-14T17:30:06.958874] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-09-14T17:30:07.390773] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T17:30:07.758824] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-09-14T17:30:08.543033] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-14T17:30:08.565947] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-09-14T17:30:08.584721] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T17:30:08.691795] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T17:30:09.358830] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-09-14T17:30:10.074209] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-14T17:30:10.117040] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T17:30:10.158788] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-09-14T17:30:10.958880] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-09-14T17:30:11.289488] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T17:30:11.377246] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-14T17:30:11.382904] [INFO ] [REMOTE ] COF: Full fetch complete (58256 records). [2025-09-14T17:30:11.383042] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-09-14T17:30:11.767038] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-09-14T17:30:11.813897] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-09-14T17:30:11.814011] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-09-14T17:30:11.814909] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-09-14T17:30:11.815035] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-09-14T17:30:11.816759] [DEBUG] [LOCAL ] COF: Trimmed 58256 records to 40371 (keeping 150 days of data) [2025-09-14T17:30:11.963463] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-14T17:30:12.120275] [DEBUG] [LOCAL ] COF: Primary data saved (40371 records). [2025-09-14T17:30:12.120439] [INFO ] [MAIN ] COF: Full history saved. [2025-09-14T17:30:12.120537] [INFO ] [MAIN ] Update Progress: 504/2370 symbols completed. COF took 27.4s. Estimated remaining: 3h 16m 15s. Rate: 9.5 symbols/min [2025-09-14T17:30:12.291496] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:30:12.312261] [DEBUG] [LOCAL ] CON: Loaded 18370 existing records from primary storage. [2025-09-14T17:30:12.312459] [INFO ] [MAIN ] CON: Loaded 18370 existing records. [2025-09-14T17:30:12.488903] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:30:12.489188] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-09-14T17:30:12.489249] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-09-14T17:30:12.489798] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-09-14T17:30:12.489884] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-09-14T17:30:12.563914] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-09-14T17:30:12.848485] [INFO ] [REMOTE ] CON: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:30:13.358881] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-09-14T17:30:13.696158] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-14T17:30:14.158830] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-09-14T17:30:14.868552] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-14T17:30:14.874452] [INFO ] [REMOTE ] COHR: Full fetch complete (58035 records). [2025-09-14T17:30:14.874700] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-09-14T17:30:14.963954] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-09-14T17:30:15.278219] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-09-14T17:30:15.278361] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-09-14T17:30:15.279123] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-09-14T17:30:15.279197] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-09-14T17:30:15.280618] [DEBUG] [LOCAL ] COHR: Trimmed 58035 records to 40158 (keeping 150 days of data) [2025-09-14T17:30:15.399638] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (2.84 seconds). [2025-09-14T17:30:15.562278] [DEBUG] [LOCAL ] COHR: Primary data saved (40158 records). [2025-09-14T17:30:15.562419] [INFO ] [MAIN ] COHR: Full history saved. [2025-09-14T17:30:15.562521] [INFO ] [MAIN ] Update Progress: 505/2370 symbols completed. COHR took 28.1s. Estimated remaining: 3h 15m 58s. Rate: 9.5 symbols/min [2025-09-14T17:30:15.733613] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:30:15.763925] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-09-14T17:30:15.773144] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T17:30:15.788942] [DEBUG] [LOCAL ] COOK: Loaded 10804 existing records from primary storage. [2025-09-14T17:30:15.789180] [INFO ] [MAIN ] COOK: Loaded 10804 existing records. [2025-09-14T17:30:15.971683] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:30:15.971947] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-09-14T17:30:15.972027] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-09-14T17:30:15.972383] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-09-14T17:30:15.972442] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-09-14T17:30:16.329589] [INFO ] [REMOTE ] COOK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:30:16.376189] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T17:30:16.558869] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-09-14T17:30:17.358845] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-09-14T17:30:17.470489] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T17:30:17.633626] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-14T17:30:18.158826] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-09-14T17:30:18.916265] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T17:30:18.958814] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-09-14T17:30:19.758828] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-09-14T17:30:19.883721] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T17:30:20.558815] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-09-14T17:30:20.608433] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-14T17:30:20.653423] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T17:30:21.358829] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-09-14T17:30:22.140315] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T17:30:22.158770] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-09-14T17:30:22.963895] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-09-14T17:30:22.973519] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-14T17:30:22.980272] [INFO ] [REMOTE ] COLD: Full fetch complete (56327 records). [2025-09-14T17:30:22.980441] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-09-14T17:30:23.368162] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-09-14T17:30:23.368290] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-09-14T17:30:23.369101] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-09-14T17:30:23.369186] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-09-14T17:30:23.370876] [DEBUG] [LOCAL ] COLD: Trimmed 56327 records to 39316 (keeping 150 days of data) [2025-09-14T17:30:23.638523] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-14T17:30:23.667380] [DEBUG] [LOCAL ] COLD: Primary data saved (39316 records). [2025-09-14T17:30:23.667617] [INFO ] [MAIN ] COLD: Full history saved. [2025-09-14T17:30:23.667819] [INFO ] [MAIN ] Update Progress: 506/2370 symbols completed. COLD took 21.9s. Estimated remaining: 3h 15m 59s. Rate: 9.5 symbols/min [2025-09-14T17:30:23.764764] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-09-14T17:30:23.841873] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:30:23.868635] [DEBUG] [LOCAL ] COP: Loaded 24087 existing records from primary storage. [2025-09-14T17:30:23.868817] [INFO ] [MAIN ] COP: Loaded 24087 existing records. [2025-09-14T17:30:24.049750] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:30:24.061723] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-09-14T17:30:24.062237] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T17:30:24.062387] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-14T17:30:24.067963] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-09-14T17:30:24.068056] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-09-14T17:30:24.423611] [INFO ] [REMOTE ] COP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:30:24.558820] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-09-14T17:30:25.358805] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-09-14T17:30:25.822750] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-14T17:30:26.147106] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T17:30:26.158768] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-09-14T17:30:26.215771] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T17:30:26.958822] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-09-14T17:30:27.360447] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T17:30:27.758837] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-09-14T17:30:27.926879] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T17:30:28.558847] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-09-14T17:30:29.358886] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-09-14T17:30:29.678487] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-14T17:30:30.080790] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-14T17:30:30.158800] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-09-14T17:30:30.488483] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T17:30:30.494069] [INFO ] [REMOTE ] CON: Full fetch complete (42025 records). [2025-09-14T17:30:30.494229] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-09-14T17:30:30.870680] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-09-14T17:30:30.870808] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-09-14T17:30:30.871434] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-09-14T17:30:30.871493] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-09-14T17:30:30.872596] [DEBUG] [LOCAL ] CON: Trimmed 42025 records to 28932 (keeping 150 days of data) [2025-09-14T17:30:30.973606] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-09-14T17:30:31.066819] [DEBUG] [LOCAL ] CON: Primary data saved (28932 records). [2025-09-14T17:30:31.067031] [INFO ] [MAIN ] CON: Full history saved. [2025-09-14T17:30:31.067254] [INFO ] [MAIN ] Update Progress: 507/2370 symbols completed. CON took 18.9s. Estimated remaining: 3h 15m 56s. Rate: 9.5 symbols/min [2025-09-14T17:30:31.236759] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:30:31.258131] [DEBUG] [LOCAL ] COR: Loaded 20001 existing records from primary storage. [2025-09-14T17:30:31.258300] [INFO ] [MAIN ] COR: Loaded 20001 existing records. [2025-09-14T17:30:31.444519] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:30:31.445060] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-09-14T17:30:31.445139] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-09-14T17:30:31.456142] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-09-14T17:30:31.471458] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-09-14T17:30:31.581791] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-14T17:30:31.764101] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-09-14T17:30:31.850280] [INFO ] [REMOTE ] COR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:30:32.135511] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T17:30:32.558841] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-09-14T17:30:33.358862] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-09-14T17:30:33.737658] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-14T17:30:34.158895] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-09-14T17:30:34.357593] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-14T17:30:34.958809] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-09-14T17:30:34.989865] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-14T17:30:34.996005] [INFO ] [REMOTE ] COMP: Full fetch complete (58009 records). [2025-09-14T17:30:34.996168] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-09-14T17:30:35.366445] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-14T17:30:35.429057] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-09-14T17:30:35.429207] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-09-14T17:30:35.430392] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-09-14T17:30:35.430476] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-09-14T17:30:35.432857] [DEBUG] [LOCAL ] COMP: Trimmed 58009 records to 40161 (keeping 150 days of data) [2025-09-14T17:30:35.749006] [DEBUG] [LOCAL ] COMP: Primary data saved (40161 records). [2025-09-14T17:30:35.749251] [INFO ] [MAIN ] COMP: Full history saved. [2025-09-14T17:30:35.749494] [INFO ] [MAIN ] Update Progress: 508/2370 symbols completed. COMP took 30.0s. Estimated remaining: 3h 15m 44s. Rate: 9.5 symbols/min [2025-09-14T17:30:35.764987] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-09-14T17:30:35.975142] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:30:35.999363] [DEBUG] [LOCAL ] COTY: Loaded 23971 existing records from primary storage. [2025-09-14T17:30:35.999524] [INFO ] [MAIN ] COTY: Loaded 23971 existing records. [2025-09-14T17:30:36.173383] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:30:36.173657] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-09-14T17:30:36.173719] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-14T17:30:36.174294] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-09-14T17:30:36.174361] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-09-14T17:30:36.533194] [INFO ] [REMOTE ] COTY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:30:36.563853] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-09-14T17:30:36.569861] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T17:30:36.987448] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-14T17:30:36.992200] [INFO ] [REMOTE ] COOK: Full fetch complete (25105 records). [2025-09-14T17:30:36.992321] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-09-14T17:30:37.353558] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-09-14T17:30:37.353679] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-09-14T17:30:37.354138] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-09-14T17:30:37.354188] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-09-14T17:30:37.356921] [DEBUG] [LOCAL ] COOK: Trimmed 25105 records to 18711 (keeping 150 days of data) [2025-09-14T17:30:37.358784] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-09-14T17:30:37.466279] [DEBUG] [LOCAL ] COOK: Primary data saved (18711 records). [2025-09-14T17:30:37.466456] [INFO ] [MAIN ] COOK: Full history saved. [2025-09-14T17:30:37.466581] [INFO ] [MAIN ] Update Progress: 509/2370 symbols completed. COOK took 21.9s. Estimated remaining: 3h 15m 21s. Rate: 9.5 symbols/min [2025-09-14T17:30:37.634697] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:30:37.656391] [DEBUG] [LOCAL ] COUR: Loaded 22243 existing records from primary storage. [2025-09-14T17:30:37.656561] [INFO ] [MAIN ] COUR: Loaded 22243 existing records. [2025-09-14T17:30:37.836239] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:30:37.836514] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-09-14T17:30:37.836573] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-09-14T17:30:37.837220] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-09-14T17:30:37.837300] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-09-14T17:30:38.184218] [INFO ] [REMOTE ] COUR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:30:38.180029] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-09-14T17:30:38.793537] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-14T17:30:38.958848] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-09-14T17:30:39.242633] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T17:30:39.760618] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-09-14T17:30:39.763174] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T17:30:40.558852] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-09-14T17:30:40.865121] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T17:30:41.358875] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-09-14T17:30:41.415949] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T17:30:42.158850] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-09-14T17:30:42.409405] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T17:30:42.958854] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-09-14T17:30:43.491600] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-14T17:30:43.758881] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-09-14T17:30:43.805694] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-14T17:30:44.558942] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-09-14T17:30:44.893044] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T17:30:45.358843] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-09-14T17:30:45.858902] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-14T17:30:46.158849] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-09-14T17:30:46.338790] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-14T17:30:46.958813] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-09-14T17:30:47.152453] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T17:30:47.758789] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-09-14T17:30:47.786547] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T17:30:48.558832] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-09-14T17:30:48.678395] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-14T17:30:49.329533] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T17:30:49.358784] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-09-14T17:30:50.158892] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-09-14T17:30:50.654482] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-14T17:30:50.958910] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-09-14T17:30:51.216871] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-14T17:30:51.621065] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T17:30:51.758879] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-09-14T17:30:52.185369] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T17:30:52.191428] [INFO ] [REMOTE ] COP: Full fetch complete (58407 records). [2025-09-14T17:30:52.191656] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-09-14T17:30:52.560755] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-09-14T17:30:52.580814] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-09-14T17:30:52.580971] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-09-14T17:30:52.581947] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-09-14T17:30:52.602745] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-09-14T17:30:52.607602] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T17:30:52.618486] [DEBUG] [LOCAL ] COP: Trimmed 58407 records to 40467 (keeping 150 days of data) [2025-09-14T17:30:52.870756] [DEBUG] [LOCAL ] COP: Primary data saved (40467 records). [2025-09-14T17:30:52.870917] [INFO ] [MAIN ] COP: Full history saved. [2025-09-14T17:30:52.871015] [INFO ] [MAIN ] Update Progress: 510/2370 symbols completed. COP took 29.2s. Estimated remaining: 3h 15m 48s. Rate: 9.5 symbols/min [2025-09-14T17:30:53.042425] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:30:53.066897] [DEBUG] [LOCAL ] CP: Loaded 23804 existing records from primary storage. [2025-09-14T17:30:53.067072] [INFO ] [MAIN ] CP: Loaded 23804 existing records. [2025-09-14T17:30:53.241749] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:30:53.242044] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-09-14T17:30:53.242101] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-09-14T17:30:53.242684] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-09-14T17:30:53.242745] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-09-14T17:30:53.363915] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-09-14T17:30:53.626422] [INFO ] [REMOTE ] CP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:30:54.158861] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-09-14T17:30:54.288260] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T17:30:54.890387] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T17:30:54.958838] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-09-14T17:30:55.758846] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-09-14T17:30:56.059474] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-14T17:30:56.558790] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-09-14T17:30:56.602856] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T17:30:56.912027] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-14T17:30:56.917041] [INFO ] [REMOTE ] COR: Full fetch complete (51662 records). [2025-09-14T17:30:56.917197] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-09-14T17:30:57.299301] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-09-14T17:30:57.299435] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-09-14T17:30:57.300239] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-09-14T17:30:57.300382] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-09-14T17:30:57.301720] [DEBUG] [LOCAL ] COR: Trimmed 51662 records to 34959 (keeping 150 days of data) [2025-09-14T17:30:57.359978] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-09-14T17:30:57.448689] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T17:30:57.591319] [DEBUG] [LOCAL ] COR: Primary data saved (34959 records). [2025-09-14T17:30:57.591534] [INFO ] [MAIN ] COR: Full history saved. [2025-09-14T17:30:57.591676] [INFO ] [MAIN ] Update Progress: 511/2370 symbols completed. COR took 26.5s. Estimated remaining: 3h 15m 36s. Rate: 9.5 symbols/min [2025-09-14T17:30:57.859702] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:30:57.879759] [DEBUG] [LOCAL ] CPA: Loaded 12521 existing records from primary storage. [2025-09-14T17:30:57.880005] [INFO ] [MAIN ] CPA: Loaded 12521 existing records. [2025-09-14T17:30:58.167052] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-09-14T17:30:58.181226] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:30:58.181539] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-09-14T17:30:58.181625] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-09-14T17:30:58.182166] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-09-14T17:30:58.182266] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-09-14T17:30:58.700893] [INFO ] [REMOTE ] CPA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:30:58.899927] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-14T17:30:58.905296] [INFO ] [REMOTE ] COUR: Full fetch complete (53089 records). [2025-09-14T17:30:58.905442] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-09-14T17:30:58.968824] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-09-14T17:30:59.291473] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-09-14T17:30:59.291659] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-09-14T17:30:59.292679] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-09-14T17:30:59.292828] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-09-14T17:30:59.294329] [DEBUG] [LOCAL ] COUR: Trimmed 53089 records to 36989 (keeping 150 days of data) [2025-09-14T17:30:59.519010] [DEBUG] [LOCAL ] COUR: Primary data saved (36989 records). [2025-09-14T17:30:59.519204] [INFO ] [MAIN ] COUR: Full history saved. [2025-09-14T17:30:59.519320] [INFO ] [MAIN ] Update Progress: 512/2370 symbols completed. COUR took 22.1s. Estimated remaining: 3h 15m 13s. Rate: 9.5 symbols/min [2025-09-14T17:30:59.692397] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:30:59.694842] [DEBUG] [LOCAL ] CPAC: Loaded 582 existing records from primary storage. [2025-09-14T17:30:59.694934] [INFO ] [MAIN ] CPAC: Loaded 582 existing records. [2025-09-14T17:30:59.769044] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-09-14T17:30:59.877186] [WARN ] [MAIN ] CPAC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:30:59.877474] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-09-14T17:30:59.877683] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-14T17:30:59.877946] [DEBUG] [LOCAL ] CPAC: Deleted primary data file. [2025-09-14T17:30:59.878047] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-09-14T17:31:00.245821] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:31:00.275829] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-14T17:31:00.345232] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-14T17:31:00.558869] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-09-14T17:31:01.358842] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-09-14T17:31:01.741083] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-14T17:31:01.935269] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-14T17:31:02.158845] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-09-14T17:31:02.329195] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T17:31:02.819935] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T17:31:02.825495] [INFO ] [REMOTE ] COTY: Full fetch complete (57943 records). [2025-09-14T17:31:02.825624] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-09-14T17:31:02.970114] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-09-14T17:31:03.210619] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-09-14T17:31:03.210751] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-09-14T17:31:03.211485] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-09-14T17:31:03.211552] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-09-14T17:31:03.212820] [DEBUG] [LOCAL ] COTY: Trimmed 57943 records to 40116 (keeping 150 days of data) [2025-09-14T17:31:03.413534] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-14T17:31:03.448251] [DEBUG] [LOCAL ] COTY: Primary data saved (40116 records). [2025-09-14T17:31:03.448416] [INFO ] [MAIN ] COTY: Full history saved. [2025-09-14T17:31:03.448522] [INFO ] [MAIN ] Update Progress: 513/2370 symbols completed. COTY took 27.7s. Estimated remaining: 3h 14m 59s. Rate: 9.5 symbols/min [2025-09-14T17:31:03.616814] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:31:03.631354] [DEBUG] [LOCAL ] CPAY: Loaded 13267 existing records from primary storage. [2025-09-14T17:31:03.631534] [INFO ] [MAIN ] CPAY: Loaded 13267 existing records. [2025-09-14T17:31:03.772925] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-09-14T17:31:03.809743] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:31:03.809922] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-09-14T17:31:03.809989] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-09-14T17:31:03.810556] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-09-14T17:31:03.810696] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-09-14T17:31:04.158735] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:31:04.558847] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-09-14T17:31:04.930966] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T17:31:05.025326] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-14T17:31:05.358886] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-09-14T17:31:06.158843] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-09-14T17:31:06.771033] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-14T17:31:06.958847] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-09-14T17:31:07.758832] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-09-14T17:31:08.041939] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-14T17:31:08.131949] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-14T17:31:08.558830] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-09-14T17:31:08.965984] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-14T17:31:08.983520] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-14T17:31:09.358884] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-09-14T17:31:09.801245] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-14T17:31:10.158881] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-09-14T17:31:10.662150] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-14T17:31:10.958797] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-09-14T17:31:11.387948] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-14T17:31:11.758829] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-09-14T17:31:12.558826] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-09-14T17:31:13.358837] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-14T17:31:13.418079] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-14T17:31:13.852789] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-14T17:31:13.853668] [INFO ] [REMOTE ] CPAC: Full fetch complete (1250 records). [2025-09-14T17:31:13.853754] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-09-14T17:31:14.042099] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-14T17:31:14.042424] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:31:14.042549] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:31:14.042676] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-14T17:31:14.042874] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-14T17:31:14.042958] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-09-14T17:31:14.043015] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-09-14T17:31:14.043193] [INFO ] [MAIN ] Update Progress: 514/2370 symbols completed. CPAC took 14.5s. Estimated remaining: 3h 15m 8s. Rate: 9.5 symbols/min [2025-09-14T17:31:14.163606] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-09-14T17:31:14.222927] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:31:14.256933] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-14T17:31:14.264255] [DEBUG] [LOCAL ] CPF: Loaded 6449 existing records from primary storage. [2025-09-14T17:31:14.271392] [INFO ] [MAIN ] CPF: Loaded 6449 existing records. [2025-09-14T17:31:14.456772] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:31:14.457046] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-09-14T17:31:14.457105] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-09-14T17:31:14.457441] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-09-14T17:31:14.457501] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-09-14T17:31:14.821995] [INFO ] [REMOTE ] CPF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:31:14.958798] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-09-14T17:31:15.426410] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T17:31:15.758791] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-09-14T17:31:16.130381] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-14T17:31:16.558834] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-09-14T17:31:17.181564] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-14T17:31:17.358852] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-09-14T17:31:17.720293] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T17:31:18.158821] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-09-14T17:31:18.650588] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-14T17:31:18.958857] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-09-14T17:31:19.293693] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-14T17:31:19.758839] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-09-14T17:31:20.558811] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-09-14T17:31:20.869362] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-14T17:31:20.916511] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-14T17:31:21.358922] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-09-14T17:31:21.928702] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T17:31:22.158822] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-09-14T17:31:22.337829] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-14T17:31:22.958832] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-09-14T17:31:23.758829] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-09-14T17:31:23.933957] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-14T17:31:24.030702] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T17:31:24.558861] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-09-14T17:31:25.175466] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T17:31:25.358843] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-09-14T17:31:25.469792] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-14T17:31:26.158845] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-09-14T17:31:26.579472] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-14T17:31:26.958822] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-09-14T17:31:27.331855] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-14T17:31:27.335368] [INFO ] [REMOTE ] CPA: Full fetch complete (31921 records). [2025-09-14T17:31:27.335524] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-09-14T17:31:27.732491] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-09-14T17:31:27.732609] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-09-14T17:31:27.733186] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-09-14T17:31:27.733256] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-09-14T17:31:27.734186] [DEBUG] [LOCAL ] CPA: Trimmed 31921 records to 21487 (keeping 150 days of data) [2025-09-14T17:31:27.791710] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-09-14T17:31:27.873538] [DEBUG] [LOCAL ] CPA: Primary data saved (21487 records). [2025-09-14T17:31:27.873828] [INFO ] [MAIN ] CPA: Full history saved. [2025-09-14T17:31:27.873929] [INFO ] [MAIN ] Update Progress: 515/2370 symbols completed. CPA took 30.3s. Estimated remaining: 3h 15m 29s. Rate: 9.5 symbols/min [2025-09-14T17:31:28.041954] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:31:28.048998] [DEBUG] [LOCAL ] CPK: Loaded 5526 existing records from primary storage. [2025-09-14T17:31:28.049124] [INFO ] [MAIN ] CPK: Loaded 5526 existing records. [2025-09-14T17:31:28.224233] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:31:28.224482] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-09-14T17:31:28.224585] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-09-14T17:31:28.224956] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-09-14T17:31:28.225018] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-09-14T17:31:28.562964] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-09-14T17:31:28.583029] [INFO ] [REMOTE ] CPK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:31:28.598675] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-14T17:31:28.604208] [INFO ] [REMOTE ] CP: Full fetch complete (57910 records). [2025-09-14T17:31:28.604382] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-09-14T17:31:28.942269] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-14T17:31:28.997407] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-09-14T17:31:28.997502] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-09-14T17:31:28.998225] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-09-14T17:31:28.998284] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-09-14T17:31:28.999447] [DEBUG] [LOCAL ] CP: Trimmed 57910 records to 40048 (keeping 150 days of data) [2025-09-14T17:31:29.242960] [DEBUG] [LOCAL ] CP: Primary data saved (40048 records). [2025-09-14T17:31:29.243118] [INFO ] [MAIN ] CP: Full history saved. [2025-09-14T17:31:29.243213] [INFO ] [MAIN ] Update Progress: 516/2370 symbols completed. CP took 36.4s. Estimated remaining: 3h 15m 4s. Rate: 9.5 symbols/min [2025-09-14T17:31:29.363939] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-09-14T17:31:29.416373] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:31:29.441199] [DEBUG] [LOCAL ] CPNG: Loaded 24059 existing records from primary storage. [2025-09-14T17:31:29.441379] [INFO ] [MAIN ] CPNG: Loaded 24059 existing records. [2025-09-14T17:31:29.616301] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:31:29.616533] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-09-14T17:31:29.616590] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-09-14T17:31:29.617327] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-09-14T17:31:29.617395] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-09-14T17:31:29.892350] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T17:31:29.896790] [INFO ] [REMOTE ] CPF: Full fetch complete (16957 records). [2025-09-14T17:31:29.917862] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-09-14T17:31:29.985152] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:31:30.158822] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-09-14T17:31:30.379054] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-14T17:31:30.417857] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-09-14T17:31:30.418275] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-09-14T17:31:30.418800] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-09-14T17:31:30.419245] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-09-14T17:31:30.419960] [DEBUG] [LOCAL ] CPF: Trimmed 16957 records to 11023 (keeping 150 days of data) [2025-09-14T17:31:30.488165] [DEBUG] [LOCAL ] CPF: Primary data saved (11023 records). [2025-09-14T17:31:30.488350] [INFO ] [MAIN ] CPF: Full history saved. [2025-09-14T17:31:30.488451] [INFO ] [MAIN ] Update Progress: 517/2370 symbols completed. CPF took 16.4s. Estimated remaining: 3h 14m 40s. Rate: 9.5 symbols/min [2025-09-14T17:31:30.958888] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-09-14T17:31:31.570842] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T17:31:31.574026] [INFO ] [REMOTE ] CPAY: Full fetch complete (34092 records). [2025-09-14T17:31:31.574144] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-09-14T17:31:31.763915] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-09-14T17:31:31.967822] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-09-14T17:31:31.967994] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-09-14T17:31:31.968705] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-09-14T17:31:31.968798] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-09-14T17:31:31.970179] [DEBUG] [LOCAL ] CPAY: Trimmed 34092 records to 22765 (keeping 150 days of data) [2025-09-14T17:31:32.108263] [DEBUG] [LOCAL ] CPAY: Primary data saved (22765 records). [2025-09-14T17:31:32.108430] [INFO ] [MAIN ] CPAY: Full history saved. [2025-09-14T17:31:32.108525] [INFO ] [MAIN ] Update Progress: 518/2370 symbols completed. CPAY took 28.7s. Estimated remaining: 3h 14m 17s. Rate: 9.5 symbols/min [2025-09-14T17:31:32.464127] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-14T17:31:32.558840] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-09-14T17:31:32.767370] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-14T17:31:33.358827] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-09-14T17:31:34.298938] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-14T17:31:34.304228] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-09-14T17:31:34.690951] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-14T17:31:34.958885] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-09-14T17:31:35.375324] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-14T17:31:35.758855] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-09-14T17:31:36.768968] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-14T17:31:36.774240] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-09-14T17:31:37.017019] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-14T17:31:37.358805] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-09-14T17:31:37.740360] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T17:31:38.158882] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-09-14T17:31:39.055077] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-14T17:31:39.059437] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-09-14T17:31:39.484075] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-14T17:31:39.758949] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-09-14T17:31:39.904471] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-14T17:31:40.558900] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-09-14T17:31:40.998518] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T17:31:41.000117] [INFO ] [REMOTE ] CPK: Full fetch complete (13946 records). [2025-09-14T17:31:41.000320] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-09-14T17:31:41.374038] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-09-14T17:31:41.374141] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-09-14T17:31:41.374491] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-09-14T17:31:41.374556] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-09-14T17:31:41.375077] [DEBUG] [LOCAL ] CPK: Trimmed 13946 records to 9467 (keeping 150 days of data) [2025-09-14T17:31:41.434064] [DEBUG] [LOCAL ] CPK: Primary data saved (9467 records). [2025-09-14T17:31:41.434220] [INFO ] [MAIN ] CPK: Full history saved. [2025-09-14T17:31:41.434332] [INFO ] [MAIN ] Update Progress: 519/2370 symbols completed. CPK took 13.6s. Estimated remaining: 3h 14m 21s. Rate: 9.5 symbols/min [2025-09-14T17:31:41.954670] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-14T17:31:41.966149] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-09-14T17:31:44.355200] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-14T17:31:44.367806] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-09-14T17:31:46.732150] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-14T17:31:46.744123] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-09-14T17:31:48.831547] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-14T17:31:48.839992] [INFO ] [REMOTE ] CPNG: Full fetch complete (58346 records). [2025-09-14T17:31:48.840202] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-09-14T17:31:49.230076] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-09-14T17:31:49.230185] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-09-14T17:31:49.230990] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-09-14T17:31:49.231073] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-09-14T17:31:49.232324] [DEBUG] [LOCAL ] CPNG: Trimmed 58346 records to 40425 (keeping 150 days of data) [2025-09-14T17:31:49.487280] [DEBUG] [LOCAL ] CPNG: Primary data saved (40425 records). [2025-09-14T17:31:49.487717] [INFO ] [MAIN ] CPNG: Full history saved. [2025-09-14T17:31:49.487827] [INFO ] [MAIN ] Update Progress: 520/2370 symbols completed. CPNG took 20.2s. Estimated remaining: 3h 14m 21s. Rate: 9.5 symbols/min [2025-09-14T17:31:50.049572] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:31:50.174751] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:31:50.198718] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:31:50.197087] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:31:50.216059] [DEBUG] [LOCAL ] CQP: Loaded 8865 existing records from primary storage. [2025-09-14T17:31:50.216252] [INFO ] [MAIN ] CQP: Loaded 8865 existing records. [2025-09-14T17:31:50.286299] [DEBUG] [LOCAL ] CPS: Loaded 10105 existing records from primary storage. [2025-09-14T17:31:50.336153] [INFO ] [MAIN ] CPS: Loaded 10105 existing records. [2025-09-14T17:31:50.357659] [DEBUG] [LOCAL ] CPRI: Loaded 23466 existing records from primary storage. [2025-09-14T17:31:50.369328] [DEBUG] [LOCAL ] CPT: Loaded 19705 existing records from primary storage. [2025-09-14T17:31:50.379751] [INFO ] [MAIN ] CPT: Loaded 19705 existing records. [2025-09-14T17:31:50.363725] [INFO ] [MAIN ] CPRI: Loaded 23466 existing records. [2025-09-14T17:31:50.652068] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:31:50.758151] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-09-14T17:31:50.793275] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-09-14T17:31:50.908332] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-09-14T17:31:50.955639] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:31:50.971875] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-09-14T17:31:51.016539] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:31:51.022861] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:31:51.023277] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-09-14T17:31:51.029063] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-09-14T17:31:51.023674] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-09-14T17:31:51.062996] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-09-14T17:31:51.083224] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-09-14T17:31:51.068349] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-09-14T17:31:51.110456] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-09-14T17:31:51.110686] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-09-14T17:31:51.128211] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-09-14T17:31:51.164163] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-09-14T17:31:51.164523] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-09-14T17:31:51.220737] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-09-14T17:31:52.702132] [INFO ] [REMOTE ] CQP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:31:52.880560] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-09-14T17:31:52.999491] [INFO ] [REMOTE ] CPS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:31:53.011051] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:31:53.045421] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-09-14T17:31:53.064502] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-09-14T17:31:53.071562] [INFO ] [REMOTE ] CPT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:31:53.073250] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-09-14T17:31:54.012937] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-14T17:31:54.018472] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-09-14T17:31:54.338706] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T17:31:54.348229] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-09-14T17:31:54.406054] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T17:31:54.415372] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-09-14T17:31:54.514095] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-14T17:31:54.524374] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-09-14T17:31:54.969672] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-14T17:31:54.976432] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-09-14T17:31:55.247751] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-14T17:31:55.252790] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-09-14T17:31:55.839716] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-14T17:31:55.850199] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-09-14T17:31:56.030733] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-14T17:31:56.035616] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-09-14T17:31:56.195983] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-14T17:31:56.203550] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-09-14T17:31:56.414711] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-14T17:31:56.426436] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-09-14T17:31:56.800486] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-14T17:31:56.806121] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-09-14T17:31:57.457516] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T17:31:57.465153] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-09-14T17:31:57.535635] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T17:31:57.546426] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-09-14T17:31:57.779566] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T17:31:57.786406] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-09-14T17:31:58.196507] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T17:31:58.208676] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-09-14T17:31:58.257158] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-14T17:31:58.789162] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-14T17:31:58.859768] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-14T17:31:58.958797] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-09-14T17:31:59.611513] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-14T17:31:59.758810] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-09-14T17:32:00.119582] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T17:32:00.558868] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-09-14T17:32:01.358867] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-09-14T17:32:01.576294] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T17:32:02.005667] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-14T17:32:02.158813] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-09-14T17:32:02.460147] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-14T17:32:02.958828] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-09-14T17:32:03.700169] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T17:32:03.701925] [INFO ] [REMOTE ] CQP: Full fetch complete (22281 records). [2025-09-14T17:32:03.702015] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-09-14T17:32:03.765044] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-09-14T17:32:04.075739] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-09-14T17:32:04.076000] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-09-14T17:32:04.076862] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-09-14T17:32:04.077000] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-09-14T17:32:04.077958] [DEBUG] [LOCAL ] CQP: Trimmed 22281 records to 15095 (keeping 150 days of data) [2025-09-14T17:32:04.200632] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-14T17:32:04.215360] [DEBUG] [LOCAL ] CQP: Primary data saved (15095 records). [2025-09-14T17:32:04.220431] [INFO ] [MAIN ] CQP: Full history saved. [2025-09-14T17:32:04.220692] [INFO ] [MAIN ] Update Progress: 521/2370 symbols completed. CQP took 14.7s. Estimated remaining: 3h 14m 45s. Rate: 9.5 symbols/min [2025-09-14T17:32:04.392336] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:32:04.404756] [DEBUG] [LOCAL ] CR: Loaded 10640 existing records from primary storage. [2025-09-14T17:32:04.404939] [INFO ] [MAIN ] CR: Loaded 10640 existing records. [2025-09-14T17:32:04.565196] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-09-14T17:32:04.587992] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:32:04.588227] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-09-14T17:32:04.588309] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-09-14T17:32:04.588798] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-09-14T17:32:04.588876] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-09-14T17:32:04.944009] [INFO ] [REMOTE ] CR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:32:05.061204] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-14T17:32:05.358833] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-09-14T17:32:06.158820] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-09-14T17:32:06.281629] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T17:32:06.309333] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-14T17:32:06.958847] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-09-14T17:32:07.736210] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T17:32:07.758786] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-09-14T17:32:07.972194] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-14T17:32:07.975062] [INFO ] [REMOTE ] CPS: Full fetch complete (28927 records). [2025-09-14T17:32:07.975191] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-09-14T17:32:08.363817] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-09-14T17:32:08.363940] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-09-14T17:32:08.364515] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-09-14T17:32:08.364592] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-09-14T17:32:08.365611] [DEBUG] [LOCAL ] CPS: Trimmed 28927 records to 18945 (keeping 150 days of data) [2025-09-14T17:32:08.484375] [DEBUG] [LOCAL ] CPS: Primary data saved (18945 records). [2025-09-14T17:32:08.484632] [INFO ] [MAIN ] CPS: Full history saved. [2025-09-14T17:32:08.484796] [INFO ] [MAIN ] Update Progress: 522/2370 symbols completed. CPS took 19.0s. Estimated remaining: 3h 14m 31s. Rate: 9.5 symbols/min [2025-09-14T17:32:08.563998] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-09-14T17:32:08.668575] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:32:08.674987] [DEBUG] [LOCAL ] CRBD: Loaded 4264 existing records from primary storage. [2025-09-14T17:32:08.675158] [INFO ] [MAIN ] CRBD: Loaded 4264 existing records. [2025-09-14T17:32:08.862976] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:32:08.863234] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-09-14T17:32:08.863306] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-14T17:32:08.863581] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-09-14T17:32:08.863711] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-09-14T17:32:09.223239] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:32:09.283637] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T17:32:09.306374] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-14T17:32:09.304935] [INFO ] [REMOTE ] CPRI: Full fetch complete (57174 records). [2025-09-14T17:32:09.306683] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-09-14T17:32:09.363986] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-09-14T17:32:09.708817] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-09-14T17:32:09.708931] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-09-14T17:32:09.709725] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-09-14T17:32:09.709792] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-09-14T17:32:09.711070] [DEBUG] [LOCAL ] CPRI: Trimmed 57174 records to 39506 (keeping 150 days of data) [2025-09-14T17:32:09.946232] [DEBUG] [LOCAL ] CPRI: Primary data saved (39506 records). [2025-09-14T17:32:09.946418] [INFO ] [MAIN ] CPRI: Full history saved. [2025-09-14T17:32:09.946544] [INFO ] [MAIN ] Update Progress: 523/2370 symbols completed. CPRI took 20.5s. Estimated remaining: 3h 14m 8s. Rate: 9.5 symbols/min [2025-09-14T17:32:10.116734] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:32:10.139029] [DEBUG] [LOCAL ] CRBG: Loaded 23505 existing records from primary storage. [2025-09-14T17:32:10.139205] [INFO ] [MAIN ] CRBG: Loaded 23505 existing records. [2025-09-14T17:32:10.169209] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-09-14T17:32:10.315447] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:32:10.315738] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-09-14T17:32:10.315800] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-09-14T17:32:10.316389] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-09-14T17:32:10.316449] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-09-14T17:32:10.662193] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:32:10.696918] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T17:32:10.958850] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-09-14T17:32:11.056397] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T17:32:11.758848] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-09-14T17:32:12.558926] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-09-14T17:32:12.676863] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-14T17:32:12.730760] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T17:32:13.358843] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-09-14T17:32:13.687208] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-14T17:32:14.158835] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-09-14T17:32:14.199265] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-14T17:32:14.958848] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-09-14T17:32:15.758835] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-09-14T17:32:15.775522] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T17:32:16.158634] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-14T17:32:16.558835] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-09-14T17:32:16.982091] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-14T17:32:17.358829] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-09-14T17:32:18.158827] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-09-14T17:32:18.191006] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T17:32:18.354415] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T17:32:18.958857] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-09-14T17:32:19.300585] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-14T17:32:19.583866] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T17:32:19.588911] [INFO ] [REMOTE ] CPT: Full fetch complete (48307 records). [2025-09-14T17:32:19.589147] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-09-14T17:32:19.764742] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-09-14T17:32:20.004182] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-09-14T17:32:20.004333] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-09-14T17:32:20.005084] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-09-14T17:32:20.005160] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-09-14T17:32:20.006498] [DEBUG] [LOCAL ] CPT: Trimmed 48307 records to 33071 (keeping 150 days of data) [2025-09-14T17:32:20.217282] [DEBUG] [LOCAL ] CPT: Primary data saved (33071 records). [2025-09-14T17:32:20.217459] [INFO ] [MAIN ] CPT: Full history saved. [2025-09-14T17:32:20.217573] [INFO ] [MAIN ] Update Progress: 524/2370 symbols completed. CPT took 30.7s. Estimated remaining: 3h 14m 16s. Rate: 9.5 symbols/min [2025-09-14T17:32:20.400172] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:32:20.423220] [DEBUG] [LOCAL ] CRC: Loaded 19599 existing records from primary storage. [2025-09-14T17:32:20.423409] [INFO ] [MAIN ] CRC: Loaded 19599 existing records. [2025-09-14T17:32:20.565091] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-09-14T17:32:20.608047] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:32:20.608328] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-09-14T17:32:20.608392] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-09-14T17:32:20.609005] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-09-14T17:32:20.609099] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-09-14T17:32:20.771603] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T17:32:20.994162] [INFO ] [REMOTE ] CRC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:32:21.358829] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-09-14T17:32:22.139834] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T17:32:22.158775] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-09-14T17:32:22.181842] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T17:32:22.958856] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-09-14T17:32:23.660416] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T17:32:23.758825] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-09-14T17:32:24.093112] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-14T17:32:24.503933] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T17:32:24.505362] [INFO ] [REMOTE ] CRBD: Full fetch complete (9914 records). [2025-09-14T17:32:24.509222] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-09-14T17:32:24.565989] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-09-14T17:32:24.875020] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-09-14T17:32:24.875120] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-09-14T17:32:24.875383] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-09-14T17:32:24.875451] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-09-14T17:32:24.875958] [DEBUG] [LOCAL ] CRBD: Trimmed 9914 records to 6949 (keeping 150 days of data) [2025-09-14T17:32:24.918436] [DEBUG] [LOCAL ] CRBD: Primary data saved (6949 records). [2025-09-14T17:32:24.918579] [INFO ] [MAIN ] CRBD: Full history saved. [2025-09-14T17:32:24.918728] [INFO ] [MAIN ] Update Progress: 525/2370 symbols completed. CRBD took 16.4s. Estimated remaining: 3h 14m 4s. Rate: 9.5 symbols/min [2025-09-14T17:32:25.087020] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:32:25.113369] [DEBUG] [LOCAL ] CRCL: Loaded 24230 existing records from primary storage. [2025-09-14T17:32:25.113528] [INFO ] [MAIN ] CRCL: Loaded 24230 existing records. [2025-09-14T17:32:25.291460] [WARN ] [MAIN ] CRCL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:32:25.291722] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-09-14T17:32:25.291788] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-14T17:32:25.292399] [DEBUG] [LOCAL ] CRCL: Deleted primary data file. [2025-09-14T17:32:25.292462] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-09-14T17:32:25.367665] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-09-14T17:32:25.650186] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:32:26.158817] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-09-14T17:32:26.396866] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T17:32:26.617083] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T17:32:26.958824] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-02. [2025-09-14T17:32:27.231451] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:32:27.231848] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-02 [2025-09-14T17:32:27.568382] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T17:32:27.758825] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-09-14T17:32:28.558844] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-09-14T17:32:29.106259] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T17:32:29.109800] [INFO ] [REMOTE ] CR: Full fetch complete (26535 records). [2025-09-14T17:32:29.109900] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-09-14T17:32:29.361959] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-09-14T17:32:29.479588] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-09-14T17:32:29.479788] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-09-14T17:32:29.480484] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-09-14T17:32:29.480576] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-09-14T17:32:29.494243] [DEBUG] [LOCAL ] CR: Trimmed 26535 records to 18070 (keeping 150 days of data) [2025-09-14T17:32:29.516046] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-14T17:32:29.646935] [DEBUG] [LOCAL ] CR: Primary data saved (18070 records). [2025-09-14T17:32:29.647197] [INFO ] [MAIN ] CR: Full history saved. [2025-09-14T17:32:29.647398] [INFO ] [MAIN ] Update Progress: 526/2370 symbols completed. CR took 25.4s. Estimated remaining: 3h 13m 52s. Rate: 9.5 symbols/min [2025-09-14T17:32:29.815258] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:32:29.838674] [DEBUG] [LOCAL ] CRGY: Loaded 23347 existing records from primary storage. [2025-09-14T17:32:29.838870] [INFO ] [MAIN ] CRGY: Loaded 23347 existing records. [2025-09-14T17:32:30.013477] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:32:30.013763] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-09-14T17:32:30.013823] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-09-14T17:32:30.014418] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-09-14T17:32:30.014479] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-09-14T17:32:30.163964] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-09-14T17:32:30.379895] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:32:30.958860] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-09-14T17:32:31.135445] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T17:32:31.758819] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-09-14T17:32:31.806668] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-14T17:32:31.812441] [INFO ] [REMOTE ] CRBG: Full fetch complete (56886 records). [2025-09-14T17:32:31.812589] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-09-14T17:32:32.207885] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-09-14T17:32:32.208000] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-09-14T17:32:32.208724] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-09-14T17:32:32.208791] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-09-14T17:32:32.210048] [DEBUG] [LOCAL ] CRBG: Trimmed 56886 records to 39482 (keeping 150 days of data) [2025-09-14T17:32:32.461693] [DEBUG] [LOCAL ] CRBG: Primary data saved (39482 records). [2025-09-14T17:32:32.461948] [INFO ] [MAIN ] CRBG: Full history saved. [2025-09-14T17:32:32.462125] [INFO ] [MAIN ] Update Progress: 527/2370 symbols completed. CRBG took 22.5s. Estimated remaining: 3h 13m 33s. Rate: 9.5 symbols/min [2025-09-14T17:32:32.567147] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-03. [2025-09-14T17:32:32.646146] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:32:32.675298] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-14T17:32:32.704550] [DEBUG] [LOCAL ] CRH: Loaded 23889 existing records from primary storage. [2025-09-14T17:32:32.704778] [INFO ] [MAIN ] CRH: Loaded 23889 existing records. [2025-09-14T17:32:32.878292] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:32:32.878576] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-09-14T17:32:32.878637] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-14T17:32:32.879260] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-09-14T17:32:32.879330] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-09-14T17:32:32.910819] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:32:32.949721] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-03 [2025-09-14T17:32:33.243573] [INFO ] [REMOTE ] CRH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:32:33.358832] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-09-14T17:32:33.421286] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T17:32:34.158900] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-04. [2025-09-14T17:32:34.425474] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:32:34.425853] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-04 [2025-09-14T17:32:34.958874] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-05. [2025-09-14T17:32:35.174448] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-14T17:32:35.215214] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:32:35.215620] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-05 [2025-09-14T17:32:35.758812] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-06. [2025-09-14T17:32:36.558835] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-09-14T17:32:37.358842] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-09-14T17:32:38.068783] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-14T17:32:38.141366] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T17:32:38.158771] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-09-14T17:32:38.958785] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-09-14T17:32:39.513530] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-14T17:32:39.700850] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-14T17:32:39.758780] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-09-14T17:32:40.495191] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-14T17:32:40.558811] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-09-14T17:32:41.050399] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-14T17:32:41.358896] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-07. [2025-09-14T17:32:42.158805] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-09-14T17:32:42.595028] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-14T17:32:42.958836] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-09-14T17:32:43.758860] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-09-14T17:32:43.995379] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T17:32:44.095251] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-09-14T17:32:44.134564] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T17:32:44.558868] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-09-14T17:32:45.358849] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-08. [2025-09-14T17:32:45.715218] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-14T17:32:46.158891] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-09-14T17:32:46.348505] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T17:32:46.478093] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-14T17:32:46.484402] [INFO ] [REMOTE ] CRC: Full fetch complete (47759 records). [2025-09-14T17:32:46.484606] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-09-14T17:32:46.857702] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-09-14T17:32:46.857805] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-09-14T17:32:46.858450] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-09-14T17:32:46.858506] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-09-14T17:32:46.859570] [DEBUG] [LOCAL ] CRC: Trimmed 47759 records to 32978 (keeping 150 days of data) [2025-09-14T17:32:46.961405] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-09-14T17:32:47.084307] [DEBUG] [LOCAL ] CRC: Primary data saved (32978 records). [2025-09-14T17:32:47.084493] [INFO ] [MAIN ] CRC: Full history saved. [2025-09-14T17:32:47.084706] [INFO ] [MAIN ] Update Progress: 528/2370 symbols completed. CRC took 26.9s. Estimated remaining: 3h 13m 56s. Rate: 9.5 symbols/min [2025-09-14T17:32:47.253145] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:32:47.274424] [DEBUG] [LOCAL ] CRI: Loaded 22366 existing records from primary storage. [2025-09-14T17:32:47.274579] [INFO ] [MAIN ] CRI: Loaded 22366 existing records. [2025-09-14T17:32:47.449566] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:32:47.449839] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-09-14T17:32:47.449917] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-14T17:32:47.450455] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-09-14T17:32:47.450514] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-09-14T17:32:47.765704] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-09-14T17:32:47.801793] [INFO ] [REMOTE ] CRI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:32:47.978052] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-14T17:32:48.520245] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-14T17:32:48.558787] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-09. [2025-09-14T17:32:49.358839] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-09-14T17:32:49.631626] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-14T17:32:50.158859] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-09-14T17:32:50.958846] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-09-14T17:32:51.127745] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-14T17:32:51.133126] [INFO ] [REMOTE ] CRCL: Full fetch complete (26709 records). [2025-09-14T17:32:51.133221] [DEBUG] [VALIDATOR ] CRCL: Validating primary data. [2025-09-14T17:32:51.314926] [WARN ] [VALIDATOR ] CRCL: Validation failed - insufficient historical data. Have 69 unique days, need 150 days [2025-09-14T17:32:51.315401] [FATAL] [MAIN ] CRCL: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:32:51.315510] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:32:51.315759] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-14T17:32:51.315903] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-14T17:32:51.316012] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-09-14T17:32:51.316121] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-09-14T17:32:51.316305] [INFO ] [MAIN ] Update Progress: 529/2370 symbols completed. CRCL took 26.4s. Estimated remaining: 3h 13m 42s. Rate: 9.5 symbols/min [2025-09-14T17:32:51.497380] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:32:51.529056] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-14T17:32:51.556934] [DEBUG] [LOCAL ] CRK: Loaded 23345 existing records from primary storage. [2025-09-14T17:32:51.557088] [INFO ] [MAIN ] CRK: Loaded 23345 existing records. [2025-09-14T17:32:51.731988] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:32:51.732233] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-09-14T17:32:51.732290] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-09-14T17:32:51.732892] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-09-14T17:32:51.732954] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-09-14T17:32:51.763938] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-09-14T17:32:52.099733] [INFO ] [REMOTE ] CRK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:32:52.129234] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-14T17:32:52.465060] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T17:32:52.558840] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-09-14T17:32:53.358922] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-09-14T17:32:53.512085] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T17:32:54.022703] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T17:32:54.158817] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-09-14T17:32:54.958875] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-09-14T17:32:55.121503] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T17:32:55.631042] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T17:32:55.758825] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-09-14T17:32:56.558835] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-09-14T17:32:56.683331] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T17:32:57.358807] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-09-14T17:32:57.437768] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T17:32:58.016242] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T17:32:58.023717] [INFO ] [REMOTE ] CRGY: Full fetch complete (57020 records). [2025-09-14T17:32:58.023886] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-09-14T17:32:58.166241] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-09-14T17:32:58.408849] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-14T17:32:58.431998] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-09-14T17:32:58.432227] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-09-14T17:32:58.433002] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-09-14T17:32:58.433069] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-09-14T17:32:58.433150] [INFO ] [REMOTE ] CRH: Full fetch complete (58174 records). [2025-09-14T17:32:58.433506] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-09-14T17:32:58.524022] [DEBUG] [LOCAL ] CRGY: Trimmed 57020 records to 39368 (keeping 150 days of data) [2025-09-14T17:32:58.942393] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-09-14T17:32:58.944392] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-09-14T17:32:58.945917] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-09-14T17:32:58.946485] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-09-14T17:32:58.950313] [DEBUG] [LOCAL ] CRH: Trimmed 58174 records to 40240 (keeping 150 days of data) [2025-09-14T17:32:59.010826] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-09-14T17:32:59.210657] [DEBUG] [LOCAL ] CRGY: Primary data saved (39368 records). [2025-09-14T17:32:59.212959] [INFO ] [MAIN ] CRGY: Full history saved. [2025-09-14T17:32:59.213140] [INFO ] [MAIN ] Update Progress: 530/2370 symbols completed. CRGY took 29.6s. Estimated remaining: 3h 13m 42s. Rate: 9.5 symbols/min [2025-09-14T17:32:59.491085] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:32:59.515396] [DEBUG] [LOCAL ] CRL: Loaded 17947 existing records from primary storage. [2025-09-14T17:32:59.516533] [INFO ] [MAIN ] CRL: Loaded 17947 existing records. [2025-09-14T17:32:59.700955] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:32:59.702930] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-09-14T17:32:59.703981] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-14T17:32:59.705102] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-09-14T17:32:59.705719] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-09-14T17:32:59.864012] [DEBUG] [LOCAL ] CRH: Primary data saved (40240 records). [2025-09-14T17:32:59.928496] [INFO ] [MAIN ] CRH: Full history saved. [2025-09-14T17:32:59.957368] [INFO ] [MAIN ] Update Progress: 531/2370 symbols completed. CRH took 27.5s. Estimated remaining: 3h 13m 16s. Rate: 9.5 symbols/min [2025-09-14T17:33:00.189296] [INFO ] [REMOTE ] CRL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:33:00.243354] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:33:00.240772] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-09-14T17:33:00.276972] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-14T17:33:00.306275] [DEBUG] [LOCAL ] CRM: Loaded 24134 existing records from primary storage. [2025-09-14T17:33:00.306458] [INFO ] [MAIN ] CRM: Loaded 24134 existing records. [2025-09-14T17:33:00.479457] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:33:00.479733] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-09-14T17:33:00.479797] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-09-14T17:33:00.480510] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-09-14T17:33:00.480570] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-09-14T17:33:00.568807] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-09-14T17:33:00.831936] [INFO ] [REMOTE ] CRM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:33:01.020493] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-14T17:33:01.358862] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-09-14T17:33:02.201983] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-09-14T17:33:02.205075] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-14T17:33:02.467912] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-14T17:33:02.958902] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-09-14T17:33:03.758883] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-09-14T17:33:04.716469] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (3.36 seconds). [2025-09-14T17:33:04.727092] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-09-14T17:33:05.163929] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (2.96 seconds). [2025-09-14T17:33:05.358910] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-09-14T17:33:05.503654] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-14T17:33:05.547081] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T17:33:06.158842] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-09-14T17:33:06.958934] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-09-14T17:33:07.142285] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-14T17:33:07.185368] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-14T17:33:07.583778] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-14T17:33:07.758835] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-09-14T17:33:08.558846] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-09-14T17:33:08.768668] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T17:33:09.358953] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-09-14T17:33:10.025028] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-14T17:33:10.158846] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-09-14T17:33:10.416524] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T17:33:10.483673] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-14T17:33:10.488818] [INFO ] [REMOTE ] CRI: Full fetch complete (54157 records). [2025-09-14T17:33:10.488953] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-09-14T17:33:10.864457] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-09-14T17:33:10.864574] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-09-14T17:33:10.865292] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-09-14T17:33:10.865349] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-09-14T17:33:10.866543] [DEBUG] [LOCAL ] CRI: Trimmed 54157 records to 37683 (keeping 150 days of data) [2025-09-14T17:33:10.959022] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-09-14T17:33:11.111718] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-14T17:33:11.143882] [DEBUG] [LOCAL ] CRI: Primary data saved (37683 records). [2025-09-14T17:33:11.144074] [INFO ] [MAIN ] CRI: Full history saved. [2025-09-14T17:33:11.144182] [INFO ] [MAIN ] Update Progress: 532/2370 symbols completed. CRI took 24.1s. Estimated remaining: 3h 13m 27s. Rate: 9.5 symbols/min [2025-09-14T17:33:11.313052] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:33:11.332076] [DEBUG] [LOCAL ] CRS: Loaded 18766 existing records from primary storage. [2025-09-14T17:33:11.332260] [INFO ] [MAIN ] CRS: Loaded 18766 existing records. [2025-09-14T17:33:11.509323] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:33:11.509581] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-09-14T17:33:11.509660] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-09-14T17:33:11.510221] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-09-14T17:33:11.510285] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-09-14T17:33:11.763894] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-09-14T17:33:11.866683] [INFO ] [REMOTE ] CRS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:33:12.558826] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-09-14T17:33:13.358890] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-09-14T17:33:13.399590] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T17:33:13.440521] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-14T17:33:14.158790] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-09-14T17:33:14.305978] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T17:33:14.958852] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-09-14T17:33:15.388140] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-14T17:33:15.758871] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-09-14T17:33:16.558846] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-09-14T17:33:16.677991] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-14T17:33:16.683349] [INFO ] [REMOTE ] CRK: Full fetch complete (56619 records). [2025-09-14T17:33:16.683497] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-09-14T17:33:17.088391] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-09-14T17:33:17.088559] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-09-14T17:33:17.089773] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-09-14T17:33:17.089851] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-09-14T17:33:17.091832] [DEBUG] [LOCAL ] CRK: Trimmed 56619 records to 39134 (keeping 150 days of data) [2025-09-14T17:33:17.372726] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (3.21 seconds). [2025-09-14T17:33:17.408942] [DEBUG] [LOCAL ] CRK: Primary data saved (39134 records). [2025-09-14T17:33:17.409893] [INFO ] [MAIN ] CRK: Full history saved. [2025-09-14T17:33:17.411068] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-09-14T17:33:17.410400] [INFO ] [MAIN ] Update Progress: 533/2370 symbols completed. CRK took 26.1s. Estimated remaining: 3h 13m 20s. Rate: 9.5 symbols/min [2025-09-14T17:33:17.584746] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:33:17.612444] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-09-14T17:33:17.612618] [DEBUG] [LOCAL ] CRT: Loaded 2143 existing records from primary storage. [2025-09-14T17:33:17.612863] [INFO ] [MAIN ] CRT: Loaded 2143 existing records. [2025-09-14T17:33:17.807322] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:33:17.807685] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-09-14T17:33:17.807767] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-09-14T17:33:17.808023] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-09-14T17:33:17.808098] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-09-14T17:33:18.168566] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-09-14T17:33:18.209878] [INFO ] [REMOTE ] CRT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:33:18.241489] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-14T17:33:18.958836] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-09-14T17:33:19.738139] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-14T17:33:19.765400] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-09-14T17:33:19.771665] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-14T17:33:19.933858] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-14T17:33:20.558840] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-09-14T17:33:21.151712] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-14T17:33:21.358853] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-09-14T17:33:21.416543] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-14T17:33:21.666842] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T17:33:21.671166] [INFO ] [REMOTE ] CRL: Full fetch complete (48278 records). [2025-09-14T17:33:21.671289] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-09-14T17:33:22.059047] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-09-14T17:33:22.059168] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-09-14T17:33:22.059924] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-09-14T17:33:22.059987] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-09-14T17:33:22.061101] [DEBUG] [LOCAL ] CRL: Trimmed 48278 records to 31895 (keeping 150 days of data) [2025-09-14T17:33:22.161619] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-09-14T17:33:22.255687] [DEBUG] [LOCAL ] CRL: Primary data saved (31895 records). [2025-09-14T17:33:22.255867] [INFO ] [MAIN ] CRL: Full history saved. [2025-09-14T17:33:22.255967] [INFO ] [MAIN ] Update Progress: 534/2370 symbols completed. CRL took 23.0s. Estimated remaining: 3h 13m 9s. Rate: 9.5 symbols/min [2025-09-14T17:33:22.426129] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:33:22.443885] [DEBUG] [LOCAL ] CSAN: Loaded 18803 existing records from primary storage. [2025-09-14T17:33:22.444042] [INFO ] [MAIN ] CSAN: Loaded 18803 existing records. [2025-09-14T17:33:22.625031] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:33:22.625278] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-09-14T17:33:22.625342] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-09-14T17:33:22.625837] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-09-14T17:33:22.625904] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-09-14T17:33:22.924212] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-14T17:33:22.964502] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-09-14T17:33:22.993346] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:33:23.758821] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-09-14T17:33:24.558881] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-09-14T17:33:24.808099] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T17:33:25.358837] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-09-14T17:33:26.158888] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-09-14T17:33:26.340974] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T17:33:26.660454] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.90 seconds). [2025-09-14T17:33:26.880204] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-14T17:33:26.958773] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-09-14T17:33:27.047203] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T17:33:27.644290] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T17:33:27.649873] [INFO ] [REMOTE ] CRM: Full fetch complete (58448 records). [2025-09-14T17:33:27.650018] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-09-14T17:33:27.763873] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-09-14T17:33:28.039888] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-09-14T17:33:28.040027] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-09-14T17:33:28.040859] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-09-14T17:33:28.040932] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-09-14T17:33:28.042242] [DEBUG] [LOCAL ] CRM: Trimmed 58448 records to 40510 (keeping 150 days of data) [2025-09-14T17:33:28.298696] [DEBUG] [LOCAL ] CRM: Primary data saved (40510 records). [2025-09-14T17:33:28.298858] [INFO ] [MAIN ] CRM: Full history saved. [2025-09-14T17:33:28.298953] [INFO ] [MAIN ] Update Progress: 535/2370 symbols completed. CRM took 28.3s. Estimated remaining: 3h 13m 1s. Rate: 9.5 symbols/min [2025-09-14T17:33:28.465329] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:33:28.480781] [DEBUG] [LOCAL ] CSL: Loaded 13838 existing records from primary storage. [2025-09-14T17:33:28.480949] [INFO ] [MAIN ] CSL: Loaded 13838 existing records. [2025-09-14T17:33:28.563955] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-09-14T17:33:28.658420] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:33:28.658735] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-09-14T17:33:28.658799] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-09-14T17:33:28.659505] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-09-14T17:33:28.659569] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-09-14T17:33:29.010204] [INFO ] [REMOTE ] CSL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:33:29.106268] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-14T17:33:29.358842] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-09-14T17:33:29.534580] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T17:33:30.012502] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-14T17:33:30.158901] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-09-14T17:33:30.761675] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-14T17:33:30.958875] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-09-14T17:33:31.758828] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-09-14T17:33:32.355232] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T17:33:32.356577] [INFO ] [REMOTE ] CRT: Full fetch complete (5367 records). [2025-09-14T17:33:32.356695] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-09-14T17:33:32.566771] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-09-14T17:33:32.763127] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-09-14T17:33:32.764777] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T17:33:32.764892] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-09-14T17:33:32.774339] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-09-14T17:33:32.774617] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-09-14T17:33:32.783785] [DEBUG] [LOCAL ] CRT: Trimmed 5367 records to 3442 (keeping 150 days of data) [2025-09-14T17:33:32.807081] [DEBUG] [LOCAL ] CRT: Primary data saved (3442 records). [2025-09-14T17:33:32.807217] [INFO ] [MAIN ] CRT: Full history saved. [2025-09-14T17:33:32.807337] [INFO ] [MAIN ] Update Progress: 536/2370 symbols completed. CRT took 15.4s. Estimated remaining: 3h 12m 49s. Rate: 9.5 symbols/min [2025-09-14T17:33:32.976373] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:33:32.983836] [DEBUG] [LOCAL ] CSR: Loaded 5736 existing records from primary storage. [2025-09-14T17:33:32.983980] [INFO ] [MAIN ] CSR: Loaded 5736 existing records. [2025-09-14T17:33:33.156767] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:33:33.157067] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-09-14T17:33:33.157129] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-09-14T17:33:33.157473] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-09-14T17:33:33.157532] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-09-14T17:33:33.363972] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-09-14T17:33:33.510385] [INFO ] [REMOTE ] CSR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:33:33.866104] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T17:33:33.870704] [INFO ] [REMOTE ] CRS: Full fetch complete (47445 records). [2025-09-14T17:33:33.870810] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-09-14T17:33:34.167791] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-09-14T17:33:34.264409] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-09-14T17:33:34.264566] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-09-14T17:33:34.265571] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-09-14T17:33:34.265745] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-09-14T17:33:34.267134] [DEBUG] [LOCAL ] CRS: Trimmed 47445 records to 32697 (keeping 150 days of data) [2025-09-14T17:33:34.291505] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T17:33:34.510508] [DEBUG] [LOCAL ] CRS: Primary data saved (32697 records). [2025-09-14T17:33:34.510716] [INFO ] [MAIN ] CRS: Full history saved. [2025-09-14T17:33:34.510828] [INFO ] [MAIN ] Update Progress: 537/2370 symbols completed. CRS took 23.4s. Estimated remaining: 3h 12m 27s. Rate: 9.5 symbols/min [2025-09-14T17:33:34.696572] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:33:34.718874] [DEBUG] [LOCAL ] CSTM: Loaded 20930 existing records from primary storage. [2025-09-14T17:33:34.719051] [INFO ] [MAIN ] CSTM: Loaded 20930 existing records. [2025-09-14T17:33:34.903430] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:33:34.903707] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-09-14T17:33:34.903767] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-09-14T17:33:34.904413] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-09-14T17:33:34.904472] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-09-14T17:33:34.971481] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-09-14T17:33:35.235804] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T17:33:35.296923] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:33:35.758857] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-09-14T17:33:36.366990] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-14T17:33:36.558812] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-09-14T17:33:36.663490] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-14T17:33:37.358875] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-09-14T17:33:38.068714] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T17:33:38.158794] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-09-14T17:33:38.536343] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-14T17:33:38.958830] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-09-14T17:33:39.605504] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-14T17:33:39.758827] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-09-14T17:33:40.279415] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-14T17:33:40.558855] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-09-14T17:33:41.214015] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T17:33:41.358866] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-09-14T17:33:42.163887] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-09-14T17:33:42.186370] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T17:33:42.648562] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T17:33:42.958843] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-09-14T17:33:43.758889] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-09-14T17:33:43.792778] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T17:33:44.304319] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-14T17:33:44.558914] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-09-14T17:33:45.097662] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T17:33:45.358799] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-09-14T17:33:45.588610] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T17:33:46.158836] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-09-14T17:33:46.968771] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-09-14T17:33:46.996372] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-14T17:33:47.682227] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T17:33:47.758947] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-09-14T17:33:47.887382] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-14T17:33:48.558913] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-09-14T17:33:48.996345] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-14T17:33:49.358844] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-09-14T17:33:49.448582] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-14T17:33:50.158834] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-09-14T17:33:50.958831] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-09-14T17:33:51.001618] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T17:33:51.151784] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T17:33:51.758828] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-09-14T17:33:52.301259] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-14T17:33:52.558830] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-09-14T17:33:53.179766] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-14T17:33:53.184497] [INFO ] [REMOTE ] CSAN: Full fetch complete (45465 records). [2025-09-14T17:33:53.184612] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-09-14T17:33:53.363717] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-09-14T17:33:53.575890] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-09-14T17:33:53.576314] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-09-14T17:33:53.577234] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-09-14T17:33:53.577408] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-09-14T17:33:53.587465] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-14T17:33:53.591729] [DEBUG] [LOCAL ] CSAN: Trimmed 45465 records to 31822 (keeping 150 days of data) [2025-09-14T17:33:53.792293] [DEBUG] [LOCAL ] CSAN: Primary data saved (31822 records). [2025-09-14T17:33:53.792487] [INFO ] [MAIN ] CSAN: Full history saved. [2025-09-14T17:33:53.792621] [INFO ] [MAIN ] Update Progress: 538/2370 symbols completed. CSAN took 31.5s. Estimated remaining: 3h 13m 5s. Rate: 9.5 symbols/min [2025-09-14T17:33:53.969367] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:33:53.978949] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T17:33:53.983985] [INFO ] [REMOTE ] CSL: Full fetch complete (34077 records). [2025-09-14T17:33:53.984136] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-09-14T17:33:54.029902] [DEBUG] [LOCAL ] CSV: Loaded 5241 existing records from primary storage. [2025-09-14T17:33:54.066800] [INFO ] [MAIN ] CSV: Loaded 5241 existing records. [2025-09-14T17:33:54.161350] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-09-14T17:33:54.417992] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:33:54.451461] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-09-14T17:33:54.451564] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-09-14T17:33:54.472891] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-09-14T17:33:54.506821] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-09-14T17:33:54.570011] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-09-14T17:33:54.602011] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-09-14T17:33:54.602543] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-09-14T17:33:54.608135] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-09-14T17:33:54.645445] [DEBUG] [LOCAL ] CSL: Trimmed 34077 records to 22559 (keeping 150 days of data) [2025-09-14T17:33:54.931834] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T17:33:54.937409] [INFO ] [REMOTE ] CSR: Full fetch complete (13213 records). [2025-09-14T17:33:54.938042] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-09-14T17:33:54.968136] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-09-14T17:33:55.121748] [INFO ] [REMOTE ] CSV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:33:55.572179] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-09-14T17:33:55.574248] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-09-14T17:33:55.576377] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-09-14T17:33:55.578590] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-09-14T17:33:55.578429] [DEBUG] [LOCAL ] CSL: Primary data saved (22559 records). [2025-09-14T17:33:55.579685] [INFO ] [MAIN ] CSL: Full history saved. [2025-09-14T17:33:55.580319] [INFO ] [MAIN ] Update Progress: 539/2370 symbols completed. CSL took 27.3s. Estimated remaining: 3h 12m 43s. Rate: 9.5 symbols/min [2025-09-14T17:33:55.580129] [DEBUG] [LOCAL ] CSR: Trimmed 13213 records to 9762 (keeping 150 days of data) [2025-09-14T17:33:55.764013] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-09-14T17:33:55.952492] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:33:55.972141] [DEBUG] [LOCAL ] CSW: Loaded 6733 existing records from primary storage. [2025-09-14T17:33:55.972374] [INFO ] [MAIN ] CSW: Loaded 6733 existing records. [2025-09-14T17:33:56.053958] [DEBUG] [LOCAL ] CSR: Primary data saved (9762 records). [2025-09-14T17:33:56.113509] [INFO ] [MAIN ] CSR: Full history saved. [2025-09-14T17:33:56.143784] [INFO ] [MAIN ] Update Progress: 540/2370 symbols completed. CSR took 23.3s. Estimated remaining: 3h 12m 17s. Rate: 9.5 symbols/min [2025-09-14T17:33:56.370624] [WARN ] [MAIN ] CSW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:33:56.408916] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-09-14T17:33:56.440270] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-14T17:33:56.440166] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:33:56.441004] [DEBUG] [LOCAL ] CSW: Deleted primary data file. [2025-09-14T17:33:56.441136] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-09-14T17:33:56.541294] [DEBUG] [LOCAL ] CTBB: Loaded 3052 existing records from primary storage. [2025-09-14T17:33:56.578005] [INFO ] [MAIN ] CTBB: Loaded 3052 existing records. [2025-09-14T17:33:56.913319] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-14T17:33:56.937419] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:33:56.976892] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-09-14T17:33:56.998132] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-09-14T17:33:57.061230] [INFO ] [REMOTE ] CSW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:33:57.061610] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-09-14T17:33:57.062376] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-09-14T17:33:57.062801] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-14T17:33:57.067089] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-09-14T17:33:57.363981] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-02. [2025-09-14T17:33:57.437935] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:33:57.694117] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:33:57.694563] [WARN ] [REMOTE ] CSW: No data returned for month 2025-02 [2025-09-14T17:33:58.158825] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-09-14T17:33:58.776712] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T17:33:58.795639] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-14T17:33:58.958876] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-09-14T17:33:59.758817] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-03. [2025-09-14T17:33:59.828146] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T17:34:00.019184] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:34:00.019527] [WARN ] [REMOTE ] CSW: No data returned for month 2025-03 [2025-09-14T17:34:00.558831] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-09-14T17:34:01.358854] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-09-14T17:34:02.158796] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-04. [2025-09-14T17:34:02.414924] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:34:02.415211] [WARN ] [REMOTE ] CSW: No data returned for month 2025-04 [2025-09-14T17:34:02.522755] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T17:34:02.550984] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-14T17:34:02.958893] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-09-14T17:34:03.758895] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-09-14T17:34:04.429617] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-14T17:34:04.435079] [INFO ] [REMOTE ] CSTM: Full fetch complete (52297 records). [2025-09-14T17:34:04.435263] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-09-14T17:34:04.563911] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-09-14T17:34:04.846210] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-09-14T17:34:04.846715] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T17:34:04.846844] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-09-14T17:34:04.851349] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-09-14T17:34:04.851822] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-09-14T17:34:04.853390] [DEBUG] [LOCAL ] CSTM: Trimmed 52297 records to 35715 (keeping 150 days of data) [2025-09-14T17:34:05.065706] [DEBUG] [LOCAL ] CSTM: Primary data saved (35715 records). [2025-09-14T17:34:05.065882] [INFO ] [MAIN ] CSTM: Full history saved. [2025-09-14T17:34:05.065989] [INFO ] [MAIN ] Update Progress: 541/2370 symbols completed. CSTM took 30.6s. Estimated remaining: 3h 12m 20s. Rate: 9.5 symbols/min [2025-09-14T17:34:05.234112] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:34:05.238688] [DEBUG] [LOCAL ] CTDD: Loaded 2446 existing records from primary storage. [2025-09-14T17:34:05.238797] [INFO ] [MAIN ] CTDD: Loaded 2446 existing records. [2025-09-14T17:34:05.363936] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-05. [2025-09-14T17:34:05.418093] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:34:05.418341] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-09-14T17:34:05.418404] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-09-14T17:34:05.418680] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-09-14T17:34:05.418747] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-09-14T17:34:05.588137] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-14T17:34:05.707823] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:34:05.710885] [WARN ] [REMOTE ] CSW: No data returned for month 2025-05 [2025-09-14T17:34:05.792098] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:34:06.158956] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-09-14T17:34:06.719134] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-14T17:34:06.958858] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-09-14T17:34:07.678466] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-14T17:34:07.758824] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-09-14T17:34:08.558841] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-09-14T17:34:08.574331] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T17:34:09.358828] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-09-14T17:34:09.396414] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-14T17:34:10.056096] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-14T17:34:10.158830] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-06. [2025-09-14T17:34:10.942561] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-14T17:34:10.958770] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-09-14T17:34:11.758856] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-09-14T17:34:12.085711] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-14T17:34:12.555833] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-14T17:34:12.558827] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-09-14T17:34:13.358834] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-07. [2025-09-14T17:34:13.394467] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-14T17:34:14.158854] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-09-14T17:34:14.510558] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T17:34:14.958859] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-08. [2025-09-14T17:34:15.067608] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-14T17:34:15.758823] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-09-14T17:34:16.039441] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-14T17:34:16.558874] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-09-14T17:34:16.851335] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T17:34:17.184126] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-14T17:34:17.358838] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-09-14T17:34:17.802409] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-14T17:34:18.158828] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-09-14T17:34:18.924019] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T17:34:18.926108] [INFO ] [REMOTE ] CSV: Full fetch complete (14438 records). [2025-09-14T17:34:18.926200] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-09-14T17:34:18.963896] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-09. [2025-09-14T17:34:19.287424] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-09-14T17:34:19.287525] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-09-14T17:34:19.287883] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-09-14T17:34:19.287948] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-09-14T17:34:19.288466] [DEBUG] [LOCAL ] CSV: Trimmed 14438 records to 9150 (keeping 150 days of data) [2025-09-14T17:34:19.343091] [DEBUG] [LOCAL ] CSV: Primary data saved (9150 records). [2025-09-14T17:34:19.343237] [INFO ] [MAIN ] CSV: Full history saved. [2025-09-14T17:34:19.343333] [INFO ] [MAIN ] Update Progress: 542/2370 symbols completed. CSV took 25.6s. Estimated remaining: 3h 12m 40s. Rate: 9.5 symbols/min [2025-09-14T17:34:19.511615] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:34:19.511873] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-09-14T17:34:19.511924] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-09-14T17:34:19.512143] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-09-14T17:34:19.512197] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-14T17:34:19.512278] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-14T17:34:19.512327] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-09-14T17:34:19.759480] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-09-14T17:34:19.802713] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-14T17:34:19.831178] [INFO ] [REMOTE ] CSW: Full fetch complete (7075 records). [2025-09-14T17:34:19.866491] [DEBUG] [VALIDATOR ] CSW: Validating primary data. [2025-09-14T17:34:19.955598] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:34:20.064277] [WARN ] [VALIDATOR ] CSW: Validation failed - insufficient historical data. Have 67 unique days, need 150 days [2025-09-14T17:34:20.064538] [FATAL] [MAIN ] CSW: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:34:20.064592] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:34:20.064667] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-14T17:34:20.064744] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-14T17:34:20.064794] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-09-14T17:34:20.064855] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-09-14T17:34:20.064963] [INFO ] [MAIN ] Update Progress: 543/2370 symbols completed. CSW took 24.5s. Estimated remaining: 3h 12m 15s. Rate: 9.5 symbols/min [2025-09-14T17:34:20.245236] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:34:20.253677] [DEBUG] [LOCAL ] CTEV: Loaded 6401 existing records from primary storage. [2025-09-14T17:34:20.253810] [INFO ] [MAIN ] CTEV: Loaded 6401 existing records. [2025-09-14T17:34:20.427108] [WARN ] [MAIN ] CTEV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:34:20.427363] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-09-14T17:34:20.427424] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-14T17:34:20.427781] [DEBUG] [LOCAL ] CTEV: Deleted primary data file. [2025-09-14T17:34:20.427843] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-09-14T17:34:20.580581] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-02. [2025-09-14T17:34:20.581561] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T17:34:20.792633] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:34:20.891230] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:34:20.891568] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-02 [2025-09-14T17:34:21.358849] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-09-14T17:34:22.041715] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:34:22.043109] [INFO ] [REMOTE ] CTBB: Full fetch complete (7938 records). [2025-09-14T17:34:22.043198] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-09-14T17:34:22.163989] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-03. [2025-09-14T17:34:22.407513] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-09-14T17:34:22.407617] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-09-14T17:34:22.407958] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-09-14T17:34:22.408034] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-09-14T17:34:22.408487] [DEBUG] [LOCAL ] CTBB: Trimmed 7938 records to 4859 (keeping 150 days of data) [2025-09-14T17:34:22.439103] [DEBUG] [LOCAL ] CTBB: Primary data saved (4859 records). [2025-09-14T17:34:22.439256] [INFO ] [MAIN ] CTBB: Full history saved. [2025-09-14T17:34:22.439373] [INFO ] [MAIN ] Update Progress: 544/2370 symbols completed. CTBB took 26.3s. Estimated remaining: 3h 11m 56s. Rate: 9.5 symbols/min [2025-09-14T17:34:22.503466] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:34:22.541751] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-03 [2025-09-14T17:34:22.612212] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:34:22.627016] [DEBUG] [LOCAL ] CTO: Loaded 12493 existing records from primary storage. [2025-09-14T17:34:22.627189] [INFO ] [MAIN ] CTO: Loaded 12493 existing records. [2025-09-14T17:34:22.808085] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:34:22.808331] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-09-14T17:34:22.808391] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-09-14T17:34:22.808950] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-09-14T17:34:22.809017] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-09-14T17:34:22.963944] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-04. [2025-09-14T17:34:23.188598] [INFO ] [REMOTE ] CTO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:34:23.333313] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:34:23.333669] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-04 [2025-09-14T17:34:23.758836] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-02. [2025-09-14T17:34:24.100213] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-14T17:34:24.558875] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-03. [2025-09-14T17:34:25.358839] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-09-14T17:34:25.511431] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-14T17:34:26.158828] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-04. [2025-09-14T17:34:26.586301] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-14T17:34:26.908532] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-14T17:34:26.958841] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-09-14T17:34:27.758829] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-05. [2025-09-14T17:34:28.239631] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-14T17:34:28.473502] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T17:34:28.558824] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-06. [2025-09-14T17:34:28.799571] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-14T17:34:29.358925] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-09-14T17:34:30.029433] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-14T17:34:30.158847] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-07. [2025-09-14T17:34:30.398258] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-14T17:34:30.958828] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-08. [2025-09-14T17:34:31.178818] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:34:31.179188] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-08 [2025-09-14T17:34:31.758894] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-05. [2025-09-14T17:34:32.558813] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-09-14T17:34:32.750192] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T17:34:33.358859] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-09-14T17:34:33.808113] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-14T17:34:34.102452] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-14T17:34:34.158834] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-09-14T17:34:34.740869] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T17:34:34.742283] [INFO ] [REMOTE ] CTDD: Full fetch complete (6227 records). [2025-09-14T17:34:34.742702] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-09-14T17:34:34.964017] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-09-14T17:34:35.103062] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-09-14T17:34:35.103169] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-09-14T17:34:35.103347] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-09-14T17:34:35.103406] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-09-14T17:34:35.103858] [DEBUG] [LOCAL ] CTDD: Trimmed 6227 records to 3852 (keeping 150 days of data) [2025-09-14T17:34:35.128194] [DEBUG] [LOCAL ] CTDD: Primary data saved (3852 records). [2025-09-14T17:34:35.128288] [INFO ] [MAIN ] CTDD: Full history saved. [2025-09-14T17:34:35.128392] [INFO ] [MAIN ] Update Progress: 545/2370 symbols completed. CTDD took 30.1s. Estimated remaining: 3h 12m 11s. Rate: 9.5 symbols/min [2025-09-14T17:34:35.301934] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:34:35.317815] [DEBUG] [LOCAL ] CTOS: Loaded 15798 existing records from primary storage. [2025-09-14T17:34:35.317993] [INFO ] [MAIN ] CTOS: Loaded 15798 existing records. [2025-09-14T17:34:35.491524] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:34:35.491824] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-09-14T17:34:35.491897] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-09-14T17:34:35.492458] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-09-14T17:34:35.492550] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-09-14T17:34:35.764074] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-09. [2025-09-14T17:34:35.851706] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:34:36.039132] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:34:36.039483] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-09 [2025-09-14T17:34:36.039571] [INFO ] [REMOTE ] CTEST: Full fetch complete (1020 records). [2025-09-14T17:34:36.039665] [DEBUG] [VALIDATOR ] CTEST: Validating primary data. [2025-09-14T17:34:36.040305] [FATAL] [VALIDATOR ] CTEST: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-12). Symbol may be delisted or halted. [2025-09-14T17:34:36.040459] [FATAL] [MAIN ] CTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:34:36.040516] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:34:36.040564] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-14T17:34:36.040632] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-14T17:34:36.040702] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-09-14T17:34:36.040839] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-09-14T17:34:36.040925] [INFO ] [MAIN ] Update Progress: 546/2370 symbols completed. CTEST took 16.7s. Estimated remaining: 3h 11m 46s. Rate: 9.5 symbols/min [2025-09-14T17:34:36.239441] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:34:36.255872] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-14T17:34:36.283471] [DEBUG] [LOCAL ] CTRA: Loaded 24015 existing records from primary storage. [2025-09-14T17:34:36.283830] [INFO ] [MAIN ] CTRA: Loaded 24015 existing records. [2025-09-14T17:34:36.474126] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:34:36.474479] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-09-14T17:34:36.474574] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-09-14T17:34:36.475407] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-09-14T17:34:36.475492] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-09-14T17:34:36.564067] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-06. [2025-09-14T17:34:36.843775] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:34:37.358860] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-09-14T17:34:37.563578] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-14T17:34:38.158858] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-09-14T17:34:38.437336] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-14T17:34:38.958928] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-09-14T17:34:39.453864] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-14T17:34:39.758885] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-07. [2025-09-14T17:34:40.078271] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T17:34:40.369195] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-14T17:34:40.558898] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-09-14T17:34:41.358872] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-09-14T17:34:41.457035] [DEBUG] [REMOTE ] CTO: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-14T17:34:41.457404] [WARN ] [REMOTE ] CTO: No data returned for month 2025-07 [2025-09-14T17:34:42.158847] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-09-14T17:34:42.528628] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-14T17:34:42.958839] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-09-14T17:34:43.061015] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T17:34:43.758852] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-09-14T17:34:44.558874] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-08. [2025-09-14T17:34:45.014368] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-14T17:34:45.358841] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-09-14T17:34:45.406275] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-14T17:34:45.599727] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-14T17:34:46.158815] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-09. [2025-09-14T17:34:46.338225] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T17:34:46.341346] [INFO ] [REMOTE ] CTO: Full fetch complete (26678 records). [2025-09-14T17:34:46.341477] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-09-14T17:34:46.537738] [WARN ] [VALIDATOR ] CTO: Validation failed - insufficient historical data. Have 128 unique days, need 150 days [2025-09-14T17:34:46.538183] [FATAL] [MAIN ] CTO: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:34:46.538243] [WARN ] [MAIN ] CTO: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:34:46.538310] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-09-14T17:34:46.538391] [DEBUG] [LOCAL ] CTO: No primary data file found to delete. [2025-09-14T17:34:46.538443] [INFO ] [LOCAL ] CTO: Starting deletion of derivative data. [2025-09-14T17:34:46.538497] [DEBUG] [LOCAL ] CTO: No derivative data file found to delete. [2025-09-14T17:34:46.538597] [INFO ] [MAIN ] Update Progress: 547/2370 symbols completed. CTO took 24.1s. Estimated remaining: 3h 11m 54s. Rate: 9.5 symbols/min [2025-09-14T17:34:46.716131] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:34:46.739811] [DEBUG] [LOCAL ] CTRE: Loaded 22554 existing records from primary storage. [2025-09-14T17:34:46.739981] [INFO ] [MAIN ] CTRE: Loaded 22554 existing records. [2025-09-14T17:34:46.868354] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:34:46.908853] [INFO ] [REMOTE ] CTEV: Full fetch complete (12880 records). [2025-09-14T17:34:46.925344] [DEBUG] [VALIDATOR ] CTEV: Validating primary data. [2025-09-14T17:34:46.928920] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:34:46.962056] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-09-14T17:34:47.000139] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-09-14T17:34:47.034496] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-09-14T17:34:47.035460] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-09-14T17:34:47.056369] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-09-14T17:34:47.196292] [WARN ] [VALIDATOR ] CTEV: Validation failed - insufficient historical data. Have 136 unique days, need 150 days [2025-09-14T17:34:47.220873] [FATAL] [MAIN ] CTEV: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:34:47.221539] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:34:47.221605] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-14T17:34:47.222146] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-14T17:34:47.232911] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-09-14T17:34:47.243253] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-09-14T17:34:47.270187] [INFO ] [MAIN ] Update Progress: 548/2370 symbols completed. CTEV took 27.2s. Estimated remaining: 3h 11m 29s. Rate: 9.5 symbols/min [2025-09-14T17:34:47.657116] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:34:47.674831] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:34:47.697305] [DEBUG] [LOCAL ] CTRI: Loaded 19235 existing records from primary storage. [2025-09-14T17:34:47.697511] [INFO ] [MAIN ] CTRI: Loaded 19235 existing records. [2025-09-14T17:34:47.764060] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-09-14T17:34:47.886857] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:34:47.887184] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-09-14T17:34:47.887272] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-09-14T17:34:47.887949] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-09-14T17:34:47.888034] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-09-14T17:34:48.239016] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:34:48.508429] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T17:34:48.559103] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-09-14T17:34:49.358983] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-09-14T17:34:49.509533] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T17:34:49.863241] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-14T17:34:50.158877] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-09-14T17:34:50.807225] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-14T17:34:50.958942] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-09-14T17:34:51.296799] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-14T17:34:51.758906] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-09-14T17:34:52.558845] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-09-14T17:34:52.720521] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T17:34:53.358813] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-09-14T17:34:53.755040] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-14T17:34:53.792398] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-14T17:34:54.158837] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-09-14T17:34:54.318389] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-14T17:34:54.958858] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-09-14T17:34:55.758894] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-09-14T17:34:56.166950] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-14T17:34:56.468850] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T17:34:56.558907] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-09-14T17:34:57.327580] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T17:34:57.358776] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-09-14T17:34:58.158869] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-09-14T17:34:58.403826] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-14T17:34:58.760517] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-14T17:34:58.958822] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-09-14T17:34:59.644136] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-14T17:34:59.758807] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-09-14T17:35:00.558832] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-09-14T17:35:01.194995] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-14T17:35:01.358833] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-09-14T17:35:01.418723] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-14T17:35:02.158836] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-09-14T17:35:02.331851] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T17:35:02.958820] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-09-14T17:35:03.250099] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T17:35:03.758880] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-09-14T17:35:03.878262] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T17:35:04.416183] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T17:35:04.441036] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:35:04.448138] [INFO ] [REMOTE ] CTRA: Full fetch complete (58330 records). [2025-09-14T17:35:04.448265] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-09-14T17:35:04.563915] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-09-14T17:35:04.839794] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-09-14T17:35:04.839907] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-09-14T17:35:04.840760] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-09-14T17:35:04.840842] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-09-14T17:35:04.842146] [DEBUG] [LOCAL ] CTRA: Trimmed 58330 records to 40394 (keeping 150 days of data) [2025-09-14T17:35:05.118064] [DEBUG] [LOCAL ] CTRA: Primary data saved (40394 records). [2025-09-14T17:35:05.118300] [INFO ] [MAIN ] CTRA: Full history saved. [2025-09-14T17:35:05.118462] [INFO ] [MAIN ] Update Progress: 549/2370 symbols completed. CTRA took 29.1s. Estimated remaining: 3h 12m 1s. Rate: 9.5 symbols/min [2025-09-14T17:35:05.296367] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:35:05.308786] [DEBUG] [LOCAL ] CTS: Loaded 8549 existing records from primary storage. [2025-09-14T17:35:05.309019] [INFO ] [MAIN ] CTS: Loaded 8549 existing records. [2025-09-14T17:35:05.364082] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-09-14T17:35:05.518953] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:35:05.519284] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-09-14T17:35:05.519350] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-09-14T17:35:05.519758] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-09-14T17:35:05.519827] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-09-14T17:35:05.895348] [INFO ] [REMOTE ] CTS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:35:06.051449] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-14T17:35:06.056901] [INFO ] [REMOTE ] CTRI: Full fetch complete (39507 records). [2025-09-14T17:35:06.057035] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-09-14T17:35:06.164003] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-09-14T17:35:06.427393] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-09-14T17:35:06.427502] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-09-14T17:35:06.428146] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-09-14T17:35:06.428216] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-09-14T17:35:06.429241] [DEBUG] [LOCAL ] CTRI: Trimmed 39507 records to 29300 (keeping 150 days of data) [2025-09-14T17:35:06.602867] [DEBUG] [LOCAL ] CTRI: Primary data saved (29300 records). [2025-09-14T17:35:06.603032] [INFO ] [MAIN ] CTRI: Full history saved. [2025-09-14T17:35:06.603145] [INFO ] [MAIN ] Update Progress: 550/2370 symbols completed. CTRI took 19.3s. Estimated remaining: 3h 11m 39s. Rate: 9.5 symbols/min [2025-09-14T17:35:06.771169] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:35:06.798700] [DEBUG] [LOCAL ] CTVA: Loaded 23886 existing records from primary storage. [2025-09-14T17:35:06.798877] [INFO ] [MAIN ] CTVA: Loaded 23886 existing records. [2025-09-14T17:35:06.971143] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-09-14T17:35:06.975531] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:35:06.976755] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-09-14T17:35:06.976828] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-09-14T17:35:06.977600] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-09-14T17:35:06.977686] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-09-14T17:35:07.276844] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-14T17:35:07.429977] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:35:07.452452] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-14T17:35:07.758849] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-09-14T17:35:08.062360] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T17:35:08.558835] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-09-14T17:35:09.034242] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-14T17:35:09.039215] [INFO ] [REMOTE ] CTOS: Full fetch complete (39869 records). [2025-09-14T17:35:09.039346] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-09-14T17:35:09.369177] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-09-14T17:35:09.415894] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-09-14T17:35:09.415997] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-09-14T17:35:09.416791] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-09-14T17:35:09.416850] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-09-14T17:35:09.417849] [DEBUG] [LOCAL ] CTOS: Trimmed 39869 records to 27448 (keeping 150 days of data) [2025-09-14T17:35:09.578086] [DEBUG] [LOCAL ] CTOS: Primary data saved (27448 records). [2025-09-14T17:35:09.578255] [INFO ] [MAIN ] CTOS: Full history saved. [2025-09-14T17:35:09.578379] [INFO ] [MAIN ] Update Progress: 551/2370 symbols completed. CTOS took 34.4s. Estimated remaining: 3h 11m 21s. Rate: 9.5 symbols/min [2025-09-14T17:35:09.747719] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:35:09.747970] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-09-14T17:35:09.748136] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-09-14T17:35:09.748366] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-09-14T17:35:09.758478] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-14T17:35:09.759100] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-14T17:35:09.759519] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-14T17:35:09.759660] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-09-14T17:35:10.084791] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T17:35:10.139703] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:35:10.141495] [INFO ] [REMOTE ] CTRE: Full fetch complete (53491 records). [2025-09-14T17:35:10.141591] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-09-14T17:35:10.164013] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-09-14T17:35:10.518632] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-09-14T17:35:10.518752] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-09-14T17:35:10.519467] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-09-14T17:35:10.519523] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-09-14T17:35:10.520911] [DEBUG] [LOCAL ] CTRE: Trimmed 53491 records to 36929 (keeping 150 days of data) [2025-09-14T17:35:10.593761] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-14T17:35:10.754372] [DEBUG] [LOCAL ] CTRE: Primary data saved (36929 records). [2025-09-14T17:35:10.754544] [INFO ] [MAIN ] CTRE: Full history saved. [2025-09-14T17:35:10.754670] [INFO ] [MAIN ] Update Progress: 552/2370 symbols completed. CTRE took 24.2s. Estimated remaining: 3h 10m 58s. Rate: 9.5 symbols/min [2025-09-14T17:35:10.924378] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:35:10.945953] [DEBUG] [LOCAL ] CUBE: Loaded 22608 existing records from primary storage. [2025-09-14T17:35:10.946104] [INFO ] [MAIN ] CUBE: Loaded 22608 existing records. [2025-09-14T17:35:10.966286] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-09-14T17:35:11.123294] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:35:11.123587] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-09-14T17:35:11.123672] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-09-14T17:35:11.124393] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-09-14T17:35:11.124464] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-09-14T17:35:11.398445] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-14T17:35:11.478199] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:35:11.758891] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-09-14T17:35:12.558865] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-09-14T17:35:12.976816] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-14T17:35:13.358876] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-09-14T17:35:14.158829] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-09-14T17:35:14.314734] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T17:35:14.423739] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-09-14T17:35:14.892619] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T17:35:14.958853] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-09-14T17:35:15.758820] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-09-14T17:35:15.976134] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T17:35:16.558831] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-09-14T17:35:17.358827] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-09-14T17:35:17.607011] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-14T17:35:17.646213] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T17:35:17.663295] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-14T17:35:18.158840] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-09-14T17:35:18.958840] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-09-14T17:35:19.078936] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-14T17:35:19.758825] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-09-14T17:35:20.558786] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-09-14T17:35:20.599858] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-14T17:35:20.780239] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-09-14T17:35:21.358826] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-09-14T17:35:21.655560] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-14T17:35:21.699530] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T17:35:22.158836] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-09-14T17:35:22.958791] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-09-14T17:35:23.260581] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-14T17:35:23.289533] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-14T17:35:23.758830] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-14T17:35:23.985698] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-09-14T17:35:23.986568] [INFO ] [REMOTE ] CUBB: Full fetch complete (728 records). [2025-09-14T17:35:23.986677] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-09-14T17:35:23.987081] [FATAL] [VALIDATOR ] CUBB: Data is stale - most recent date (2025-09-11) is before last completed trading day (2025-09-12). Symbol may be delisted or halted. [2025-09-14T17:35:23.987175] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:35:23.987254] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:35:23.987306] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-14T17:35:23.987376] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-14T17:35:23.987432] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-14T17:35:23.987552] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-09-14T17:35:23.987628] [INFO ] [MAIN ] Update Progress: 553/2370 symbols completed. CUBB took 14.4s. Estimated remaining: 3h 11m 15s. Rate: 9.5 symbols/min [2025-09-14T17:35:24.168466] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:35:24.184204] [DEBUG] [LOCAL ] CUBI: Loaded 12858 existing records from primary storage. [2025-09-14T17:35:24.184383] [INFO ] [MAIN ] CUBI: Loaded 12858 existing records. [2025-09-14T17:35:24.374023] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:35:24.374284] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-09-14T17:35:24.374343] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-09-14T17:35:24.374903] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-09-14T17:35:24.374976] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-09-14T17:35:24.560432] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-09-14T17:35:24.751402] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:35:25.358827] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-09-14T17:35:26.158831] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-09-14T17:35:26.476500] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-14T17:35:26.733496] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T17:35:26.736019] [INFO ] [REMOTE ] CTS: Full fetch complete (20639 records). [2025-09-14T17:35:26.736138] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-09-14T17:35:26.963909] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-09-14T17:35:27.141422] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-09-14T17:35:27.141556] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-09-14T17:35:27.142025] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-09-14T17:35:27.142083] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-09-14T17:35:27.142963] [DEBUG] [LOCAL ] CTS: Trimmed 20639 records to 14207 (keeping 150 days of data) [2025-09-14T17:35:27.249358] [DEBUG] [LOCAL ] CTS: Primary data saved (14207 records). [2025-09-14T17:35:27.249585] [INFO ] [MAIN ] CTS: Full history saved. [2025-09-14T17:35:27.249841] [INFO ] [MAIN ] Update Progress: 554/2370 symbols completed. CTS took 22.1s. Estimated remaining: 3h 10m 58s. Rate: 9.5 symbols/min [2025-09-14T17:35:27.435925] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:35:27.471450] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-14T17:35:27.500308] [DEBUG] [LOCAL ] CUK: Loaded 22875 existing records from primary storage. [2025-09-14T17:35:27.500531] [INFO ] [MAIN ] CUK: Loaded 22875 existing records. [2025-09-14T17:35:27.683221] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:35:27.683502] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-09-14T17:35:27.683583] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-09-14T17:35:27.684245] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-09-14T17:35:27.684314] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-09-14T17:35:27.763902] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-09-14T17:35:28.043523] [INFO ] [REMOTE ] CUK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:35:28.190602] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-14T17:35:28.558830] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-09-14T17:35:29.358869] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-09-14T17:35:29.573229] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-14T17:35:30.158857] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-09-14T17:35:30.402820] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-14T17:35:30.528463] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T17:35:30.958885] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-09-14T17:35:31.758876] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-09-14T17:35:32.039127] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T17:35:32.320862] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-14T17:35:32.558851] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-09-14T17:35:33.338144] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T17:35:33.358798] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-09-14T17:35:33.700745] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T17:35:34.158833] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-09-14T17:35:34.958838] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-09-14T17:35:35.017704] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T17:35:35.758814] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-09-14T17:35:35.857450] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T17:35:35.982469] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-14T17:35:36.558861] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-09-14T17:35:37.358890] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-09-14T17:35:37.675535] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T17:35:37.868708] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T17:35:38.041812] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:35:38.047236] [INFO ] [REMOTE ] CUBE: Full fetch complete (54906 records). [2025-09-14T17:35:38.047423] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-09-14T17:35:38.163948] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-09-14T17:35:38.434010] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-09-14T17:35:38.434116] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-09-14T17:35:38.434845] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-09-14T17:35:38.434905] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-09-14T17:35:38.436079] [DEBUG] [LOCAL ] CUBE: Trimmed 54906 records to 38219 (keeping 150 days of data) [2025-09-14T17:35:38.666848] [DEBUG] [LOCAL ] CUBE: Primary data saved (38219 records). [2025-09-14T17:35:38.667019] [INFO ] [MAIN ] CUBE: Full history saved. [2025-09-14T17:35:38.667119] [INFO ] [MAIN ] Update Progress: 555/2370 symbols completed. CUBE took 27.9s. Estimated remaining: 3h 11m 9s. Rate: 9.5 symbols/min [2025-09-14T17:35:38.838516] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:35:38.841406] [DEBUG] [LOCAL ] CULP: Loaded 1208 existing records from primary storage. [2025-09-14T17:35:38.841497] [INFO ] [MAIN ] CULP: Loaded 1208 existing records. [2025-09-14T17:35:38.964080] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-09-14T17:35:39.018804] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:35:39.019140] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-09-14T17:35:39.019211] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-09-14T17:35:39.019442] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-09-14T17:35:39.019498] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-09-14T17:35:39.365835] [INFO ] [REMOTE ] CULP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:35:39.758853] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-09-14T17:35:40.052118] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T17:35:40.303605] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-14T17:35:40.319621] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-14T17:35:40.558904] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-09-14T17:35:41.180008] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T17:35:41.185018] [INFO ] [REMOTE ] CUBI: Full fetch complete (29035 records). [2025-09-14T17:35:41.185326] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-09-14T17:35:41.364199] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-09-14T17:35:41.724155] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-09-14T17:35:41.724294] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-09-14T17:35:41.724962] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-09-14T17:35:41.725034] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-09-14T17:35:41.726297] [DEBUG] [LOCAL ] CUBI: Trimmed 29035 records to 20046 (keeping 150 days of data) [2025-09-14T17:35:41.888191] [DEBUG] [LOCAL ] CUBI: Primary data saved (20046 records). [2025-09-14T17:35:41.888370] [INFO ] [MAIN ] CUBI: Full history saved. [2025-09-14T17:35:41.888473] [INFO ] [MAIN ] Update Progress: 556/2370 symbols completed. CUBI took 17.9s. Estimated remaining: 3h 10m 52s. Rate: 9.5 symbols/min [2025-09-14T17:35:42.062535] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:35:42.079356] [DEBUG] [LOCAL ] CURB: Loaded 14812 existing records from primary storage. [2025-09-14T17:35:42.079548] [INFO ] [MAIN ] CURB: Loaded 14812 existing records. [2025-09-14T17:35:42.168383] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-09-14T17:35:42.259038] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:35:42.259298] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-09-14T17:35:42.259360] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-09-14T17:35:42.259879] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-09-14T17:35:42.259945] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-09-14T17:35:42.614855] [INFO ] [REMOTE ] CURB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:35:42.630274] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-14T17:35:42.958854] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-09-14T17:35:43.245123] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T17:35:43.592904] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-14T17:35:43.758832] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-09-14T17:35:44.292462] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-14T17:35:44.558842] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-09-14T17:35:45.095212] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-14T17:35:45.358885] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-09-14T17:35:45.922575] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-14T17:35:46.158887] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-09-14T17:35:46.958857] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-09-14T17:35:47.758830] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-09-14T17:35:47.997976] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T17:35:48.120700] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-14T17:35:48.417582] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-14T17:35:48.558873] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-09-14T17:35:49.358848] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-09-14T17:35:49.620059] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-14T17:35:49.899912] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T17:35:49.901463] [INFO ] [REMOTE ] CULP: Full fetch complete (3329 records). [2025-09-14T17:35:49.901562] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-09-14T17:35:50.163964] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-09-14T17:35:50.298542] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-09-14T17:35:50.298693] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-09-14T17:35:50.298864] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-09-14T17:35:50.298921] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-09-14T17:35:50.299374] [DEBUG] [LOCAL ] CULP: Trimmed 3329 records to 2034 (keeping 150 days of data) [2025-09-14T17:35:50.311530] [DEBUG] [LOCAL ] CULP: Primary data saved (2034 records). [2025-09-14T17:35:50.311624] [INFO ] [MAIN ] CULP: Full history saved. [2025-09-14T17:35:50.311743] [INFO ] [MAIN ] Update Progress: 557/2370 symbols completed. CULP took 11.6s. Estimated remaining: 3h 10m 53s. Rate: 9.5 symbols/min [2025-09-14T17:35:50.958913] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-09-14T17:35:51.730621] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T17:35:51.737043] [INFO ] [REMOTE ] CTVA: Full fetch complete (57835 records). [2025-09-14T17:35:51.737233] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-09-14T17:35:51.763971] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-09-14T17:35:52.121616] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-14T17:35:52.228780] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-09-14T17:35:52.228930] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-09-14T17:35:52.229900] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-09-14T17:35:52.229968] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-09-14T17:35:52.231666] [DEBUG] [LOCAL ] CTVA: Trimmed 57835 records to 40082 (keeping 150 days of data) [2025-09-14T17:35:52.489933] [DEBUG] [LOCAL ] CTVA: Primary data saved (40082 records). [2025-09-14T17:35:52.490107] [INFO ] [MAIN ] CTVA: Full history saved. [2025-09-14T17:35:52.490207] [INFO ] [MAIN ] Update Progress: 558/2370 symbols completed. CTVA took 45.9s. Estimated remaining: 3h 10m 33s. Rate: 9.5 symbols/min [2025-09-14T17:35:52.558877] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-09-14T17:35:53.314687] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T17:35:53.358793] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-09-14T17:35:54.436788] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T17:35:54.448404] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-09-14T17:35:54.832074] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-14T17:35:54.958828] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-09-14T17:35:56.203355] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-14T17:35:56.209674] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-09-14T17:35:56.348026] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T17:35:56.558929] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-09-14T17:35:57.340960] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-14T17:35:57.358783] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-09-14T17:35:58.225937] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-14T17:35:58.231752] [INFO ] [REMOTE ] CUK: Full fetch complete (55535 records). [2025-09-14T17:35:58.231891] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-09-14T17:35:58.628049] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-09-14T17:35:58.628157] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-09-14T17:35:58.628900] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-09-14T17:35:58.628958] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-09-14T17:35:58.630141] [DEBUG] [LOCAL ] CUK: Trimmed 55535 records to 38115 (keeping 150 days of data) [2025-09-14T17:35:58.860137] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T17:35:58.872096] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-09-14T17:35:58.910554] [DEBUG] [LOCAL ] CUK: Primary data saved (38115 records). [2025-09-14T17:35:58.910750] [INFO ] [MAIN ] CUK: Full history saved. [2025-09-14T17:35:58.910867] [INFO ] [MAIN ] Update Progress: 559/2370 symbols completed. CUK took 31.7s. Estimated remaining: 3h 10m 27s. Rate: 9.5 symbols/min [2025-09-14T17:36:00.340308] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T17:36:00.348294] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-09-14T17:36:00.700552] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-14T17:36:00.704361] [INFO ] [REMOTE ] CURB: Full fetch complete (35602 records). [2025-09-14T17:36:00.704493] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-09-14T17:36:01.099036] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-09-14T17:36:01.099153] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-09-14T17:36:01.099786] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-09-14T17:36:01.099846] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-09-14T17:36:01.100859] [DEBUG] [LOCAL ] CURB: Trimmed 35602 records to 23951 (keeping 150 days of data) [2025-09-14T17:36:01.254412] [DEBUG] [LOCAL ] CURB: Primary data saved (23951 records). [2025-09-14T17:36:01.254880] [INFO ] [MAIN ] CURB: Full history saved. [2025-09-14T17:36:01.255076] [INFO ] [MAIN ] Update Progress: 560/2370 symbols completed. CURB took 19.4s. Estimated remaining: 3h 10m 8s. Rate: 9.5 symbols/min [2025-09-14T17:36:01.977935] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:36:02.019983] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:36:02.057593] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:36:02.061268] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:36:02.078964] [DEBUG] [LOCAL ] CVEO: Loaded 6456 existing records from primary storage. [2025-09-14T17:36:02.079286] [INFO ] [MAIN ] CVEO: Loaded 6456 existing records. [2025-09-14T17:36:02.182616] [DEBUG] [LOCAL ] CURV: Loaded 14399 existing records from primary storage. [2025-09-14T17:36:02.229475] [INFO ] [MAIN ] CURV: Loaded 14399 existing records. [2025-09-14T17:36:02.229961] [DEBUG] [LOCAL ] CUZ: Loaded 22311 existing records from primary storage. [2025-09-14T17:36:02.230209] [INFO ] [MAIN ] CUZ: Loaded 22311 existing records. [2025-09-14T17:36:02.230621] [DEBUG] [LOCAL ] CVE: Loaded 23970 existing records from primary storage. [2025-09-14T17:36:02.373289] [INFO ] [MAIN ] CVE: Loaded 23970 existing records. [2025-09-14T17:36:02.469769] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:36:02.557862] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-09-14T17:36:02.618425] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-14T17:36:02.727411] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-09-14T17:36:02.743172] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:36:02.773292] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-09-14T17:36:02.849143] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-09-14T17:36:02.824890] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:36:02.891415] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-09-14T17:36:02.926045] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:36:02.920748] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-09-14T17:36:02.949165] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-09-14T17:36:02.934965] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-09-14T17:36:02.954438] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-09-14T17:36:02.984761] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-09-14T17:36:02.981395] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-09-14T17:36:02.984973] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-09-14T17:36:03.029337] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-09-14T17:36:03.046309] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-09-14T17:36:02.990134] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-09-14T17:36:04.117159] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:36:04.187472] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-09-14T17:36:04.262852] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:36:04.327230] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-09-14T17:36:04.316386] [INFO ] [REMOTE ] CURV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:36:04.359786] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-09-14T17:36:04.381033] [INFO ] [REMOTE ] CVE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:36:04.382855] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-09-14T17:36:05.440340] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-14T17:36:05.443486] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-09-14T17:36:05.580960] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-14T17:36:05.586405] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-09-14T17:36:06.029022] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T17:36:06.039566] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-09-14T17:36:06.233334] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-14T17:36:06.244424] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-09-14T17:36:06.488889] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T17:36:06.492917] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-09-14T17:36:06.868470] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-14T17:36:06.958827] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-09-14T17:36:07.206276] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-14T17:36:07.544435] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T17:36:07.758873] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-09-14T17:36:08.041879] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T17:36:08.082679] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-14T17:36:08.558833] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-09-14T17:36:09.358812] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-09-14T17:36:09.457602] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-14T17:36:10.158862] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-09-14T17:36:10.292537] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T17:36:10.386736] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T17:36:10.958882] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-09-14T17:36:11.170022] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-14T17:36:11.758853] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-09-14T17:36:12.558896] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-09-14T17:36:12.927419] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-14T17:36:12.968965] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-14T17:36:13.358887] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-09-14T17:36:13.775670] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T17:36:14.158859] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-09-14T17:36:14.234179] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-14T17:36:14.958829] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-09-14T17:36:15.682765] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-14T17:36:15.758833] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-09-14T17:36:15.993474] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-14T17:36:16.558894] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-09-14T17:36:17.358845] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-09-14T17:36:18.163925] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-09-14T17:36:18.179719] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-14T17:36:18.680306] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-14T17:36:18.682416] [INFO ] [REMOTE ] CVEO: Full fetch complete (16837 records). [2025-09-14T17:36:18.682507] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-09-14T17:36:18.966720] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-09-14T17:36:19.060069] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-09-14T17:36:19.060181] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-09-14T17:36:19.060690] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-09-14T17:36:19.060751] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-09-14T17:36:19.061326] [DEBUG] [LOCAL ] CVEO: Trimmed 16837 records to 11781 (keeping 150 days of data) [2025-09-14T17:36:19.130244] [DEBUG] [LOCAL ] CVEO: Primary data saved (11781 records). [2025-09-14T17:36:19.130417] [INFO ] [MAIN ] CVEO: Full history saved. [2025-09-14T17:36:19.130536] [INFO ] [MAIN ] Update Progress: 561/2370 symbols completed. CVEO took 17.9s. Estimated remaining: 3h 10m 39s. Rate: 9.5 symbols/min [2025-09-14T17:36:19.298247] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:36:19.319597] [DEBUG] [LOCAL ] CVI: Loaded 20957 existing records from primary storage. [2025-09-14T17:36:19.319921] [INFO ] [MAIN ] CVI: Loaded 20957 existing records. [2025-09-14T17:36:19.495309] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:36:19.518779] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-09-14T17:36:19.521849] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-09-14T17:36:19.523697] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (2.96 seconds). [2025-09-14T17:36:19.540997] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-09-14T17:36:19.551533] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-09-14T17:36:19.552159] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T17:36:19.767100] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-09-14T17:36:19.934597] [INFO ] [REMOTE ] CVI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:36:20.558885] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-09-14T17:36:20.691061] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T17:36:21.358848] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-09-14T17:36:21.820970] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-14T17:36:21.881902] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-14T17:36:21.886410] [INFO ] [REMOTE ] CURV: Full fetch complete (28457 records). [2025-09-14T17:36:21.886526] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-09-14T17:36:22.158798] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-09-14T17:36:22.261540] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-09-14T17:36:22.261684] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-09-14T17:36:22.262228] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-09-14T17:36:22.262286] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-09-14T17:36:22.263322] [DEBUG] [LOCAL ] CURV: Trimmed 28457 records to 19974 (keeping 150 days of data) [2025-09-14T17:36:22.379744] [DEBUG] [LOCAL ] CURV: Primary data saved (19974 records). [2025-09-14T17:36:22.379927] [INFO ] [MAIN ] CURV: Full history saved. [2025-09-14T17:36:22.380041] [INFO ] [MAIN ] Update Progress: 562/2370 symbols completed. CURV took 21.1s. Estimated remaining: 3h 10m 23s. Rate: 9.5 symbols/min [2025-09-14T17:36:22.549603] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:36:22.557455] [DEBUG] [LOCAL ] CVLG: Loaded 6050 existing records from primary storage. [2025-09-14T17:36:22.557608] [INFO ] [MAIN ] CVLG: Loaded 6050 existing records. [2025-09-14T17:36:22.737590] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:36:22.737916] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-09-14T17:36:22.737991] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-09-14T17:36:22.738388] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-09-14T17:36:22.738457] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-09-14T17:36:22.978276] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-09-14T17:36:23.098570] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:36:23.127612] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T17:36:23.398759] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T17:36:23.758825] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-09-14T17:36:24.558832] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-09-14T17:36:24.903566] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-14T17:36:25.358822] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-09-14T17:36:25.512908] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T17:36:26.158835] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-09-14T17:36:26.254588] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T17:36:26.880562] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-14T17:36:26.886484] [INFO ] [REMOTE ] CVE: Full fetch complete (58231 records). [2025-09-14T17:36:26.886680] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-09-14T17:36:26.963970] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-09-14T17:36:27.280138] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-09-14T17:36:27.280303] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-09-14T17:36:27.281245] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-09-14T17:36:27.281333] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-09-14T17:36:27.282675] [DEBUG] [LOCAL ] CVE: Trimmed 58231 records to 40314 (keeping 150 days of data) [2025-09-14T17:36:27.534659] [DEBUG] [LOCAL ] CVE: Primary data saved (40314 records). [2025-09-14T17:36:27.534843] [INFO ] [MAIN ] CVE: Full history saved. [2025-09-14T17:36:27.534980] [INFO ] [MAIN ] Update Progress: 563/2370 symbols completed. CVE took 26.3s. Estimated remaining: 3h 10m 13s. Rate: 9.5 symbols/min [2025-09-14T17:36:27.706755] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:36:27.754219] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T17:36:27.764412] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-09-14T17:36:27.776057] [DEBUG] [LOCAL ] CVNA: Loaded 23692 existing records from primary storage. [2025-09-14T17:36:27.776212] [INFO ] [MAIN ] CVNA: Loaded 23692 existing records. [2025-09-14T17:36:27.954418] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-14T17:36:27.957806] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:36:27.960569] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-09-14T17:36:27.960656] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-09-14T17:36:27.961346] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-09-14T17:36:27.961421] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-09-14T17:36:28.317171] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:36:28.330207] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T17:36:28.335549] [INFO ] [REMOTE ] CUZ: Full fetch complete (53438 records). [2025-09-14T17:36:28.335698] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-09-14T17:36:28.563894] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-09-14T17:36:28.715538] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-09-14T17:36:28.715720] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-09-14T17:36:28.716567] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-09-14T17:36:28.716681] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-09-14T17:36:28.718068] [DEBUG] [LOCAL ] CUZ: Trimmed 53438 records to 37222 (keeping 150 days of data) [2025-09-14T17:36:28.955396] [DEBUG] [LOCAL ] CUZ: Primary data saved (37222 records). [2025-09-14T17:36:28.955663] [INFO ] [MAIN ] CUZ: Full history saved. [2025-09-14T17:36:28.955912] [INFO ] [MAIN ] Update Progress: 564/2370 symbols completed. CUZ took 27.7s. Estimated remaining: 3h 9m 51s. Rate: 9.5 symbols/min [2025-09-14T17:36:29.136190] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:36:29.160913] [DEBUG] [LOCAL ] CVS: Loaded 24111 existing records from primary storage. [2025-09-14T17:36:29.161135] [INFO ] [MAIN ] CVS: Loaded 24111 existing records. [2025-09-14T17:36:29.342029] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:36:29.342316] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-09-14T17:36:29.342410] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-09-14T17:36:29.343074] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-09-14T17:36:29.343139] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-09-14T17:36:29.363912] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-09-14T17:36:29.722657] [INFO ] [REMOTE ] CVS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:36:30.158794] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-09-14T17:36:30.378015] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-14T17:36:30.639043] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-14T17:36:30.958915] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-09-14T17:36:31.758927] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-09-14T17:36:32.290918] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-14T17:36:32.558822] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-09-14T17:36:32.900324] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-14T17:36:32.971597] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-14T17:36:33.358849] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-09-14T17:36:34.110277] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-14T17:36:34.158900] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-09-14T17:36:34.909717] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-14T17:36:34.958887] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-09-14T17:36:35.759067] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-09-14T17:36:36.200073] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-14T17:36:36.558865] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-09-14T17:36:36.650593] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T17:36:37.358873] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-09-14T17:36:37.626156] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T17:36:38.166301] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-09-14T17:36:38.203179] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-14T17:36:38.960667] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-09-14T17:36:38.968671] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T17:36:39.235864] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-14T17:36:39.758920] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-09-14T17:36:40.558926] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-09-14T17:36:41.014555] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-14T17:36:41.358902] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-09-14T17:36:42.014669] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-14T17:36:42.161268] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-09-14T17:36:42.170216] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-14T17:36:42.234281] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-14T17:36:42.782888] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T17:36:42.784872] [INFO ] [REMOTE ] CVLG: Full fetch complete (16237 records). [2025-09-14T17:36:42.784970] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-09-14T17:36:42.963688] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-09-14T17:36:43.171433] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-09-14T17:36:43.171575] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-09-14T17:36:43.172192] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-09-14T17:36:43.172254] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-09-14T17:36:43.172986] [DEBUG] [LOCAL ] CVLG: Trimmed 16237 records to 11706 (keeping 150 days of data) [2025-09-14T17:36:43.255967] [DEBUG] [LOCAL ] CVLG: Primary data saved (11706 records). [2025-09-14T17:36:43.256299] [INFO ] [MAIN ] CVLG: Full history saved. [2025-09-14T17:36:43.256478] [INFO ] [MAIN ] Update Progress: 565/2370 symbols completed. CVLG took 20.9s. Estimated remaining: 3h 10m 10s. Rate: 9.5 symbols/min [2025-09-14T17:36:43.443989] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:36:43.471704] [DEBUG] [LOCAL ] CVX: Loaded 24170 existing records from primary storage. [2025-09-14T17:36:43.471943] [INFO ] [MAIN ] CVX: Loaded 24170 existing records. [2025-09-14T17:36:43.672927] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:36:43.673418] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-09-14T17:36:43.679375] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-09-14T17:36:43.689462] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-09-14T17:36:43.689385] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T17:36:43.689678] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-09-14T17:36:43.760594] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-09-14T17:36:43.760918] [INFO ] [REMOTE ] CVI: Full fetch complete (50234 records). [2025-09-14T17:36:43.803287] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-09-14T17:36:44.484562] [INFO ] [REMOTE ] CVX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:36:44.564666] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-09-14T17:36:44.568789] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-09-14T17:36:44.568952] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-09-14T17:36:44.569965] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-09-14T17:36:44.570045] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-09-14T17:36:44.571884] [DEBUG] [LOCAL ] CVI: Trimmed 50234 records to 34598 (keeping 150 days of data) [2025-09-14T17:36:44.781660] [DEBUG] [LOCAL ] CVI: Primary data saved (34598 records). [2025-09-14T17:36:44.781846] [INFO ] [MAIN ] CVI: Full history saved. [2025-09-14T17:36:44.781971] [INFO ] [MAIN ] Update Progress: 566/2370 symbols completed. CVI took 25.7s. Estimated remaining: 3h 9m 48s. Rate: 9.5 symbols/min [2025-09-14T17:36:44.949970] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:36:44.961489] [DEBUG] [LOCAL ] CW: Loaded 9743 existing records from primary storage. [2025-09-14T17:36:44.961669] [INFO ] [MAIN ] CW: Loaded 9743 existing records. [2025-09-14T17:36:45.140765] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:36:45.141094] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-09-14T17:36:45.141159] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-14T17:36:45.141548] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-09-14T17:36:45.141622] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-09-14T17:36:45.377189] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-09-14T17:36:45.494383] [INFO ] [REMOTE ] CW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:36:45.956214] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-14T17:36:46.158843] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-09-14T17:36:46.774529] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-14T17:36:46.958869] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-09-14T17:36:47.332625] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-14T17:36:47.758872] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-09-14T17:36:47.838372] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-14T17:36:48.558865] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-09-14T17:36:49.215882] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-14T17:36:49.358803] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-09-14T17:36:49.554580] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T17:36:49.845234] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-14T17:36:50.158852] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-09-14T17:36:50.958953] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-09-14T17:36:51.678334] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-14T17:36:51.758868] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-09-14T17:36:52.233412] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-14T17:36:52.320087] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-14T17:36:52.558906] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-09-14T17:36:53.358883] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-09-14T17:36:54.006182] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-14T17:36:54.158894] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-09-14T17:36:54.459777] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-14T17:36:54.958922] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-09-14T17:36:55.616859] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-14T17:36:55.758813] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-09-14T17:36:56.161582] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-14T17:36:56.558844] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-09-14T17:36:57.083238] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T17:36:57.091465] [INFO ] [REMOTE ] CVS: Full fetch complete (58378 records). [2025-09-14T17:36:57.091709] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-09-14T17:36:57.359260] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-09-14T17:36:57.504919] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-09-14T17:36:57.521792] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-09-14T17:36:57.522731] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-09-14T17:36:57.522804] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-09-14T17:36:57.524792] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-09-14T17:36:57.536188] [DEBUG] [LOCAL ] CVS: Trimmed 58378 records to 40438 (keeping 150 days of data) [2025-09-14T17:36:57.784608] [DEBUG] [LOCAL ] CVS: Primary data saved (40438 records). [2025-09-14T17:36:57.784784] [INFO ] [MAIN ] CVS: Full history saved. [2025-09-14T17:36:57.784889] [INFO ] [MAIN ] Update Progress: 567/2370 symbols completed. CVS took 28.8s. Estimated remaining: 3h 10m 3s. Rate: 9.5 symbols/min [2025-09-14T17:36:57.951122] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:36:57.975672] [DEBUG] [LOCAL ] CWAN: Loaded 23673 existing records from primary storage. [2025-09-14T17:36:57.975851] [INFO ] [MAIN ] CWAN: Loaded 23673 existing records. [2025-09-14T17:36:58.149942] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:36:58.150292] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-09-14T17:36:58.150360] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-14T17:36:58.165505] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-09-14T17:36:58.180390] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-09-14T17:36:58.180570] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-09-14T17:36:58.228435] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-14T17:36:58.552999] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:36:58.599426] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-14T17:36:58.958894] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-09-14T17:36:59.758887] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-09-14T17:37:00.558842] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-09-14T17:37:00.682335] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-14T17:37:00.720555] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T17:37:01.358890] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-09-14T17:37:01.538364] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-14T17:37:01.557268] [INFO ] [REMOTE ] CVNA: Full fetch complete (57717 records). [2025-09-14T17:37:01.557552] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-09-14T17:37:01.558592] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-14T17:37:01.954592] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-09-14T17:37:01.954747] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-09-14T17:37:01.955516] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-09-14T17:37:01.955579] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-09-14T17:37:01.957232] [DEBUG] [LOCAL ] CVNA: Trimmed 57717 records to 39897 (keeping 150 days of data) [2025-09-14T17:37:02.181573] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-09-14T17:37:02.220727] [DEBUG] [LOCAL ] CVNA: Primary data saved (39897 records). [2025-09-14T17:37:02.220964] [INFO ] [MAIN ] CVNA: Full history saved. [2025-09-14T17:37:02.221155] [INFO ] [MAIN ] Update Progress: 568/2370 symbols completed. CVNA took 34.7s. Estimated remaining: 3h 9m 51s. Rate: 9.5 symbols/min [2025-09-14T17:37:02.435104] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:37:02.457191] [DEBUG] [LOCAL ] CWEN: Loaded 20311 existing records from primary storage. [2025-09-14T17:37:02.457388] [INFO ] [MAIN ] CWEN: Loaded 20311 existing records. [2025-09-14T17:37:02.632726] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:37:02.633026] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-09-14T17:37:02.633102] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-09-14T17:37:02.633771] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-09-14T17:37:02.633847] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-09-14T17:37:02.964135] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-09-14T17:37:02.994623] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:37:03.519364] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-14T17:37:03.758882] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-09-14T17:37:04.174001] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-14T17:37:04.524004] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-14T17:37:04.558858] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-09-14T17:37:04.936395] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T17:37:05.148750] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T17:37:05.154382] [INFO ] [REMOTE ] CVX: Full fetch complete (58440 records). [2025-09-14T17:37:05.154555] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-09-14T17:37:05.364055] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-09-14T17:37:05.544530] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-09-14T17:37:05.544666] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-09-14T17:37:05.545528] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-09-14T17:37:05.545604] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-09-14T17:37:05.546901] [DEBUG] [LOCAL ] CVX: Trimmed 58440 records to 40500 (keeping 150 days of data) [2025-09-14T17:37:05.828815] [DEBUG] [LOCAL ] CVX: Primary data saved (40500 records). [2025-09-14T17:37:05.828984] [INFO ] [MAIN ] CVX: Full history saved. [2025-09-14T17:37:05.829224] [INFO ] [MAIN ] Update Progress: 569/2370 symbols completed. CVX took 22.6s. Estimated remaining: 3h 9m 36s. Rate: 9.5 symbols/min [2025-09-14T17:37:06.006247] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:37:06.028816] [DEBUG] [LOCAL ] CWH: Loaded 22892 existing records from primary storage. [2025-09-14T17:37:06.028985] [INFO ] [MAIN ] CWH: Loaded 22892 existing records. [2025-09-14T17:37:06.172291] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-09-14T17:37:06.212193] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:37:06.212387] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-09-14T17:37:06.212478] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-09-14T17:37:06.213102] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-09-14T17:37:06.213169] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-09-14T17:37:06.573809] [INFO ] [REMOTE ] CWH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:37:06.748231] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T17:37:06.750869] [INFO ] [REMOTE ] CW: Full fetch complete (25593 records). [2025-09-14T17:37:06.750989] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-09-14T17:37:06.964048] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-09-14T17:37:07.129291] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-09-14T17:37:07.129615] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-09-14T17:37:07.130198] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-09-14T17:37:07.130414] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-09-14T17:37:07.132490] [DEBUG] [LOCAL ] CW: Trimmed 25593 records to 16960 (keeping 150 days of data) [2025-09-14T17:37:07.251906] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T17:37:07.288728] [DEBUG] [LOCAL ] CW: Primary data saved (16960 records). [2025-09-14T17:37:07.288932] [INFO ] [MAIN ] CW: Full history saved. [2025-09-14T17:37:07.289096] [INFO ] [MAIN ] Update Progress: 570/2370 symbols completed. CW took 22.5s. Estimated remaining: 3h 9m 15s. Rate: 9.5 symbols/min [2025-09-14T17:37:07.461911] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:37:07.486462] [DEBUG] [LOCAL ] CWK: Loaded 22344 existing records from primary storage. [2025-09-14T17:37:07.486689] [INFO ] [MAIN ] CWK: Loaded 22344 existing records. [2025-09-14T17:37:07.677754] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:37:07.678036] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-09-14T17:37:07.678097] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-09-14T17:37:07.678772] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-09-14T17:37:07.678838] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-09-14T17:37:07.763975] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-09-14T17:37:08.055525] [INFO ] [REMOTE ] CWK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:37:08.558833] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-09-14T17:37:08.747901] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T17:37:09.358899] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-09-14T17:37:09.467484] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T17:37:10.118904] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T17:37:10.158850] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-09-14T17:37:10.967106] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-09-14T17:37:10.972460] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T17:37:11.758828] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-09-14T17:37:11.945635] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T17:37:12.558870] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-09-14T17:37:12.792696] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T17:37:13.358840] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-09-14T17:37:13.679843] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T17:37:13.867421] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-14T17:37:14.158886] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-09-14T17:37:14.958837] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-09-14T17:37:15.099058] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-14T17:37:15.758855] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-09-14T17:37:16.023273] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T17:37:16.307232] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T17:37:16.558905] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-09-14T17:37:17.358824] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-09-14T17:37:17.739928] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-14T17:37:18.162012] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-09-14T17:37:18.167848] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T17:37:18.796897] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T17:37:18.958880] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-09-14T17:37:19.758830] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-09-14T17:37:19.897517] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T17:37:20.405384] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-14T17:37:20.558827] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-09-14T17:37:21.358864] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-09-14T17:37:21.511693] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T17:37:22.078862] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-14T17:37:22.158836] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-09-14T17:37:22.958849] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-09-14T17:37:23.065004] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-14T17:37:23.758884] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-09-14T17:37:23.875165] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T17:37:24.258331] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T17:37:24.263883] [INFO ] [REMOTE ] CWEN: Full fetch complete (49004 records). [2025-09-14T17:37:24.264039] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-09-14T17:37:24.560737] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-09-14T17:37:24.653706] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-09-14T17:37:24.654006] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-09-14T17:37:24.654812] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-09-14T17:37:24.654886] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-09-14T17:37:24.656619] [DEBUG] [LOCAL ] CWEN: Trimmed 49004 records to 33419 (keeping 150 days of data) [2025-09-14T17:37:24.783508] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-14T17:37:24.906133] [DEBUG] [LOCAL ] CWEN: Primary data saved (33419 records). [2025-09-14T17:37:24.906320] [INFO ] [MAIN ] CWEN: Full history saved. [2025-09-14T17:37:24.906448] [INFO ] [MAIN ] Update Progress: 571/2370 symbols completed. CWEN took 22.7s. Estimated remaining: 3h 9m 44s. Rate: 9.5 symbols/min [2025-09-14T17:37:25.082415] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:37:25.096669] [DEBUG] [LOCAL ] CWT: Loaded 11772 existing records from primary storage. [2025-09-14T17:37:25.096927] [INFO ] [MAIN ] CWT: Loaded 11772 existing records. [2025-09-14T17:37:25.280960] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:37:25.281382] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-09-14T17:37:25.281452] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-09-14T17:37:25.281956] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-09-14T17:37:25.282022] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-09-14T17:37:25.364014] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-09-14T17:37:25.661003] [INFO ] [REMOTE ] CWT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:37:26.146943] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T17:37:26.158775] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-09-14T17:37:26.958843] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-09-14T17:37:27.060048] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-14T17:37:27.066318] [INFO ] [REMOTE ] CWAN: Full fetch complete (56786 records). [2025-09-14T17:37:27.066512] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-09-14T17:37:27.438308] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-09-14T17:37:27.438473] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-09-14T17:37:27.439383] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-09-14T17:37:27.439532] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-09-14T17:37:27.440960] [DEBUG] [LOCAL ] CWAN: Trimmed 56786 records to 39593 (keeping 150 days of data) [2025-09-14T17:37:27.561241] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-14T17:37:27.717073] [DEBUG] [LOCAL ] CWAN: Primary data saved (39593 records). [2025-09-14T17:37:27.717262] [INFO ] [MAIN ] CWAN: Full history saved. [2025-09-14T17:37:27.717387] [INFO ] [MAIN ] Update Progress: 572/2370 symbols completed. CWAN took 29.9s. Estimated remaining: 3h 9m 26s. Rate: 9.5 symbols/min [2025-09-14T17:37:27.763916] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-09-14T17:37:27.895930] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:37:27.914813] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-14T17:37:27.938677] [DEBUG] [LOCAL ] CX: Loaded 23640 existing records from primary storage. [2025-09-14T17:37:27.938873] [INFO ] [MAIN ] CX: Loaded 23640 existing records. [2025-09-14T17:37:28.112548] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:37:28.112861] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-09-14T17:37:28.112925] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-09-14T17:37:28.113671] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-09-14T17:37:28.113732] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-09-14T17:37:28.464094] [INFO ] [REMOTE ] CX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:37:28.558782] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-09-14T17:37:29.285955] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-14T17:37:29.291113] [INFO ] [REMOTE ] CWH: Full fetch complete (55381 records). [2025-09-14T17:37:29.291242] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-09-14T17:37:29.365771] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-09-14T17:37:29.674764] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-09-14T17:37:29.674881] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-09-14T17:37:29.675668] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-09-14T17:37:29.675794] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-09-14T17:37:29.677039] [DEBUG] [LOCAL ] CWH: Trimmed 55381 records to 38864 (keeping 150 days of data) [2025-09-14T17:37:29.918684] [DEBUG] [LOCAL ] CWH: Primary data saved (38864 records). [2025-09-14T17:37:29.918886] [INFO ] [MAIN ] CWH: Full history saved. [2025-09-14T17:37:29.918990] [INFO ] [MAIN ] Update Progress: 573/2370 symbols completed. CWH took 24.1s. Estimated remaining: 3h 9m 7s. Rate: 9.5 symbols/min [2025-09-14T17:37:30.091330] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:37:30.095693] [DEBUG] [LOCAL ] CXE: Loaded 2696 existing records from primary storage. [2025-09-14T17:37:30.095802] [INFO ] [MAIN ] CXE: Loaded 2696 existing records. [2025-09-14T17:37:30.164825] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-09-14T17:37:30.277233] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:37:30.277625] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-09-14T17:37:30.277809] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-09-14T17:37:30.278170] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-09-14T17:37:30.278323] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-09-14T17:37:30.575581] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-14T17:37:30.695276] [INFO ] [REMOTE ] CXE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:37:30.749219] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-14T17:37:30.958838] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-09-14T17:37:31.632069] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T17:37:31.758835] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-09-14T17:37:32.317660] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-14T17:37:32.406621] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T17:37:32.411894] [INFO ] [REMOTE ] CWK: Full fetch complete (53595 records). [2025-09-14T17:37:32.412021] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-09-14T17:37:32.564246] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-09-14T17:37:32.800355] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-09-14T17:37:32.800462] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-09-14T17:37:32.801178] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-09-14T17:37:32.801239] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-09-14T17:37:32.802359] [DEBUG] [LOCAL ] CWK: Trimmed 53595 records to 37114 (keeping 150 days of data) [2025-09-14T17:37:33.020185] [DEBUG] [LOCAL ] CWK: Primary data saved (37114 records). [2025-09-14T17:37:33.020368] [INFO ] [MAIN ] CWK: Full history saved. [2025-09-14T17:37:33.020468] [INFO ] [MAIN ] Update Progress: 574/2370 symbols completed. CWK took 25.7s. Estimated remaining: 3h 8m 51s. Rate: 9.5 symbols/min [2025-09-14T17:37:33.189399] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:37:33.193539] [DEBUG] [LOCAL ] CXH: Loaded 2736 existing records from primary storage. [2025-09-14T17:37:33.193655] [INFO ] [MAIN ] CXH: Loaded 2736 existing records. [2025-09-14T17:37:33.364288] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-09-14T17:37:33.368583] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:37:33.369748] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-09-14T17:37:33.369908] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-09-14T17:37:33.370199] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-09-14T17:37:33.370260] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-09-14T17:37:33.489939] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-14T17:37:33.726191] [INFO ] [REMOTE ] CXH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:37:34.158878] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-09-14T17:37:34.958900] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-09-14T17:37:35.069152] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-14T17:37:35.141239] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-14T17:37:35.318578] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-14T17:37:35.758870] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-09-14T17:37:36.558894] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-09-14T17:37:37.151542] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T17:37:37.358854] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-09-14T17:37:38.049446] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-14T17:37:38.158800] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-09-14T17:37:38.653689] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-14T17:37:38.653555] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T17:37:38.958827] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-09-14T17:37:39.391313] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-14T17:37:39.758893] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-09-14T17:37:40.558856] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-09-14T17:37:41.212815] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-14T17:37:41.358874] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-09-14T17:37:41.485508] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T17:37:42.029844] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-14T17:37:42.158884] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-09-14T17:37:42.958890] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-09-14T17:37:43.557975] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-14T17:37:43.758863] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-09-14T17:37:44.271836] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T17:37:44.558858] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-09-14T17:37:45.179459] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-14T17:37:45.358829] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-09-14T17:37:45.505297] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-14T17:37:46.158846] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-09-14T17:37:46.643573] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-14T17:37:46.958959] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-09-14T17:37:47.501568] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T17:37:47.505783] [INFO ] [REMOTE ] CWT: Full fetch complete (30651 records). [2025-09-14T17:37:47.505953] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-09-14T17:37:47.763936] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-09-14T17:37:47.922904] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-09-14T17:37:47.923129] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-09-14T17:37:47.923743] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-09-14T17:37:47.923921] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-09-14T17:37:47.925197] [DEBUG] [LOCAL ] CWT: Trimmed 30651 records to 20471 (keeping 150 days of data) [2025-09-14T17:37:48.059083] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T17:37:48.089919] [DEBUG] [LOCAL ] CWT: Primary data saved (20471 records). [2025-09-14T17:37:48.090086] [INFO ] [MAIN ] CWT: Full history saved. [2025-09-14T17:37:48.090188] [INFO ] [MAIN ] Update Progress: 575/2370 symbols completed. CWT took 23.2s. Estimated remaining: 3h 9m 12s. Rate: 9.5 symbols/min [2025-09-14T17:37:48.286544] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:37:48.292306] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-14T17:37:48.312327] [DEBUG] [LOCAL ] CXM: Loaded 21454 existing records from primary storage. [2025-09-14T17:37:48.312490] [INFO ] [MAIN ] CXM: Loaded 21454 existing records. [2025-09-14T17:37:48.496964] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:37:48.497340] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-09-14T17:37:48.497410] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-09-14T17:37:48.498104] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-09-14T17:37:48.498179] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-09-14T17:37:48.564093] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-09-14T17:37:48.857914] [INFO ] [REMOTE ] CXM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:37:49.358878] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-09-14T17:37:50.058415] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-14T17:37:50.158836] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-09-14T17:37:50.241299] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-14T17:37:50.246929] [INFO ] [REMOTE ] CX: Full fetch complete (57447 records). [2025-09-14T17:37:50.247073] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-09-14T17:37:50.622658] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-09-14T17:37:50.622796] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-09-14T17:37:50.623688] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-09-14T17:37:50.623764] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-09-14T17:37:50.625100] [DEBUG] [LOCAL ] CX: Trimmed 57447 records to 39740 (keeping 150 days of data) [2025-09-14T17:37:50.715280] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-14T17:37:50.864790] [DEBUG] [LOCAL ] CX: Primary data saved (39740 records). [2025-09-14T17:37:50.865000] [INFO ] [MAIN ] CX: Full history saved. [2025-09-14T17:37:50.865127] [INFO ] [MAIN ] Update Progress: 576/2370 symbols completed. CX took 23.1s. Estimated remaining: 3h 8m 55s. Rate: 9.5 symbols/min [2025-09-14T17:37:50.966060] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-09-14T17:37:51.064623] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:37:51.081120] [DEBUG] [LOCAL ] CXT: Loaded 13913 existing records from primary storage. [2025-09-14T17:37:51.081335] [INFO ] [MAIN ] CXT: Loaded 13913 existing records. [2025-09-14T17:37:51.270305] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:37:51.270593] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-09-14T17:37:51.270677] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-09-14T17:37:51.271201] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-09-14T17:37:51.271264] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-09-14T17:37:51.618422] [INFO ] [REMOTE ] CXT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:37:51.678181] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:37:51.679970] [INFO ] [REMOTE ] CXE: Full fetch complete (8191 records). [2025-09-14T17:37:51.680094] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-09-14T17:37:51.763997] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-09-14T17:37:52.046778] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-09-14T17:37:52.046888] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-09-14T17:37:52.047121] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-09-14T17:37:52.047172] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-09-14T17:37:52.047660] [DEBUG] [LOCAL ] CXE: Trimmed 8191 records to 4713 (keeping 150 days of data) [2025-09-14T17:37:52.075342] [DEBUG] [LOCAL ] CXE: Primary data saved (4713 records). [2025-09-14T17:37:52.075531] [INFO ] [MAIN ] CXE: Full history saved. [2025-09-14T17:37:52.075636] [INFO ] [MAIN ] Update Progress: 577/2370 symbols completed. CXE took 22.2s. Estimated remaining: 3h 8m 32s. Rate: 9.5 symbols/min [2025-09-14T17:37:52.252421] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:37:52.274461] [DEBUG] [LOCAL ] CXW: Loaded 19641 existing records from primary storage. [2025-09-14T17:37:52.274689] [INFO ] [MAIN ] CXW: Loaded 19641 existing records. [2025-09-14T17:37:52.452817] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:37:52.453108] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-09-14T17:37:52.453181] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-09-14T17:37:52.453763] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-09-14T17:37:52.453830] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-09-14T17:37:52.563985] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-09-14T17:37:52.807010] [INFO ] [REMOTE ] CXW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:37:53.346599] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T17:37:53.358714] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-09-14T17:37:53.637180] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T17:37:53.972295] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-14T17:37:54.158824] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-09-14T17:37:54.958852] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-09-14T17:37:55.478851] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-14T17:37:55.758877] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-09-14T17:37:56.558844] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-09-14T17:37:56.663375] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T17:37:57.244557] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-14T17:37:57.264808] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T17:37:57.358775] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-09-14T17:37:58.158828] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-09-14T17:37:58.699597] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-14T17:37:58.837285] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-14T17:37:58.958840] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-09-14T17:37:59.758838] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-09-14T17:38:00.297158] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T17:38:00.298661] [INFO ] [REMOTE ] CXH: Full fetch complete (4562 records). [2025-09-14T17:38:00.298764] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-09-14T17:38:00.441695] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T17:38:00.565285] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-09-14T17:38:00.700123] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-09-14T17:38:00.700237] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-09-14T17:38:00.700412] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-09-14T17:38:00.700465] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-09-14T17:38:00.700894] [DEBUG] [LOCAL ] CXH: Trimmed 4562 records to 3883 (keeping 150 days of data) [2025-09-14T17:38:00.723394] [DEBUG] [LOCAL ] CXH: Primary data saved (3883 records). [2025-09-14T17:38:00.723481] [INFO ] [MAIN ] CXH: Full history saved. [2025-09-14T17:38:00.723573] [INFO ] [MAIN ] Update Progress: 578/2370 symbols completed. CXH took 27.7s. Estimated remaining: 3h 8m 33s. Rate: 9.5 symbols/min [2025-09-14T17:38:00.896279] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:38:00.909696] [DEBUG] [LOCAL ] CYD: Loaded 11837 existing records from primary storage. [2025-09-14T17:38:00.909839] [INFO ] [MAIN ] CYD: Loaded 11837 existing records. [2025-09-14T17:38:01.092187] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:38:01.092501] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-09-14T17:38:01.092561] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-09-14T17:38:01.092977] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-09-14T17:38:01.093037] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-09-14T17:38:01.366383] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-09-14T17:38:01.446897] [INFO ] [REMOTE ] CYD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:38:01.889969] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-14T17:38:02.158847] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-09-14T17:38:02.958870] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-09-14T17:38:03.241362] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T17:38:03.314517] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T17:38:03.758892] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-09-14T17:38:04.558832] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-09-14T17:38:04.681747] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T17:38:04.729151] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-14T17:38:05.358882] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-09-14T17:38:05.843306] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T17:38:06.158834] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-09-14T17:38:06.779303] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T17:38:06.782912] [INFO ] [REMOTE ] CXT: Full fetch complete (34030 records). [2025-09-14T17:38:06.783031] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-09-14T17:38:06.967402] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-09-14T17:38:07.175959] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-09-14T17:38:07.176318] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-09-14T17:38:07.176997] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-09-14T17:38:07.177286] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-09-14T17:38:07.207986] [DEBUG] [LOCAL ] CXT: Trimmed 34030 records to 22501 (keeping 150 days of data) [2025-09-14T17:38:07.210199] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T17:38:07.358858] [DEBUG] [LOCAL ] CXT: Primary data saved (22501 records). [2025-09-14T17:38:07.359020] [INFO ] [MAIN ] CXT: Full history saved. [2025-09-14T17:38:07.359152] [INFO ] [MAIN ] Update Progress: 579/2370 symbols completed. CXT took 16.5s. Estimated remaining: 3h 8m 28s. Rate: 9.5 symbols/min [2025-09-14T17:38:07.537818] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:38:07.558185] [DEBUG] [LOCAL ] CYH: Loaded 21567 existing records from primary storage. [2025-09-14T17:38:07.558360] [INFO ] [MAIN ] CYH: Loaded 21567 existing records. [2025-09-14T17:38:07.760085] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:38:07.759720] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-09-14T17:38:07.761369] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-09-14T17:38:07.761466] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-09-14T17:38:07.762248] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-09-14T17:38:07.762337] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-09-14T17:38:08.122921] [INFO ] [REMOTE ] CYH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:38:08.563966] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-09-14T17:38:08.583169] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-14T17:38:09.209814] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-14T17:38:09.358833] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-09-14T17:38:10.158861] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-09-14T17:38:10.267739] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T17:38:10.545731] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T17:38:10.958849] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-09-14T17:38:11.388392] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-14T17:38:11.758830] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-09-14T17:38:12.565518] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-09-14T17:38:12.573777] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T17:38:12.801028] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-14T17:38:13.358835] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-09-14T17:38:14.158788] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-09-14T17:38:14.196116] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T17:38:14.763934] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-14T17:38:14.958833] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-09-14T17:38:15.500217] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-14T17:38:15.758820] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-09-14T17:38:16.155122] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T17:38:16.558792] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-09-14T17:38:16.931066] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-14T17:38:17.358834] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-09-14T17:38:17.906763] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T17:38:18.158876] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-09-14T17:38:18.558437] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-14T17:38:18.958829] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-09-14T17:38:19.758787] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-09-14T17:38:19.870675] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T17:38:20.070917] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-14T17:38:20.074779] [INFO ] [REMOTE ] CYD: Full fetch complete (28861 records). [2025-09-14T17:38:20.074875] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-09-14T17:38:20.445877] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-09-14T17:38:20.445994] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-09-14T17:38:20.446598] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-09-14T17:38:20.446675] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-09-14T17:38:20.447448] [DEBUG] [LOCAL ] CYD: Trimmed 28861 records to 19326 (keeping 150 days of data) [2025-09-14T17:38:20.559029] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-09-14T17:38:20.568482] [DEBUG] [LOCAL ] CYD: Primary data saved (19326 records). [2025-09-14T17:38:20.568723] [INFO ] [MAIN ] CYD: Full history saved. [2025-09-14T17:38:20.568916] [INFO ] [MAIN ] Update Progress: 580/2370 symbols completed. CYD took 19.8s. Estimated remaining: 3h 8m 43s. Rate: 9.5 symbols/min [2025-09-14T17:38:20.745102] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:38:20.768525] [DEBUG] [LOCAL ] D: Loaded 24073 existing records from primary storage. [2025-09-14T17:38:20.768748] [INFO ] [MAIN ] D: Loaded 24073 existing records. [2025-09-14T17:38:20.948464] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:38:20.948794] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-09-14T17:38:20.948856] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-09-14T17:38:20.949610] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-09-14T17:38:20.949701] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-09-14T17:38:21.303503] [INFO ] [REMOTE ] D: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:38:21.359683] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-09-14T17:38:21.371425] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T17:38:22.158831] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-09-14T17:38:22.397289] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-14T17:38:22.958821] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-09-14T17:38:23.199320] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-14T17:38:23.681451] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T17:38:23.758815] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-09-14T17:38:24.486004] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-14T17:38:24.531067] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T17:38:24.536214] [INFO ] [REMOTE ] CXW: Full fetch complete (49044 records). [2025-09-14T17:38:24.536366] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-09-14T17:38:24.563979] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-09-14T17:38:24.974413] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-09-14T17:38:24.974541] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-09-14T17:38:24.975329] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-09-14T17:38:24.975406] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-09-14T17:38:24.976730] [DEBUG] [LOCAL ] CXW: Trimmed 49044 records to 33263 (keeping 150 days of data) [2025-09-14T17:38:25.191141] [DEBUG] [LOCAL ] CXW: Primary data saved (33263 records). [2025-09-14T17:38:25.191350] [INFO ] [MAIN ] CXW: Full history saved. [2025-09-14T17:38:25.191506] [INFO ] [MAIN ] Update Progress: 581/2370 symbols completed. CXW took 33.1s. Estimated remaining: 3h 8m 31s. Rate: 9.5 symbols/min [2025-09-14T17:38:25.372345] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-09-14T17:38:25.377370] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:38:25.385519] [DEBUG] [LOCAL ] DAC: Loaded 5318 existing records from primary storage. [2025-09-14T17:38:25.385718] [INFO ] [MAIN ] DAC: Loaded 5318 existing records. [2025-09-14T17:38:25.562190] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:38:25.562434] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-09-14T17:38:25.562512] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-14T17:38:25.562800] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-09-14T17:38:25.562861] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-09-14T17:38:25.921188] [INFO ] [REMOTE ] DAC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:38:26.158842] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-09-14T17:38:26.498558] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-14T17:38:26.698666] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T17:38:26.802736] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:38:26.807985] [INFO ] [REMOTE ] CXM: Full fetch complete (52000 records). [2025-09-14T17:38:26.808149] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-09-14T17:38:26.978310] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-09-14T17:38:27.190121] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-09-14T17:38:27.190236] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-09-14T17:38:27.191234] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-09-14T17:38:27.191309] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-09-14T17:38:27.192716] [DEBUG] [LOCAL ] CXM: Trimmed 52000 records to 35801 (keeping 150 days of data) [2025-09-14T17:38:27.399495] [DEBUG] [LOCAL ] CXM: Primary data saved (35801 records). [2025-09-14T17:38:27.399700] [INFO ] [MAIN ] CXM: Full history saved. [2025-09-14T17:38:27.399802] [INFO ] [MAIN ] Update Progress: 582/2370 symbols completed. CXM took 39.3s. Estimated remaining: 3h 8m 12s. Rate: 9.5 symbols/min [2025-09-14T17:38:27.571566] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:38:27.594690] [DEBUG] [LOCAL ] DAL: Loaded 24113 existing records from primary storage. [2025-09-14T17:38:27.594880] [INFO ] [MAIN ] DAL: Loaded 24113 existing records. [2025-09-14T17:38:27.766867] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-09-14T17:38:27.774114] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:38:27.774326] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-09-14T17:38:27.774418] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-09-14T17:38:27.775172] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-09-14T17:38:27.775262] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-09-14T17:38:28.137312] [INFO ] [REMOTE ] DAL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:38:28.558836] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-09-14T17:38:28.893696] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T17:38:29.358850] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-09-14T17:38:29.537788] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T17:38:29.629743] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T17:38:30.158841] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-09-14T17:38:30.958832] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-09-14T17:38:31.276898] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-14T17:38:31.585402] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-14T17:38:31.694322] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-14T17:38:31.699273] [INFO ] [REMOTE ] CYH: Full fetch complete (52836 records). [2025-09-14T17:38:31.699406] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-09-14T17:38:31.763940] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-09-14T17:38:32.079430] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-09-14T17:38:32.079557] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-09-14T17:38:32.080360] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-09-14T17:38:32.080442] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-09-14T17:38:32.081704] [DEBUG] [LOCAL ] CYH: Trimmed 52836 records to 36354 (keeping 150 days of data) [2025-09-14T17:38:32.294402] [DEBUG] [LOCAL ] CYH: Primary data saved (36354 records). [2025-09-14T17:38:32.294623] [INFO ] [MAIN ] CYH: Full history saved. [2025-09-14T17:38:32.294797] [INFO ] [MAIN ] Update Progress: 583/2370 symbols completed. CYH took 24.9s. Estimated remaining: 3h 8m 2s. Rate: 9.5 symbols/min [2025-09-14T17:38:32.479743] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:38:32.503186] [DEBUG] [LOCAL ] DAN: Loaded 22225 existing records from primary storage. [2025-09-14T17:38:32.503394] [INFO ] [MAIN ] DAN: Loaded 22225 existing records. [2025-09-14T17:38:32.566874] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-09-14T17:38:32.683898] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:38:32.684164] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-09-14T17:38:32.684244] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-09-14T17:38:32.684924] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-09-14T17:38:32.685007] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-09-14T17:38:33.038158] [INFO ] [REMOTE ] DAN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:38:33.358849] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-09-14T17:38:33.641563] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-14T17:38:34.158890] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-09-14T17:38:34.415399] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-14T17:38:34.457224] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-14T17:38:34.958850] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-09-14T17:38:35.758819] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-09-14T17:38:36.242604] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-14T17:38:36.374033] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-14T17:38:36.558840] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-09-14T17:38:37.234556] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-14T17:38:37.316443] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-14T17:38:37.358798] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-09-14T17:38:38.158913] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-09-14T17:38:38.958938] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-09-14T17:38:39.063403] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-14T17:38:39.758971] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-09-14T17:38:39.972361] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-14T17:38:40.272098] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-14T17:38:40.558865] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-09-14T17:38:40.603178] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-14T17:38:41.358866] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-09-14T17:38:42.110939] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T17:38:42.112524] [INFO ] [REMOTE ] DAC: Full fetch complete (14335 records). [2025-09-14T17:38:42.112611] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-09-14T17:38:42.168953] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-09-14T17:38:42.486509] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-09-14T17:38:42.486718] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-09-14T17:38:42.487215] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-09-14T17:38:42.503683] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-09-14T17:38:42.521447] [DEBUG] [LOCAL ] DAC: Trimmed 14335 records to 9159 (keeping 150 days of data) [2025-09-14T17:38:42.521299] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-14T17:38:42.592104] [DEBUG] [LOCAL ] DAC: Primary data saved (9159 records). [2025-09-14T17:38:42.592273] [INFO ] [MAIN ] DAC: Full history saved. [2025-09-14T17:38:42.592375] [INFO ] [MAIN ] Update Progress: 584/2370 symbols completed. DAC took 17.4s. Estimated remaining: 3h 8m 8s. Rate: 9.5 symbols/min [2025-09-14T17:38:42.762462] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:38:42.771957] [DEBUG] [LOCAL ] DAO: Loaded 7542 existing records from primary storage. [2025-09-14T17:38:42.772099] [INFO ] [MAIN ] DAO: Loaded 7542 existing records. [2025-09-14T17:38:42.948152] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:38:42.948486] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-09-14T17:38:42.948558] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-09-14T17:38:42.948881] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-09-14T17:38:42.948941] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-09-14T17:38:42.969498] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-09-14T17:38:43.309018] [INFO ] [REMOTE ] DAO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:38:43.758881] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-09-14T17:38:44.346198] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-14T17:38:44.558828] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-09-14T17:38:44.949975] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-14T17:38:45.127584] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T17:38:45.133193] [INFO ] [REMOTE ] D: Full fetch complete (58324 records). [2025-09-14T17:38:45.133354] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-09-14T17:38:45.359949] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-09-14T17:38:45.520539] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-09-14T17:38:45.520688] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-09-14T17:38:45.521550] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-09-14T17:38:45.521759] [DEBUG] [LOCAL ] D: Saving primary data. [2025-09-14T17:38:45.551844] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T17:38:45.562740] [DEBUG] [LOCAL ] D: Trimmed 58324 records to 40397 (keeping 150 days of data) [2025-09-14T17:38:45.823834] [DEBUG] [LOCAL ] D: Primary data saved (40397 records). [2025-09-14T17:38:45.824005] [INFO ] [MAIN ] D: Full history saved. [2025-09-14T17:38:45.824111] [INFO ] [MAIN ] Update Progress: 585/2370 symbols completed. D took 25.3s. Estimated remaining: 3h 7m 52s. Rate: 9.5 symbols/min [2025-09-14T17:38:45.995465] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:38:46.017604] [DEBUG] [LOCAL ] DAR: Loaded 23500 existing records from primary storage. [2025-09-14T17:38:46.017814] [INFO ] [MAIN ] DAR: Loaded 23500 existing records. [2025-09-14T17:38:46.164093] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-09-14T17:38:46.200898] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:38:46.201176] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-09-14T17:38:46.201255] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-09-14T17:38:46.202159] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-09-14T17:38:46.202233] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-09-14T17:38:46.572493] [INFO ] [REMOTE ] DAR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:38:46.958862] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-09-14T17:38:47.189251] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-14T17:38:47.758818] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-09-14T17:38:48.033145] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T17:38:48.558807] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-09-14T17:38:48.611380] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-14T17:38:49.358826] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-09-14T17:38:50.151542] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-14T17:38:50.163070] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-09-14T17:38:50.268113] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-14T17:38:50.654991] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-14T17:38:50.958848] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-09-14T17:38:51.268381] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-14T17:38:51.758841] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-09-14T17:38:52.544154] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T17:38:52.558777] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-09-14T17:38:53.196088] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-14T17:38:53.358824] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-09-14T17:38:54.158834] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-09-14T17:38:54.365539] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T17:38:54.958856] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-09-14T17:38:55.106247] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-14T17:38:55.580915] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-14T17:38:55.758839] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-09-14T17:38:56.558857] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-09-14T17:38:56.717741] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-14T17:38:56.940209] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-14T17:38:57.258616] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T17:38:57.263730] [INFO ] [REMOTE ] DAN: Full fetch complete (53332 records). [2025-09-14T17:38:57.263864] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-09-14T17:38:57.365250] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-09-14T17:38:57.671009] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-09-14T17:38:57.671155] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-09-14T17:38:57.672018] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-09-14T17:38:57.672101] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-09-14T17:38:57.673504] [DEBUG] [LOCAL ] DAN: Trimmed 53332 records to 36951 (keeping 150 days of data) [2025-09-14T17:38:57.790376] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T17:38:57.799396] [INFO ] [REMOTE ] DAL: Full fetch complete (58433 records). [2025-09-14T17:38:57.800627] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-09-14T17:38:58.162237] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-09-14T17:38:58.203489] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-09-14T17:38:58.204662] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-09-14T17:38:58.206149] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-09-14T17:38:58.207019] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-09-14T17:38:58.210669] [DEBUG] [LOCAL ] DAL: Trimmed 58433 records to 40493 (keeping 150 days of data) [2025-09-14T17:38:58.529673] [DEBUG] [LOCAL ] DAN: Primary data saved (36951 records). [2025-09-14T17:38:58.530689] [INFO ] [MAIN ] DAN: Full history saved. [2025-09-14T17:38:58.534837] [INFO ] [MAIN ] Update Progress: 586/2370 symbols completed. DAN took 26.2s. Estimated remaining: 3h 8m 5s. Rate: 9.5 symbols/min [2025-09-14T17:38:58.720083] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:38:58.747754] [DEBUG] [LOCAL ] DAVA: Loaded 18392 existing records from primary storage. [2025-09-14T17:38:58.748632] [INFO ] [MAIN ] DAVA: Loaded 18392 existing records. [2025-09-14T17:38:58.748732] [DEBUG] [LOCAL ] DAL: Primary data saved (40493 records). [2025-09-14T17:38:58.790612] [INFO ] [MAIN ] DAL: Full history saved. [2025-09-14T17:38:58.822048] [INFO ] [MAIN ] Update Progress: 587/2370 symbols completed. DAL took 31.4s. Estimated remaining: 3h 7m 40s. Rate: 9.5 symbols/min [2025-09-14T17:38:58.983512] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-09-14T17:38:59.023680] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:38:59.050506] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-09-14T17:38:59.077993] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-09-14T17:38:59.102714] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-09-14T17:38:59.102629] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:38:59.102859] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-09-14T17:38:59.393964] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-14T17:38:59.408683] [DEBUG] [LOCAL ] DAY: Loaded 22348 existing records from primary storage. [2025-09-14T17:38:59.414582] [INFO ] [MAIN ] DAY: Loaded 22348 existing records. [2025-09-14T17:38:59.580656] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:38:59.656357] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:38:59.656543] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-09-14T17:38:59.656602] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-09-14T17:38:59.657175] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-09-14T17:38:59.657240] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-09-14T17:38:59.763902] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-09-14T17:39:00.006037] [INFO ] [REMOTE ] DAY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:39:00.558795] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-09-14T17:39:00.896581] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-14T17:39:01.276627] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T17:39:01.358893] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-09-14T17:39:02.047469] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T17:39:02.158829] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-09-14T17:39:02.673508] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-14T17:39:02.958836] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-09-14T17:39:03.758832] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-09-14T17:39:04.558898] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-09-14T17:39:05.229018] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-14T17:39:05.292690] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (3.13 seconds). [2025-09-14T17:39:05.358800] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-09-14T17:39:05.620673] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T17:39:06.070712] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T17:39:06.158868] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-09-14T17:39:06.958836] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-09-14T17:39:07.196471] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T17:39:07.384330] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T17:39:07.758829] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-09-14T17:39:07.990492] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-14T17:39:08.558842] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-09-14T17:39:09.258487] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T17:39:09.358795] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-09-14T17:39:10.158863] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-09-14T17:39:10.388456] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T17:39:10.954247] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-14T17:39:10.962322] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-09-14T17:39:11.699758] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T17:39:11.702284] [INFO ] [REMOTE ] DAO: Full fetch complete (24603 records). [2025-09-14T17:39:11.702448] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-09-14T17:39:11.764969] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-09-14T17:39:12.080874] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-09-14T17:39:12.081015] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-09-14T17:39:12.081728] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-09-14T17:39:12.081909] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-09-14T17:39:12.093747] [DEBUG] [LOCAL ] DAO: Trimmed 24603 records to 13641 (keeping 150 days of data) [2025-09-14T17:39:12.146711] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-14T17:39:12.205513] [DEBUG] [LOCAL ] DAO: Primary data saved (13641 records). [2025-09-14T17:39:12.205719] [INFO ] [MAIN ] DAO: Full history saved. [2025-09-14T17:39:12.205914] [INFO ] [MAIN ] Update Progress: 588/2370 symbols completed. DAO took 29.6s. Estimated remaining: 3h 7m 55s. Rate: 9.5 symbols/min [2025-09-14T17:39:12.373624] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:39:12.389063] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T17:39:12.394713] [INFO ] [REMOTE ] DAR: Full fetch complete (56332 records). [2025-09-14T17:39:12.394851] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-09-14T17:39:12.582981] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-09-14T17:39:12.589701] [DEBUG] [LOCAL ] DB: Loaded 23468 existing records from primary storage. [2025-09-14T17:39:12.673081] [INFO ] [MAIN ] DB: Loaded 23468 existing records. [2025-09-14T17:39:12.962387] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-09-14T17:39:12.979587] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-09-14T17:39:12.983866] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-09-14T17:39:12.984142] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-09-14T17:39:12.984006] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:39:12.984606] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-09-14T17:39:12.984708] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-14T17:39:12.985737] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-09-14T17:39:12.985854] [DEBUG] [LOCAL ] DAR: Trimmed 56332 records to 39024 (keeping 150 days of data) [2025-09-14T17:39:12.986108] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-09-14T17:39:13.359879] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-09-14T17:39:13.522945] [INFO ] [REMOTE ] DB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:39:13.578833] [DEBUG] [LOCAL ] DAR: Primary data saved (39024 records). [2025-09-14T17:39:13.578993] [INFO ] [MAIN ] DAR: Full history saved. [2025-09-14T17:39:13.579088] [INFO ] [MAIN ] Update Progress: 589/2370 symbols completed. DAR took 27.8s. Estimated remaining: 3h 7m 34s. Rate: 9.5 symbols/min [2025-09-14T17:39:13.755771] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:39:13.775305] [DEBUG] [LOCAL ] DBD: Loaded 18458 existing records from primary storage. [2025-09-14T17:39:13.775499] [INFO ] [MAIN ] DBD: Loaded 18458 existing records. [2025-09-14T17:39:13.953810] [WARN ] [MAIN ] DBD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:39:13.954098] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-09-14T17:39:13.954169] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-14T17:39:13.955078] [DEBUG] [LOCAL ] DBD: Deleted primary data file. [2025-09-14T17:39:13.955150] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-09-14T17:39:14.167980] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-09-14T17:39:14.323801] [INFO ] [REMOTE ] DBD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:39:14.347332] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T17:39:14.958881] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-09-14T17:39:15.166323] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-14T17:39:15.758842] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-09-14T17:39:16.158192] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-14T17:39:16.177543] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-14T17:39:16.367491] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-14T17:39:16.558833] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-09-14T17:39:17.358826] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-09-14T17:39:17.698741] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-14T17:39:17.704151] [INFO ] [REMOTE ] DAVA: Full fetch complete (43330 records). [2025-09-14T17:39:17.704333] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-09-14T17:39:18.099514] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-09-14T17:39:18.099675] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-09-14T17:39:18.100563] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-09-14T17:39:18.100659] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-09-14T17:39:18.101956] [DEBUG] [LOCAL ] DAVA: Trimmed 43330 records to 30679 (keeping 150 days of data) [2025-09-14T17:39:18.166189] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-09-14T17:39:18.290671] [DEBUG] [LOCAL ] DAVA: Primary data saved (30679 records). [2025-09-14T17:39:18.290846] [INFO ] [MAIN ] DAVA: Full history saved. [2025-09-14T17:39:18.290964] [INFO ] [MAIN ] Update Progress: 590/2370 symbols completed. DAVA took 19.8s. Estimated remaining: 3h 7m 23s. Rate: 9.5 symbols/min [2025-09-14T17:39:18.466866] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:39:18.485934] [DEBUG] [LOCAL ] DBI: Loaded 19377 existing records from primary storage. [2025-09-14T17:39:18.486121] [INFO ] [MAIN ] DBI: Loaded 19377 existing records. [2025-09-14T17:39:18.664874] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:39:18.665126] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-09-14T17:39:18.665204] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-09-14T17:39:18.665767] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-09-14T17:39:18.665838] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-09-14T17:39:18.963973] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-09-14T17:39:19.031638] [INFO ] [REMOTE ] DBI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:39:19.159241] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-14T17:39:19.758873] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-09-14T17:39:20.530074] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-14T17:39:20.558777] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-09-14T17:39:20.753879] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-09-14T17:39:21.225039] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-14T17:39:21.358821] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-09-14T17:39:21.597580] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-14T17:39:22.158806] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-09-14T17:39:22.958796] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-09-14T17:39:23.030323] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T17:39:23.758875] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-09-14T17:39:23.947809] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T17:39:24.443330] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-14T17:39:24.558789] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-09-14T17:39:25.144027] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-14T17:39:25.239073] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-14T17:39:25.358804] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-09-14T17:39:26.158841] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-09-14T17:39:26.804732] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T17:39:26.810671] [INFO ] [REMOTE ] DAY: Full fetch complete (54529 records). [2025-09-14T17:39:26.810804] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-09-14T17:39:26.962994] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-09-14T17:39:27.191768] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-09-14T17:39:27.191965] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-09-14T17:39:27.192798] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-09-14T17:39:27.192916] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-09-14T17:39:27.195657] [DEBUG] [LOCAL ] DAY: Trimmed 54529 records to 37479 (keeping 150 days of data) [2025-09-14T17:39:27.225460] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T17:39:27.454430] [DEBUG] [LOCAL ] DAY: Primary data saved (37479 records). [2025-09-14T17:39:27.454603] [INFO ] [MAIN ] DAY: Full history saved. [2025-09-14T17:39:27.454790] [INFO ] [MAIN ] Update Progress: 591/2370 symbols completed. DAY took 28.6s. Estimated remaining: 3h 7m 25s. Rate: 9.5 symbols/min [2025-09-14T17:39:27.622269] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:39:27.630209] [DEBUG] [LOCAL ] DBL: Loaded 4934 existing records from primary storage. [2025-09-14T17:39:27.630353] [INFO ] [MAIN ] DBL: Loaded 4934 existing records. [2025-09-14T17:39:27.770074] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-09-14T17:39:27.844290] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:39:27.844529] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-09-14T17:39:27.844583] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-09-14T17:39:27.844897] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-09-14T17:39:27.844958] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-09-14T17:39:28.195197] [INFO ] [REMOTE ] DBL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:39:28.470913] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-14T17:39:28.558784] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-09-14T17:39:29.002850] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-14T17:39:29.038997] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-14T17:39:29.358824] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-09-14T17:39:30.158893] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-09-14T17:39:30.958845] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-09-14T17:39:31.169189] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-14T17:39:31.758914] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-09-14T17:39:31.911266] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-14T17:39:32.073447] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T17:39:32.558928] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-09-14T17:39:33.204675] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-14T17:39:33.358860] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-09-14T17:39:33.716869] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-14T17:39:34.158895] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-09-14T17:39:34.233941] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-14T17:39:34.958837] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-09-14T17:39:35.688164] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-14T17:39:35.758854] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-09-14T17:39:36.111281] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-14T17:39:36.558890] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-09-14T17:39:36.586630] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T17:39:37.358844] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-09-14T17:39:38.158933] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-09-14T17:39:38.221883] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-14T17:39:38.227514] [INFO ] [REMOTE ] DB: Full fetch complete (57049 records). [2025-09-14T17:39:38.227697] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-09-14T17:39:38.589090] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T17:39:38.619057] [INFO ] [REMOTE ] DBD: Full fetch complete (25049 records). [2025-09-14T17:39:38.625089] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-09-14T17:39:38.640524] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-09-14T17:39:38.640909] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-09-14T17:39:38.642238] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-09-14T17:39:38.674102] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-09-14T17:39:38.821799] [DEBUG] [LOCAL ] DB: Trimmed 57049 records to 39472 (keeping 150 days of data) [2025-09-14T17:39:38.986812] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-09-14T17:39:39.153733] [DEBUG] [VALIDATOR ] DBD: All expected trading days are present. [2025-09-14T17:39:39.154923] [DEBUG] [VALIDATOR ] DBD: Primary data validation passed. [2025-09-14T17:39:39.157691] [INFO ] [MAIN ] DBD: Fetched primary data is valid. [2025-09-14T17:39:39.156352] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T17:39:39.157793] [DEBUG] [LOCAL ] DBD: Saving primary data. [2025-09-14T17:39:39.172022] [DEBUG] [LOCAL ] DBD: Trimmed 25049 records to 18458 (keeping 150 days of data) [2025-09-14T17:39:39.401322] [DEBUG] [LOCAL ] DBD: Primary data saved (18458 records). [2025-09-14T17:39:39.402381] [INFO ] [MAIN ] DBD: Full history saved. [2025-09-14T17:39:39.402536] [INFO ] [MAIN ] Update Progress: 592/2370 symbols completed. DBD took 25.8s. Estimated remaining: 3h 7m 36s. Rate: 9.5 symbols/min [2025-09-14T17:39:39.579873] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:39:39.615072] [DEBUG] [LOCAL ] DBRG: Loaded 22262 existing records from primary storage. [2025-09-14T17:39:39.617055] [INFO ] [MAIN ] DBRG: Loaded 22262 existing records. [2025-09-14T17:39:39.725301] [DEBUG] [LOCAL ] DB: Primary data saved (39472 records). [2025-09-14T17:39:39.725948] [INFO ] [MAIN ] DB: Full history saved. [2025-09-14T17:39:39.736623] [INFO ] [MAIN ] Update Progress: 593/2370 symbols completed. DB took 27.5s. Estimated remaining: 3h 7m 12s. Rate: 9.5 symbols/min [2025-09-14T17:39:39.776856] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-09-14T17:39:39.880036] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:39:39.926787] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-09-14T17:39:39.971910] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-09-14T17:39:39.989153] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:39:39.990382] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-09-14T17:39:39.990524] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-09-14T17:39:40.131324] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-14T17:39:40.197692] [DEBUG] [LOCAL ] DCI: Loaded 16614 existing records from primary storage. [2025-09-14T17:39:40.233214] [INFO ] [MAIN ] DCI: Loaded 16614 existing records. [2025-09-14T17:39:40.567540] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:39:40.564122] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-09-14T17:39:40.570825] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:39:40.572160] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-09-14T17:39:40.572228] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-09-14T17:39:40.572765] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-09-14T17:39:40.572845] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-09-14T17:39:40.935841] [INFO ] [REMOTE ] DCI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:39:41.358801] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-09-14T17:39:41.397195] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-14T17:39:41.460868] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T17:39:42.158863] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-09-14T17:39:42.958856] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-09-14T17:39:43.108033] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T17:39:43.292913] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-14T17:39:43.687612] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T17:39:43.689117] [INFO ] [REMOTE ] DBL: Full fetch complete (9843 records). [2025-09-14T17:39:43.689205] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-09-14T17:39:43.764297] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-09-14T17:39:44.070752] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-09-14T17:39:44.070877] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-09-14T17:39:44.071149] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-09-14T17:39:44.071203] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-09-14T17:39:44.071831] [DEBUG] [LOCAL ] DBL: Trimmed 9843 records to 7122 (keeping 150 days of data) [2025-09-14T17:39:44.117804] [DEBUG] [LOCAL ] DBL: Primary data saved (7122 records). [2025-09-14T17:39:44.118004] [INFO ] [MAIN ] DBL: Full history saved. [2025-09-14T17:39:44.118131] [INFO ] [MAIN ] Update Progress: 594/2370 symbols completed. DBL took 16.7s. Estimated remaining: 3h 6m 59s. Rate: 9.5 symbols/min [2025-09-14T17:39:44.298842] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:39:44.308508] [DEBUG] [LOCAL ] DCO: Loaded 7642 existing records from primary storage. [2025-09-14T17:39:44.308717] [INFO ] [MAIN ] DCO: Loaded 7642 existing records. [2025-09-14T17:39:44.485795] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:39:44.486114] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-09-14T17:39:44.486180] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-09-14T17:39:44.486577] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-09-14T17:39:44.486667] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-09-14T17:39:44.563918] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-09-14T17:39:44.839864] [INFO ] [REMOTE ] DCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:39:45.032500] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-14T17:39:45.358855] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-09-14T17:39:46.158836] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-09-14T17:39:46.497007] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T17:39:46.935919] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-14T17:39:46.958817] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-09-14T17:39:46.979406] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-14T17:39:47.758894] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-09-14T17:39:48.331583] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T17:39:48.336852] [INFO ] [REMOTE ] DBI: Full fetch complete (49375 records). [2025-09-14T17:39:48.336994] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-09-14T17:39:48.563940] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-09-14T17:39:48.721490] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-09-14T17:39:48.721637] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-09-14T17:39:48.722539] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-09-14T17:39:48.722692] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-09-14T17:39:48.724226] [DEBUG] [LOCAL ] DBI: Trimmed 49375 records to 33452 (keeping 150 days of data) [2025-09-14T17:39:48.850849] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T17:39:48.971568] [DEBUG] [LOCAL ] DBI: Primary data saved (33452 records). [2025-09-14T17:39:48.971794] [INFO ] [MAIN ] DBI: Full history saved. [2025-09-14T17:39:48.971934] [INFO ] [MAIN ] Update Progress: 595/2370 symbols completed. DBI took 30.7s. Estimated remaining: 3h 6m 49s. Rate: 9.5 symbols/min [2025-09-14T17:39:49.149455] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:39:49.173262] [DEBUG] [LOCAL ] DD: Loaded 23686 existing records from primary storage. [2025-09-14T17:39:49.173460] [INFO ] [MAIN ] DD: Loaded 23686 existing records. [2025-09-14T17:39:49.356574] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:39:49.356874] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-09-14T17:39:49.356936] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-09-14T17:39:49.357676] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-09-14T17:39:49.357739] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-09-14T17:39:49.369485] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-09-14T17:39:49.626788] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-14T17:39:49.731899] [INFO ] [REMOTE ] DD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:39:50.158892] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-09-14T17:39:50.958861] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-09-14T17:39:51.108577] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-14T17:39:51.758936] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-09-14T17:39:52.034217] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T17:39:52.559304] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-14T17:39:52.559379] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-09-14T17:39:52.641378] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-14T17:39:53.358879] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-09-14T17:39:54.158828] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-09-14T17:39:54.534192] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-14T17:39:54.815692] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T17:39:54.958849] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-09-14T17:39:55.589460] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-14T17:39:55.758823] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-09-14T17:39:55.897122] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-14T17:39:56.558832] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-09-14T17:39:57.293083] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T17:39:57.358794] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-09-14T17:39:58.158877] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-09-14T17:39:58.335257] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-14T17:39:58.606470] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-14T17:39:58.958890] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-09-14T17:39:59.753478] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-14T17:39:59.763459] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-09-14T17:39:59.944208] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T17:40:00.558891] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-09-14T17:40:01.358878] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-09-14T17:40:01.780406] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-14T17:40:01.997321] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T17:40:02.158882] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-09-14T17:40:02.910976] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-14T17:40:02.916527] [INFO ] [REMOTE ] DBRG: Full fetch complete (54329 records). [2025-09-14T17:40:02.916727] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-09-14T17:40:02.963996] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-09-14T17:40:03.240010] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-14T17:40:03.342504] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-09-14T17:40:03.342683] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-09-14T17:40:03.343758] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-09-14T17:40:03.343829] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-09-14T17:40:03.345665] [DEBUG] [LOCAL ] DBRG: Trimmed 54329 records to 37419 (keeping 150 days of data) [2025-09-14T17:40:03.592382] [DEBUG] [LOCAL ] DBRG: Primary data saved (37419 records). [2025-09-14T17:40:03.592630] [INFO ] [MAIN ] DBRG: Full history saved. [2025-09-14T17:40:03.592781] [INFO ] [MAIN ] Update Progress: 596/2370 symbols completed. DBRG took 24.2s. Estimated remaining: 3h 7m 7s. Rate: 9.5 symbols/min [2025-09-14T17:40:03.767214] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-09-14T17:40:03.771514] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:40:03.796465] [DEBUG] [LOCAL ] DDD: Loaded 22695 existing records from primary storage. [2025-09-14T17:40:03.796705] [INFO ] [MAIN ] DDD: Loaded 22695 existing records. [2025-09-14T17:40:03.985318] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:40:03.985699] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-09-14T17:40:03.985766] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-14T17:40:03.986502] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-09-14T17:40:03.986574] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-09-14T17:40:04.363494] [INFO ] [REMOTE ] DDD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:40:04.558854] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-09-14T17:40:04.728959] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-14T17:40:05.071894] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-14T17:40:05.358841] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-09-14T17:40:05.379362] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T17:40:06.000202] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:40:06.005261] [INFO ] [REMOTE ] DCI: Full fetch complete (40861 records). [2025-09-14T17:40:06.014286] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-09-14T17:40:06.163995] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-09-14T17:40:06.421929] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-09-14T17:40:06.422068] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-09-14T17:40:06.422821] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-09-14T17:40:06.422887] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-09-14T17:40:06.424228] [DEBUG] [LOCAL ] DCI: Trimmed 40861 records to 27720 (keeping 150 days of data) [2025-09-14T17:40:06.601582] [DEBUG] [LOCAL ] DCI: Primary data saved (27720 records). [2025-09-14T17:40:06.601854] [INFO ] [MAIN ] DCI: Full history saved. [2025-09-14T17:40:06.601987] [INFO ] [MAIN ] Update Progress: 597/2370 symbols completed. DCI took 26.8s. Estimated remaining: 3h 6m 51s. Rate: 9.5 symbols/min [2025-09-14T17:40:06.958883] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-09-14T17:40:07.758795] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-09-14T17:40:08.277212] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-14T17:40:08.558821] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-09-14T17:40:08.679377] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-14T17:40:08.682731] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-14T17:40:08.685154] [INFO ] [REMOTE ] DCO: Full fetch complete (14529 records). [2025-09-14T17:40:08.696529] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-09-14T17:40:09.066806] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-09-14T17:40:09.066938] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-09-14T17:40:09.067402] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-09-14T17:40:09.067477] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-09-14T17:40:09.068080] [DEBUG] [LOCAL ] DCO: Trimmed 14529 records to 10870 (keeping 150 days of data) [2025-09-14T17:40:09.134416] [DEBUG] [LOCAL ] DCO: Primary data saved (10870 records). [2025-09-14T17:40:09.134673] [INFO ] [MAIN ] DCO: Full history saved. [2025-09-14T17:40:09.134818] [INFO ] [MAIN ] Update Progress: 598/2370 symbols completed. DCO took 25.0s. Estimated remaining: 3h 6m 33s. Rate: 9.5 symbols/min [2025-09-14T17:40:09.358887] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-09-14T17:40:10.465032] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-14T17:40:10.477142] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-09-14T17:40:11.167476] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T17:40:11.178604] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-09-14T17:40:11.225870] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T17:40:11.232061] [INFO ] [REMOTE ] DD: Full fetch complete (57381 records). [2025-09-14T17:40:11.232263] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-09-14T17:40:11.613290] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-09-14T17:40:11.613410] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-09-14T17:40:11.614193] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-09-14T17:40:11.614253] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-09-14T17:40:11.615574] [DEBUG] [LOCAL ] DD: Trimmed 57381 records to 39762 (keeping 150 days of data) [2025-09-14T17:40:11.876554] [DEBUG] [LOCAL ] DD: Primary data saved (39762 records). [2025-09-14T17:40:11.876965] [INFO ] [MAIN ] DD: Full history saved. [2025-09-14T17:40:11.877144] [INFO ] [MAIN ] Update Progress: 599/2370 symbols completed. DD took 22.9s. Estimated remaining: 3h 6m 16s. Rate: 9.5 symbols/min [2025-09-14T17:40:12.650236] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-14T17:40:12.661765] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-09-14T17:40:14.567117] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T17:40:14.579920] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-09-14T17:40:16.280418] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-14T17:40:16.291175] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-09-14T17:40:18.188050] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-14T17:40:18.199334] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-09-14T17:40:20.054307] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-14T17:40:20.065837] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-09-14T17:40:20.712689] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T17:40:20.718536] [INFO ] [REMOTE ] DDD: Full fetch complete (55243 records). [2025-09-14T17:40:20.718752] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-09-14T17:40:21.110894] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-09-14T17:40:21.111016] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-09-14T17:40:21.111885] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-09-14T17:40:21.111947] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-09-14T17:40:21.113364] [DEBUG] [LOCAL ] DDD: Trimmed 55243 records to 38100 (keeping 150 days of data) [2025-09-14T17:40:21.331265] [DEBUG] [LOCAL ] DDD: Primary data saved (38100 records). [2025-09-14T17:40:21.331451] [INFO ] [MAIN ] DDD: Full history saved. [2025-09-14T17:40:21.331551] [INFO ] [MAIN ] Update Progress: 600/2370 symbols completed. DDD took 17.7s. Estimated remaining: 3h 6m 19s. Rate: 9.5 symbols/min [2025-09-14T17:40:21.951604] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:40:22.091205] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:40:22.127219] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:40:22.129434] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:40:22.133177] [DEBUG] [LOCAL ] DDT: Loaded 917 existing records from primary storage. [2025-09-14T17:40:22.133812] [INFO ] [MAIN ] DDT: Loaded 917 existing records. [2025-09-14T17:40:22.255083] [DEBUG] [LOCAL ] DDS: Loaded 5774 existing records from primary storage. [2025-09-14T17:40:22.283422] [DEBUG] [LOCAL ] DDL: Loaded 13375 existing records from primary storage. [2025-09-14T17:40:22.345168] [DEBUG] [LOCAL ] DE: Loaded 21308 existing records from primary storage. [2025-09-14T17:40:22.288755] [INFO ] [MAIN ] DDS: Loaded 5774 existing records. [2025-09-14T17:40:22.351533] [INFO ] [MAIN ] DE: Loaded 21308 existing records. [2025-09-14T17:40:22.351228] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:40:22.361939] [INFO ] [MAIN ] DDL: Loaded 13375 existing records. [2025-09-14T17:40:22.608120] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-09-14T17:40:22.667318] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-09-14T17:40:22.757200] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-09-14T17:40:22.839501] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-09-14T17:40:22.834334] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:40:22.790705] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:40:22.870732] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-09-14T17:40:22.907949] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-09-14T17:40:22.913235] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-09-14T17:40:22.965695] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-09-14T17:40:22.978070] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:40:23.012594] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-09-14T17:40:23.025407] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-09-14T17:40:23.025499] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-09-14T17:40:23.036217] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-09-14T17:40:23.041421] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-09-14T17:40:23.080662] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-09-14T17:40:23.071939] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-09-14T17:40:23.139440] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-09-14T17:40:24.004742] [INFO ] [REMOTE ] DDT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:40:24.063559] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-09-14T17:40:24.279694] [INFO ] [REMOTE ] DE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:40:24.275969] [INFO ] [REMOTE ] DDS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:40:24.280322] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-09-14T17:40:24.280102] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-09-14T17:40:24.363234] [INFO ] [REMOTE ] DDL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:40:24.363721] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-09-14T17:40:24.727637] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-14T17:40:24.729006] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-09-14T17:40:25.294067] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-14T17:40:25.297188] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-09-14T17:40:25.353989] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-14T17:40:25.355251] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-09-14T17:40:25.467209] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T17:40:25.474753] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-09-14T17:40:25.677955] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-14T17:40:25.688031] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-09-14T17:40:25.780527] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-14T17:40:25.782205] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-09-14T17:40:26.310243] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-14T17:40:26.311438] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-09-14T17:40:26.425322] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-14T17:40:26.429376] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-09-14T17:40:26.546360] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-14T17:40:26.557595] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-09-14T17:40:26.642962] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-14T17:40:26.644198] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-09-14T17:40:27.166347] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-14T17:40:27.167903] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-09-14T17:40:27.401409] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-14T17:40:27.585553] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T17:40:27.691627] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-14T17:40:27.758794] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-09-14T17:40:27.956060] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-14T17:40:28.558865] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-09-14T17:40:28.749374] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T17:40:29.358851] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-09-14T17:40:29.685250] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T17:40:29.686179] [INFO ] [REMOTE ] DDT: Full fetch complete (2195 records). [2025-09-14T17:40:29.686268] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-09-14T17:40:30.044733] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-09-14T17:40:30.044851] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-09-14T17:40:30.044987] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-09-14T17:40:30.045050] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-09-14T17:40:30.045410] [DEBUG] [LOCAL ] DDT: Trimmed 2195 records to 1389 (keeping 150 days of data) [2025-09-14T17:40:30.054778] [DEBUG] [LOCAL ] DDT: Primary data saved (1389 records). [2025-09-14T17:40:30.054860] [INFO ] [MAIN ] DDT: Full history saved. [2025-09-14T17:40:30.054961] [INFO ] [MAIN ] Update Progress: 601/2370 symbols completed. DDT took 8.7s. Estimated remaining: 3h 6m 20s. Rate: 9.5 symbols/min [2025-09-14T17:40:30.163947] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-09-14T17:40:30.232738] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:40:30.250729] [DEBUG] [LOCAL ] DEA: Loaded 17034 existing records from primary storage. [2025-09-14T17:40:30.250919] [INFO ] [MAIN ] DEA: Loaded 17034 existing records. [2025-09-14T17:40:30.430018] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:40:30.430313] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-09-14T17:40:30.430500] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-09-14T17:40:30.431169] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-09-14T17:40:30.431236] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-09-14T17:40:30.812577] [INFO ] [REMOTE ] DEA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:40:30.824936] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-14T17:40:30.958805] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-09-14T17:40:31.137188] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T17:40:31.758893] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-09-14T17:40:32.564077] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-09-14T17:40:32.575877] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-14T17:40:32.652743] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-14T17:40:33.358847] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-09-14T17:40:34.158857] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-09-14T17:40:34.248215] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T17:40:34.632070] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-14T17:40:34.958909] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-09-14T17:40:35.758839] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-09-14T17:40:35.910402] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T17:40:35.935842] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-14T17:40:36.554599] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-14T17:40:36.558764] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-09-14T17:40:37.358888] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-09-14T17:40:37.371244] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T17:40:37.374564] [INFO ] [REMOTE ] DDS: Full fetch complete (14789 records). [2025-09-14T17:40:37.374721] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-09-14T17:40:37.769031] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-09-14T17:40:37.769166] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-09-14T17:40:37.769747] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-09-14T17:40:37.769810] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-09-14T17:40:37.770516] [DEBUG] [LOCAL ] DDS: Trimmed 14789 records to 9703 (keeping 150 days of data) [2025-09-14T17:40:37.836685] [DEBUG] [LOCAL ] DDS: Primary data saved (9703 records). [2025-09-14T17:40:37.836923] [INFO ] [MAIN ] DDS: Full history saved. [2025-09-14T17:40:37.837050] [INFO ] [MAIN ] Update Progress: 602/2370 symbols completed. DDS took 16.5s. Estimated remaining: 3h 6m 18s. Rate: 9.5 symbols/min [2025-09-14T17:40:38.018007] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:40:38.033152] [DEBUG] [LOCAL ] DEC: Loaded 12270 existing records from primary storage. [2025-09-14T17:40:38.033359] [INFO ] [MAIN ] DEC: Loaded 12270 existing records. [2025-09-14T17:40:38.164083] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-09-14T17:40:38.230106] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:40:38.230437] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-09-14T17:40:38.230506] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-14T17:40:38.230997] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-09-14T17:40:38.231065] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-09-14T17:40:38.629239] [INFO ] [REMOTE ] DEC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:40:38.717802] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-14T17:40:38.958897] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-09-14T17:40:39.757752] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T17:40:39.767495] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-09-14T17:40:40.558881] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-09-14T17:40:40.798228] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-14T17:40:40.856344] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T17:40:41.358868] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-09-14T17:40:42.158876] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-09-14T17:40:42.278917] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T17:40:42.936070] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-14T17:40:42.958786] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-09-14T17:40:43.758914] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-09-14T17:40:44.003320] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T17:40:44.250891] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-14T17:40:44.558901] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-09-14T17:40:45.323765] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-14T17:40:45.358795] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-09-14T17:40:45.777578] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-14T17:40:46.158831] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-09-14T17:40:46.937244] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-14T17:40:46.958793] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-09-14T17:40:47.577401] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T17:40:47.758897] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-09-14T17:40:48.127633] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-14T17:40:48.132768] [INFO ] [REMOTE ] DE: Full fetch complete (52274 records). [2025-09-14T17:40:48.132888] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-09-14T17:40:48.538486] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T17:40:48.538592] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-09-14T17:40:48.546693] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-09-14T17:40:48.548069] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-09-14T17:40:48.548457] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-09-14T17:40:48.549760] [DEBUG] [LOCAL ] DE: Trimmed 52274 records to 35483 (keeping 150 days of data) [2025-09-14T17:40:48.608196] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-09-14T17:40:48.786547] [DEBUG] [LOCAL ] DE: Primary data saved (35483 records). [2025-09-14T17:40:48.786771] [INFO ] [MAIN ] DE: Full history saved. [2025-09-14T17:40:48.786901] [INFO ] [MAIN ] Update Progress: 603/2370 symbols completed. DE took 27.5s. Estimated remaining: 3h 6m 25s. Rate: 9.5 symbols/min [2025-09-14T17:40:48.954469] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:40:48.977692] [DEBUG] [LOCAL ] DECK: Loaded 23922 existing records from primary storage. [2025-09-14T17:40:48.977884] [INFO ] [MAIN ] DECK: Loaded 23922 existing records. [2025-09-14T17:40:49.150868] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:40:49.151165] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-09-14T17:40:49.151234] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-09-14T17:40:49.151994] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-09-14T17:40:49.152057] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-09-14T17:40:49.370176] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-09-14T17:40:49.523632] [INFO ] [REMOTE ] DECK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:40:49.778262] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-14T17:40:50.158846] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-09-14T17:40:50.831904] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-14T17:40:50.958878] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-09-14T17:40:51.758890] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-09-14T17:40:52.007383] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-14T17:40:52.373252] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-14T17:40:52.558950] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-09-14T17:40:53.092534] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-14T17:40:53.097146] [INFO ] [REMOTE ] DDL: Full fetch complete (39494 records). [2025-09-14T17:40:53.097281] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-09-14T17:40:53.363885] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-09-14T17:40:53.478468] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-09-14T17:40:53.478586] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-09-14T17:40:53.479279] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-09-14T17:40:53.479355] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-09-14T17:40:53.480497] [DEBUG] [LOCAL ] DDL: Trimmed 39494 records to 26209 (keeping 150 days of data) [2025-09-14T17:40:53.626192] [DEBUG] [LOCAL ] DDL: Primary data saved (26209 records). [2025-09-14T17:40:53.626359] [INFO ] [MAIN ] DDL: Full history saved. [2025-09-14T17:40:53.626469] [INFO ] [MAIN ] Update Progress: 604/2370 symbols completed. DDL took 32.3s. Estimated remaining: 3h 6m 15s. Rate: 9.5 symbols/min [2025-09-14T17:40:53.795003] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:40:53.812106] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T17:40:53.834365] [DEBUG] [LOCAL ] DEI: Loaded 21269 existing records from primary storage. [2025-09-14T17:40:53.834553] [INFO ] [MAIN ] DEI: Loaded 21269 existing records. [2025-09-14T17:40:54.011403] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:40:54.011735] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-09-14T17:40:54.011796] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-14T17:40:54.012326] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-09-14T17:40:54.012389] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-09-14T17:40:54.168762] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-09-14T17:40:54.370517] [INFO ] [REMOTE ] DEI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:40:54.958877] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-09-14T17:40:55.365688] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-14T17:40:55.368569] [INFO ] [REMOTE ] DEC: Full fetch complete (34051 records). [2025-09-14T17:40:55.368697] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-09-14T17:40:55.744506] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-09-14T17:40:55.744864] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-09-14T17:40:55.745605] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-09-14T17:40:55.745954] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-09-14T17:40:55.758713] [DEBUG] [LOCAL ] DEC: Trimmed 34051 records to 21746 (keeping 150 days of data) [2025-09-14T17:40:55.758836] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-09-14T17:40:55.758557] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T17:40:55.765260] [INFO ] [REMOTE ] DEA: Full fetch complete (46468 records). [2025-09-14T17:40:55.765454] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-09-14T17:40:56.025756] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-09-14T17:40:56.317763] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-09-14T17:40:56.320803] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-09-14T17:40:56.321399] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-09-14T17:40:56.324442] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-09-14T17:40:56.337761] [DEBUG] [LOCAL ] DEC: Primary data saved (21746 records). [2025-09-14T17:40:56.338101] [INFO ] [MAIN ] DEC: Full history saved. [2025-09-14T17:40:56.338256] [DEBUG] [LOCAL ] DEA: Trimmed 46468 records to 29951 (keeping 150 days of data) [2025-09-14T17:40:56.338371] [INFO ] [MAIN ] Update Progress: 605/2370 symbols completed. DEC took 18.5s. Estimated remaining: 3h 5m 58s. Rate: 9.5 symbols/min [2025-09-14T17:40:56.563796] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-09-14T17:40:56.610132] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:40:56.680977] [DEBUG] [LOCAL ] DELL: Loaded 24101 existing records from primary storage. [2025-09-14T17:40:56.701923] [INFO ] [MAIN ] DELL: Loaded 24101 existing records. [2025-09-14T17:40:56.882413] [DEBUG] [LOCAL ] DEA: Primary data saved (29951 records). [2025-09-14T17:40:56.902717] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:40:56.902604] [INFO ] [MAIN ] DEA: Full history saved. [2025-09-14T17:40:56.902892] [INFO ] [MAIN ] Update Progress: 606/2370 symbols completed. DEA took 26.8s. Estimated remaining: 3h 5m 35s. Rate: 9.5 symbols/min [2025-09-14T17:40:56.903050] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-09-14T17:40:56.903162] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-14T17:40:56.946260] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-09-14T17:40:57.001456] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-09-14T17:40:57.186864] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:40:57.423319] [DEBUG] [LOCAL ] DEO: Loaded 22257 existing records from primary storage. [2025-09-14T17:40:57.455630] [INFO ] [MAIN ] DEO: Loaded 22257 existing records. [2025-09-14T17:40:57.459934] [INFO ] [REMOTE ] DELL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:40:57.460702] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-09-14T17:40:57.644268] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:40:57.644537] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-09-14T17:40:57.644594] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-09-14T17:40:57.645312] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-09-14T17:40:57.645375] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-09-14T17:40:57.845303] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-14T17:40:58.055370] [INFO ] [REMOTE ] DEO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:40:58.158847] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-09-14T17:40:58.424340] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T17:40:58.958834] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-09-14T17:40:59.758861] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-09-14T17:40:59.931419] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-09-14T17:41:00.133503] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-14T17:41:00.558884] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-09-14T17:41:01.027778] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-14T17:41:01.358807] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-09-14T17:41:01.659309] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T17:41:02.158848] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-09-14T17:41:02.891132] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-14T17:41:02.958786] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-09-14T17:41:03.470288] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-14T17:41:03.624849] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-14T17:41:03.758844] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-09-14T17:41:04.558808] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-09-14T17:41:04.613840] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T17:41:05.358807] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-09-14T17:41:05.394499] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-14T17:41:06.158833] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-09-14T17:41:06.497131] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-14T17:41:06.958871] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-09-14T17:41:07.319333] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-14T17:41:07.758839] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-09-14T17:41:07.793295] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T17:41:08.558866] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-09-14T17:41:08.956966] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-14T17:41:09.358839] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-09-14T17:41:09.683504] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T17:41:10.158835] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-09-14T17:41:10.693724] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T17:41:10.699314] [INFO ] [REMOTE ] DECK: Full fetch complete (58002 records). [2025-09-14T17:41:10.699445] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-09-14T17:41:10.963484] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-09-14T17:41:11.101115] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-09-14T17:41:11.101405] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-09-14T17:41:11.102277] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-09-14T17:41:11.102485] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-09-14T17:41:11.104515] [DEBUG] [LOCAL ] DECK: Trimmed 58002 records to 40114 (keeping 150 days of data) [2025-09-14T17:41:11.133525] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T17:41:11.281365] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-09-14T17:41:11.452436] [DEBUG] [LOCAL ] DECK: Primary data saved (40114 records). [2025-09-14T17:41:11.452693] [INFO ] [MAIN ] DECK: Full history saved. [2025-09-14T17:41:11.452819] [INFO ] [MAIN ] Update Progress: 607/2370 symbols completed. DECK took 22.7s. Estimated remaining: 3h 5m 52s. Rate: 9.5 symbols/min [2025-09-14T17:41:11.631177] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:41:11.646447] [DEBUG] [LOCAL ] DFH: Loaded 14327 existing records from primary storage. [2025-09-14T17:41:11.646677] [INFO ] [MAIN ] DFH: Loaded 14327 existing records. [2025-09-14T17:41:11.764029] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-09-14T17:41:11.843680] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:41:11.843979] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-09-14T17:41:11.844046] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-09-14T17:41:11.844520] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-09-14T17:41:11.844593] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-09-14T17:41:12.193982] [INFO ] [REMOTE ] DFH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:41:12.558821] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-09-14T17:41:12.997959] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-14T17:41:13.358835] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-09-14T17:41:13.546767] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-14T17:41:14.144956] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T17:41:14.158784] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-09-14T17:41:14.958848] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-09-14T17:41:15.110852] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T17:41:15.359375] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-14T17:41:15.591193] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T17:41:15.596284] [INFO ] [REMOTE ] DEI: Full fetch complete (52496 records). [2025-09-14T17:41:15.596418] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-09-14T17:41:15.772600] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-09-14T17:41:15.986972] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-09-14T17:41:15.987087] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-09-14T17:41:15.987801] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-09-14T17:41:15.987860] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-09-14T17:41:15.989355] [DEBUG] [LOCAL ] DEI: Trimmed 52496 records to 36290 (keeping 150 days of data) [2025-09-14T17:41:16.212160] [DEBUG] [LOCAL ] DEI: Primary data saved (36290 records). [2025-09-14T17:41:16.212345] [INFO ] [MAIN ] DEI: Full history saved. [2025-09-14T17:41:16.212525] [INFO ] [MAIN ] Update Progress: 608/2370 symbols completed. DEI took 22.6s. Estimated remaining: 3h 5m 42s. Rate: 9.5 symbols/min [2025-09-14T17:41:16.381017] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:41:16.392083] [DEBUG] [LOCAL ] DFIN: Loaded 9184 existing records from primary storage. [2025-09-14T17:41:16.392252] [INFO ] [MAIN ] DFIN: Loaded 9184 existing records. [2025-09-14T17:41:16.564157] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-09-14T17:41:16.570704] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:41:16.571069] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-09-14T17:41:16.571161] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-09-14T17:41:16.571607] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-09-14T17:41:16.571701] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-09-14T17:41:16.930064] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:41:17.358901] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-09-14T17:41:17.431261] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-14T17:41:17.437003] [INFO ] [REMOTE ] DEO: Full fetch complete (53224 records). [2025-09-14T17:41:17.437150] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-09-14T17:41:17.817931] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-09-14T17:41:17.818083] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-09-14T17:41:17.818915] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-09-14T17:41:17.818988] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-09-14T17:41:17.820261] [DEBUG] [LOCAL ] DEO: Trimmed 53224 records to 36454 (keeping 150 days of data) [2025-09-14T17:41:18.049725] [DEBUG] [LOCAL ] DEO: Primary data saved (36454 records). [2025-09-14T17:41:18.049920] [INFO ] [MAIN ] DEO: Full history saved. [2025-09-14T17:41:18.050045] [INFO ] [MAIN ] Update Progress: 609/2370 symbols completed. DEO took 21.1s. Estimated remaining: 3h 5m 22s. Rate: 9.5 symbols/min [2025-09-14T17:41:18.163886] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-09-14T17:41:18.231834] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:41:18.240738] [DEBUG] [LOCAL ] DFP: Loaded 5327 existing records from primary storage. [2025-09-14T17:41:18.240935] [INFO ] [MAIN ] DFP: Loaded 5327 existing records. [2025-09-14T17:41:18.418958] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:41:18.419250] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-09-14T17:41:18.419310] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-14T17:41:18.419606] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-09-14T17:41:18.419690] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-09-14T17:41:18.779519] [INFO ] [REMOTE ] DFP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:41:18.795193] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T17:41:18.853985] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-14T17:41:18.958789] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-09-14T17:41:19.759593] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-09-14T17:41:19.762122] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T17:41:20.558808] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-09-14T17:41:21.098029] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-14T17:41:21.361197] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-09-14T17:41:21.364122] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-14T17:41:21.927125] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-14T17:41:21.962006] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-14T17:41:22.158790] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-09-14T17:41:22.817757] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-14T17:41:22.958800] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-09-14T17:41:23.758839] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-09-14T17:41:24.558833] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-09-14T17:41:25.119663] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-14T17:41:25.237714] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-14T17:41:25.358795] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-09-14T17:41:25.381486] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-14T17:41:26.158824] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-09-14T17:41:26.958814] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-09-14T17:41:27.274795] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T17:41:27.758807] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-09-14T17:41:27.816847] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-14T17:41:28.324817] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-14T17:41:28.364604] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T17:41:28.558827] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-09-14T17:41:29.358826] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-09-14T17:41:29.900582] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T17:41:30.158793] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-09-14T17:41:30.327041] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T17:41:30.958825] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-09-14T17:41:31.553767] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T17:41:31.568730] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-14T17:41:31.758874] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-09-14T17:41:32.558834] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-09-14T17:41:33.102073] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T17:41:33.105774] [INFO ] [REMOTE ] DFH: Full fetch complete (36248 records). [2025-09-14T17:41:33.105933] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-09-14T17:41:33.365069] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-09-14T17:41:33.480096] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-09-14T17:41:33.480221] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-09-14T17:41:33.481016] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-09-14T17:41:33.481110] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-09-14T17:41:33.482056] [DEBUG] [LOCAL ] DFH: Trimmed 36248 records to 24215 (keeping 150 days of data) [2025-09-14T17:41:33.631888] [DEBUG] [LOCAL ] DFH: Primary data saved (24215 records). [2025-09-14T17:41:33.632051] [INFO ] [MAIN ] DFH: Full history saved. [2025-09-14T17:41:33.632167] [INFO ] [MAIN ] Update Progress: 610/2370 symbols completed. DFH took 22.2s. Estimated remaining: 3h 5m 43s. Rate: 9.5 symbols/min [2025-09-14T17:41:33.798578] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:41:33.851297] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-14T17:41:33.849960] [DEBUG] [LOCAL ] DG: Loaded 23816 existing records from primary storage. [2025-09-14T17:41:33.851493] [INFO ] [MAIN ] DG: Loaded 23816 existing records. [2025-09-14T17:41:34.035977] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:41:34.036277] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-09-14T17:41:34.036359] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-09-14T17:41:34.037084] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-09-14T17:41:34.037149] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-09-14T17:41:34.175254] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-09-14T17:41:34.392012] [INFO ] [REMOTE ] DG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:41:34.399865] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-14T17:41:34.878806] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T17:41:34.886329] [INFO ] [REMOTE ] DELL: Full fetch complete (58416 records). [2025-09-14T17:41:34.886501] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-09-14T17:41:34.964060] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-09-14T17:41:35.284663] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-09-14T17:41:35.284791] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-09-14T17:41:35.287439] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-09-14T17:41:35.287572] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-09-14T17:41:35.288938] [DEBUG] [LOCAL ] DELL: Trimmed 58416 records to 40477 (keeping 150 days of data) [2025-09-14T17:41:35.557484] [DEBUG] [LOCAL ] DELL: Primary data saved (40477 records). [2025-09-14T17:41:35.557699] [INFO ] [MAIN ] DELL: Full history saved. [2025-09-14T17:41:35.557823] [INFO ] [MAIN ] Update Progress: 611/2370 symbols completed. DELL took 39.2s. Estimated remaining: 3h 5m 24s. Rate: 9.5 symbols/min [2025-09-14T17:41:35.729190] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:41:35.752163] [DEBUG] [LOCAL ] DGX: Loaded 19786 existing records from primary storage. [2025-09-14T17:41:35.752374] [INFO ] [MAIN ] DGX: Loaded 19786 existing records. [2025-09-14T17:41:35.763899] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-09-14T17:41:35.940086] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:41:35.940423] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-09-14T17:41:35.940549] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-09-14T17:41:35.948123] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-09-14T17:41:35.948250] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-09-14T17:41:35.991441] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-14T17:41:36.301920] [INFO ] [REMOTE ] DGX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:41:36.558883] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-09-14T17:41:37.358881] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-09-14T17:41:37.770938] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-14T17:41:37.845925] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-14T17:41:38.158855] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-09-14T17:41:38.212755] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-14T17:41:38.215375] [INFO ] [REMOTE ] DFP: Full fetch complete (12715 records). [2025-09-14T17:41:38.215595] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-09-14T17:41:38.589429] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-09-14T17:41:38.589557] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-09-14T17:41:38.589895] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-09-14T17:41:38.589961] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-09-14T17:41:38.590599] [DEBUG] [LOCAL ] DFP: Trimmed 12715 records to 8600 (keeping 150 days of data) [2025-09-14T17:41:38.646148] [DEBUG] [LOCAL ] DFP: Primary data saved (8600 records). [2025-09-14T17:41:38.646345] [INFO ] [MAIN ] DFP: Full history saved. [2025-09-14T17:41:38.646452] [INFO ] [MAIN ] Update Progress: 612/2370 symbols completed. DFP took 20.6s. Estimated remaining: 3h 5m 8s. Rate: 9.5 symbols/min [2025-09-14T17:41:38.822900] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:41:38.833623] [DEBUG] [LOCAL ] DHF: Loaded 9870 existing records from primary storage. [2025-09-14T17:41:38.833831] [INFO ] [MAIN ] DHF: Loaded 9870 existing records. [2025-09-14T17:41:38.964019] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-09-14T17:41:39.018501] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:41:39.018838] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-09-14T17:41:39.018905] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-14T17:41:39.019295] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-09-14T17:41:39.019358] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-09-14T17:41:39.374478] [INFO ] [REMOTE ] DHF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:41:39.758849] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-09-14T17:41:39.963314] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T17:41:40.004372] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-14T17:41:40.558824] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-09-14T17:41:40.679153] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-14T17:41:41.358855] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-09-14T17:41:41.670897] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-14T17:41:42.158851] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-09-14T17:41:42.958836] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-09-14T17:41:43.029537] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T17:41:43.758852] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-09-14T17:41:44.075614] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T17:41:44.267120] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-14T17:41:44.558900] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-09-14T17:41:45.358807] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-09-14T17:41:45.512410] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-14T17:41:45.544194] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T17:41:46.158841] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-09-14T17:41:46.408833] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-09-14T17:41:46.411469] [INFO ] [REMOTE ] DFIN: Full fetch complete (25954 records). [2025-09-14T17:41:46.411638] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-09-14T17:41:46.776383] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-09-14T17:41:46.776497] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-09-14T17:41:46.777100] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-09-14T17:41:46.777166] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-09-14T17:41:46.777969] [DEBUG] [LOCAL ] DFIN: Trimmed 25954 records to 16451 (keeping 150 days of data) [2025-09-14T17:41:46.874009] [DEBUG] [LOCAL ] DFIN: Primary data saved (16451 records). [2025-09-14T17:41:46.874175] [INFO ] [MAIN ] DFIN: Full history saved. [2025-09-14T17:41:46.874279] [INFO ] [MAIN ] Update Progress: 613/2370 symbols completed. DFIN took 30.7s. Estimated remaining: 3h 5m 7s. Rate: 9.5 symbols/min [2025-09-14T17:41:46.966539] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-09-14T17:41:47.050892] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:41:47.075035] [DEBUG] [LOCAL ] DHI: Loaded 23933 existing records from primary storage. [2025-09-14T17:41:47.075201] [INFO ] [MAIN ] DHI: Loaded 23933 existing records. [2025-09-14T17:41:47.255502] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:41:47.255827] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-09-14T17:41:47.255903] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-14T17:41:47.256786] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-09-14T17:41:47.256855] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-09-14T17:41:47.614980] [INFO ] [REMOTE ] DHI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:41:47.649885] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-14T17:41:47.758793] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-09-14T17:41:48.239412] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-14T17:41:48.558884] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-09-14T17:41:49.358884] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-09-14T17:41:49.687023] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-14T17:41:50.158854] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-09-14T17:41:50.331024] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-14T17:41:50.381009] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T17:41:50.958840] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-09-14T17:41:51.758849] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-09-14T17:41:52.179383] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-14T17:41:52.558820] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-09-14T17:41:52.974619] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-14T17:41:53.296732] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T17:41:53.358789] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-09-14T17:41:54.158813] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-09-14T17:41:54.238874] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T17:41:54.958844] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-09-14T17:41:55.093062] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-14T17:41:55.772608] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-09-14T17:41:55.778683] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-14T17:41:56.558787] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-09-14T17:41:56.817924] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T17:41:56.943603] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-14T17:41:57.101257] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T17:41:57.105606] [INFO ] [REMOTE ] DGX: Full fetch complete (49923 records). [2025-09-14T17:41:57.105789] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-09-14T17:41:57.364057] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-09-14T17:41:57.512703] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-09-14T17:41:57.512831] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-09-14T17:41:57.513592] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-09-14T17:41:57.513683] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-09-14T17:41:57.514755] [DEBUG] [LOCAL ] DGX: Trimmed 49923 records to 33788 (keeping 150 days of data) [2025-09-14T17:41:57.727303] [DEBUG] [LOCAL ] DGX: Primary data saved (33788 records). [2025-09-14T17:41:57.727497] [INFO ] [MAIN ] DGX: Full history saved. [2025-09-14T17:41:57.727601] [INFO ] [MAIN ] Update Progress: 614/2370 symbols completed. DGX took 22.2s. Estimated remaining: 3h 5m 14s. Rate: 9.5 symbols/min [2025-09-14T17:41:57.901310] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:41:57.925565] [DEBUG] [LOCAL ] DHR: Loaded 23865 existing records from primary storage. [2025-09-14T17:41:57.925794] [INFO ] [MAIN ] DHR: Loaded 23865 existing records. [2025-09-14T17:41:58.099403] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:41:58.099716] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-09-14T17:41:58.099780] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-14T17:41:58.100491] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-09-14T17:41:58.100554] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-09-14T17:41:58.164063] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-09-14T17:41:58.459113] [INFO ] [REMOTE ] DHR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:41:58.958896] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-09-14T17:41:59.128620] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-14T17:41:59.758905] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-09-14T17:42:00.074565] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-14T17:42:00.558887] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-09-14T17:42:00.765700] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T17:42:00.825839] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-14T17:42:01.358922] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-09-14T17:42:02.158843] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-09-14T17:42:02.958806] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-09-14T17:42:03.159756] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-14T17:42:03.758885] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-09-14T17:42:04.436162] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (3.08 seconds). [2025-09-14T17:42:04.558879] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-09-14T17:42:04.863428] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-14T17:42:04.869594] [INFO ] [REMOTE ] DG: Full fetch complete (57969 records). [2025-09-14T17:42:04.869829] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-09-14T17:42:05.288590] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-09-14T17:42:05.288779] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-09-14T17:42:05.289895] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-09-14T17:42:05.289966] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-09-14T17:42:05.291701] [DEBUG] [LOCAL ] DG: Trimmed 57969 records to 40084 (keeping 150 days of data) [2025-09-14T17:42:05.370139] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T17:42:05.399276] [INFO ] [REMOTE ] DHF: Full fetch complete (22859 records). [2025-09-14T17:42:05.400708] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-09-14T17:42:05.813114] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-09-14T17:42:05.813439] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-09-14T17:42:05.814174] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-09-14T17:42:05.866019] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-09-14T17:42:05.909369] [DEBUG] [LOCAL ] DHF: Trimmed 22859 records to 16009 (keeping 150 days of data) [2025-09-14T17:42:06.027124] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (3.87 seconds). [2025-09-14T17:42:06.043948] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-09-14T17:42:06.066148] [DEBUG] [LOCAL ] DG: Primary data saved (40084 records). [2025-09-14T17:42:06.067046] [INFO ] [MAIN ] DG: Full history saved. [2025-09-14T17:42:06.067632] [INFO ] [MAIN ] Update Progress: 615/2370 symbols completed. DG took 32.4s. Estimated remaining: 3h 5m 13s. Rate: 9.5 symbols/min [2025-09-14T17:42:06.248736] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:42:06.261485] [DEBUG] [LOCAL ] DHF: Primary data saved (16009 records). [2025-09-14T17:42:06.261936] [INFO ] [MAIN ] DHF: Full history saved. [2025-09-14T17:42:06.262115] [INFO ] [MAIN ] Update Progress: 616/2370 symbols completed. DHF took 27.6s. Estimated remaining: 3h 4m 49s. Rate: 9.5 symbols/min [2025-09-14T17:42:06.378111] [DEBUG] [LOCAL ] DHT: Loaded 20988 existing records from primary storage. [2025-09-14T17:42:06.443591] [INFO ] [MAIN ] DHT: Loaded 20988 existing records. [2025-09-14T17:42:06.500617] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:42:06.489904] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-09-14T17:42:06.586724] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-09-14T17:42:06.617995] [DEBUG] [LOCAL ] DHX: Loaded 5186 existing records from primary storage. [2025-09-14T17:42:06.663923] [INFO ] [MAIN ] DHX: Loaded 5186 existing records. [2025-09-14T17:42:06.684844] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:42:06.760401] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-09-14T17:42:06.787599] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-14T17:42:06.793940] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-09-14T17:42:06.814471] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-09-14T17:42:06.930881] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:42:06.971230] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-09-14T17:42:06.992439] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-14T17:42:07.079503] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-09-14T17:42:07.137786] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-09-14T17:42:07.340584] [INFO ] [REMOTE ] DHT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:42:07.391941] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-09-14T17:42:07.629570] [INFO ] [REMOTE ] DHX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:42:07.626389] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-14T17:42:07.635238] [INFO ] [REMOTE ] DHI: Full fetch complete (58044 records). [2025-09-14T17:42:07.635384] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-09-14T17:42:07.763866] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-09-14T17:42:08.020080] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-09-14T17:42:08.020242] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-09-14T17:42:08.021260] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-09-14T17:42:08.021355] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-09-14T17:42:08.022684] [DEBUG] [LOCAL ] DHI: Trimmed 58044 records to 40196 (keeping 150 days of data) [2025-09-14T17:42:08.153356] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-14T17:42:08.326716] [DEBUG] [LOCAL ] DHI: Primary data saved (40196 records). [2025-09-14T17:42:08.326890] [INFO ] [MAIN ] DHI: Full history saved. [2025-09-14T17:42:08.326986] [INFO ] [MAIN ] Update Progress: 617/2370 symbols completed. DHI took 21.5s. Estimated remaining: 3h 4m 31s. Rate: 9.5 symbols/min [2025-09-14T17:42:08.496910] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:42:08.505103] [DEBUG] [LOCAL ] DIAX: Loaded 5907 existing records from primary storage. [2025-09-14T17:42:08.505279] [INFO ] [MAIN ] DIAX: Loaded 5907 existing records. [2025-09-14T17:42:08.560198] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-09-14T17:42:08.707784] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:42:08.708058] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-09-14T17:42:08.708117] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-14T17:42:08.708480] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-09-14T17:42:08.708542] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-09-14T17:42:09.067024] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:42:09.081197] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-14T17:42:09.112827] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-14T17:42:09.358827] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-09-14T17:42:10.158851] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-09-14T17:42:10.315299] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-14T17:42:10.348329] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T17:42:10.958851] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-09-14T17:42:11.758831] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-09-14T17:42:11.873451] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-14T17:42:11.894269] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-14T17:42:12.457312] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-14T17:42:12.558839] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-09-14T17:42:13.358814] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-09-14T17:42:13.573349] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-14T17:42:14.158837] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-09-14T17:42:14.958820] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-09-14T17:42:15.426711] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-14T17:42:15.758827] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-09-14T17:42:16.358933] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-14T17:42:16.558796] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-09-14T17:42:17.047158] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (2.89 seconds). [2025-09-14T17:42:17.358810] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-09-14T17:42:17.485929] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-14T17:42:17.655986] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-14T17:42:18.158839] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-09-14T17:42:18.881024] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-14T17:42:18.958793] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-09-14T17:42:19.758823] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-09-14T17:42:20.147834] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-14T17:42:20.532686] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-14T17:42:20.558768] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-09-14T17:42:20.734151] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T17:42:21.154734] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-14T17:42:21.358831] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-09-14T17:42:22.158817] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-09-14T17:42:22.178492] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-14T17:42:22.958818] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-09-14T17:42:22.993774] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T17:42:23.758879] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-09-14T17:42:24.558865] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-09-14T17:42:24.697783] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T17:42:24.723849] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-14T17:42:25.358871] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-09-14T17:42:25.401957] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-14T17:42:26.158841] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-09-14T17:42:26.958808] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-09-14T17:42:27.320576] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-14T17:42:27.363355] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-14T17:42:27.366055] [INFO ] [REMOTE ] DHX: Full fetch complete (15591 records). [2025-09-14T17:42:27.366155] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-09-14T17:42:27.761610] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-09-14T17:42:27.761221] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-09-14T17:42:27.761854] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-09-14T17:42:27.762301] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-09-14T17:42:27.762362] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-09-14T17:42:27.763955] [DEBUG] [LOCAL ] DHX: Trimmed 15591 records to 9236 (keeping 150 days of data) [2025-09-14T17:42:27.818731] [DEBUG] [LOCAL ] DHX: Primary data saved (9236 records). [2025-09-14T17:42:27.818917] [INFO ] [MAIN ] DHX: Full history saved. [2025-09-14T17:42:27.819045] [INFO ] [MAIN ] Update Progress: 618/2370 symbols completed. DHX took 21.6s. Estimated remaining: 3h 5m 2s. Rate: 9.5 symbols/min [2025-09-14T17:42:27.987638] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:42:28.004759] [DEBUG] [LOCAL ] DIN: Loaded 16406 existing records from primary storage. [2025-09-14T17:42:28.004942] [INFO ] [MAIN ] DIN: Loaded 16406 existing records. [2025-09-14T17:42:28.183923] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:42:28.184219] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-09-14T17:42:28.184281] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-09-14T17:42:28.184920] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-09-14T17:42:28.184986] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-09-14T17:42:28.550343] [INFO ] [REMOTE ] DIN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:42:28.558779] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-09-14T17:42:28.869488] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-14T17:42:29.308385] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-14T17:42:29.317168] [INFO ] [REMOTE ] DHT: Full fetch complete (52327 records). [2025-09-14T17:42:29.317444] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-09-14T17:42:29.364204] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-09-14T17:42:29.896281] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-09-14T17:42:29.896565] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-09-14T17:42:29.897736] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-09-14T17:42:29.897894] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-09-14T17:42:29.900138] [DEBUG] [LOCAL ] DHT: Trimmed 52327 records to 35605 (keeping 150 days of data) [2025-09-14T17:42:30.074720] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T17:42:30.121704] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T17:42:30.129885] [INFO ] [REMOTE ] DHR: Full fetch complete (58043 records). [2025-09-14T17:42:30.130557] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-09-14T17:42:30.164326] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-09-14T17:42:30.415246] [DEBUG] [LOCAL ] DHT: Primary data saved (35605 records). [2025-09-14T17:42:30.432708] [INFO ] [MAIN ] DHT: Full history saved. [2025-09-14T17:42:30.432883] [INFO ] [MAIN ] Update Progress: 619/2370 symbols completed. DHT took 24.4s. Estimated remaining: 3h 4m 45s. Rate: 9.5 symbols/min [2025-09-14T17:42:30.823024] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:42:30.876459] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-09-14T17:42:30.876583] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-09-14T17:42:30.877488] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-09-14T17:42:30.877553] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-09-14T17:42:30.879085] [DEBUG] [LOCAL ] DHR: Trimmed 58043 records to 40171 (keeping 150 days of data) [2025-09-14T17:42:30.983663] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-09-14T17:42:30.997254] [DEBUG] [LOCAL ] DINO: Loaded 23755 existing records from primary storage. [2025-09-14T17:42:30.998096] [INFO ] [MAIN ] DINO: Loaded 23755 existing records. [2025-09-14T17:42:31.185884] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:42:31.188569] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-09-14T17:42:31.189362] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-09-14T17:42:31.191125] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-09-14T17:42:31.191891] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-09-14T17:42:31.571986] [INFO ] [REMOTE ] DINO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:42:31.703571] [DEBUG] [LOCAL ] DHR: Primary data saved (40171 records). [2025-09-14T17:42:31.703775] [INFO ] [MAIN ] DHR: Full history saved. [2025-09-14T17:42:31.706820] [INFO ] [MAIN ] Update Progress: 620/2370 symbols completed. DHR took 34.0s. Estimated remaining: 3h 4m 25s. Rate: 9.5 symbols/min [2025-09-14T17:42:31.769754] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-09-14T17:42:31.870266] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-14T17:42:31.888243] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:42:31.890470] [INFO ] [REMOTE ] DIAX: Full fetch complete (13011 records). [2025-09-14T17:42:31.890596] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-09-14T17:42:32.185115] [DEBUG] [LOCAL ] DIS: Loaded 24148 existing records from primary storage. [2025-09-14T17:42:32.195893] [INFO ] [MAIN ] DIS: Loaded 24148 existing records. [2025-09-14T17:42:32.374120] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-14T17:42:32.392229] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-09-14T17:42:32.412319] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-09-14T17:42:32.423413] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-09-14T17:42:32.423742] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-09-14T17:42:32.500548] [DEBUG] [LOCAL ] DIAX: Trimmed 13011 records to 8704 (keeping 150 days of data) [2025-09-14T17:42:32.504012] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:42:32.504319] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-09-14T17:42:32.504663] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-09-14T17:42:32.527001] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-09-14T17:42:32.542990] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-09-14T17:42:32.563876] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-09-14T17:42:32.617413] [DEBUG] [LOCAL ] DIAX: Primary data saved (8704 records). [2025-09-14T17:42:32.640119] [INFO ] [MAIN ] DIAX: Full history saved. [2025-09-14T17:42:32.670062] [INFO ] [MAIN ] Update Progress: 621/2370 symbols completed. DIAX took 24.3s. Estimated remaining: 3h 4m 3s. Rate: 9.5 symbols/min [2025-09-14T17:42:33.029140] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:42:33.109808] [DEBUG] [LOCAL ] DIVY: Loaded 468 existing records from primary storage. [2025-09-14T17:42:33.108305] [INFO ] [REMOTE ] DIS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:42:33.110206] [INFO ] [MAIN ] DIVY: Loaded 468 existing records. [2025-09-14T17:42:33.284157] [WARN ] [MAIN ] DIVY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:42:33.284459] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-09-14T17:42:33.284520] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-14T17:42:33.284763] [DEBUG] [LOCAL ] DIVY: Deleted primary data file. [2025-09-14T17:42:33.284823] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-09-14T17:42:33.373059] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-09-14T17:42:33.654011] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:42:33.687506] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-14T17:42:34.158801] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-09-14T17:42:34.229150] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T17:42:34.958839] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-09-14T17:42:35.375686] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-14T17:42:35.733780] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-14T17:42:35.758771] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-09-14T17:42:36.080551] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T17:42:36.558855] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-09-14T17:42:37.358845] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-09-14T17:42:37.710372] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-14T17:42:38.111239] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T17:42:38.155000] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-14T17:42:38.165750] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-09-14T17:42:38.958832] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-09-14T17:42:39.758850] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-09-14T17:42:39.791852] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T17:42:40.266929] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-14T17:42:40.515041] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-14T17:42:40.558793] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-09-14T17:42:41.358832] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-09-14T17:42:41.824086] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-14T17:42:42.158845] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-09-14T17:42:42.958824] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-09-14T17:42:43.118520] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-14T17:42:43.530990] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-14T17:42:43.758851] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-09-14T17:42:44.558858] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-09-14T17:42:44.966443] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-14T17:42:45.113260] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-14T17:42:45.343260] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-14T17:42:45.358779] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-09-14T17:42:45.982132] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T17:42:45.986508] [INFO ] [REMOTE ] DIN: Full fetch complete (40606 records). [2025-09-14T17:42:45.986625] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-09-14T17:42:46.164545] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-09-14T17:42:46.370114] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-09-14T17:42:46.370227] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-09-14T17:42:46.370915] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-09-14T17:42:46.370981] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-09-14T17:42:46.371970] [DEBUG] [LOCAL ] DIN: Trimmed 40606 records to 27267 (keeping 150 days of data) [2025-09-14T17:42:46.538715] [DEBUG] [LOCAL ] DIN: Primary data saved (27267 records). [2025-09-14T17:42:46.538909] [INFO ] [MAIN ] DIN: Full history saved. [2025-09-14T17:42:46.539012] [INFO ] [MAIN ] Update Progress: 622/2370 symbols completed. DIN took 18.7s. Estimated remaining: 3h 4m 18s. Rate: 9.5 symbols/min [2025-09-14T17:42:46.714274] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:42:46.736832] [DEBUG] [LOCAL ] DK: Loaded 22433 existing records from primary storage. [2025-09-14T17:42:46.736998] [INFO ] [MAIN ] DK: Loaded 22433 existing records. [2025-09-14T17:42:46.910379] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:42:46.910680] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-09-14T17:42:46.910742] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-14T17:42:46.911323] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-09-14T17:42:46.911382] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-09-14T17:42:46.964002] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-09-14T17:42:47.271011] [INFO ] [REMOTE ] DK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:42:47.415404] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-14T17:42:47.758831] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-09-14T17:42:48.166172] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-14T17:42:48.558895] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-09-14T17:42:48.790446] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-09-14T17:42:48.920979] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-14T17:42:49.358846] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-09-14T17:42:50.158849] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-09-14T17:42:50.958832] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-14T17:42:51.257306] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-14T17:42:51.259545] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-14T17:42:51.271364] [INFO ] [REMOTE ] DIVY: Full fetch complete (1278 records). [2025-09-14T17:42:51.271535] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-09-14T17:42:51.447382] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-14T17:42:51.447615] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:42:51.447704] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:42:51.447779] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-14T17:42:51.447876] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-14T17:42:51.447943] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-09-14T17:42:51.448069] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-09-14T17:42:51.448193] [INFO ] [MAIN ] Update Progress: 623/2370 symbols completed. DIVY took 18.8s. Estimated remaining: 3h 4m 8s. Rate: 9.5 symbols/min [2025-09-14T17:42:51.622559] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:42:51.631659] [DEBUG] [LOCAL ] DKL: Loaded 6352 existing records from primary storage. [2025-09-14T17:42:51.631850] [INFO ] [MAIN ] DKL: Loaded 6352 existing records. [2025-09-14T17:42:51.763953] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-09-14T17:42:51.823551] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:42:51.823775] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-09-14T17:42:51.823840] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-14T17:42:51.824149] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-09-14T17:42:51.824211] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-09-14T17:42:52.178162] [INFO ] [REMOTE ] DKL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:42:52.508859] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-14T17:42:52.558790] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-09-14T17:42:53.035007] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-14T17:42:53.358848] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-09-14T17:42:54.158837] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-09-14T17:42:54.599210] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-14T17:42:54.958849] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-09-14T17:42:55.088452] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T17:42:55.294578] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T17:42:55.758830] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-09-14T17:42:56.270098] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T17:42:56.275655] [INFO ] [REMOTE ] DINO: Full fetch complete (57625 records). [2025-09-14T17:42:56.275808] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-09-14T17:42:56.564739] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-09-14T17:42:56.657535] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-09-14T17:42:56.657655] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-09-14T17:42:56.658376] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-09-14T17:42:56.658440] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-09-14T17:42:56.659613] [DEBUG] [LOCAL ] DINO: Trimmed 57625 records to 39866 (keeping 150 days of data) [2025-09-14T17:42:56.913560] [DEBUG] [LOCAL ] DINO: Primary data saved (39866 records). [2025-09-14T17:42:56.913809] [INFO ] [MAIN ] DINO: Full history saved. [2025-09-14T17:42:56.913936] [INFO ] [MAIN ] Update Progress: 624/2370 symbols completed. DINO took 26.5s. Estimated remaining: 3h 3m 59s. Rate: 9.5 symbols/min [2025-09-14T17:42:57.095316] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:42:57.117805] [DEBUG] [LOCAL ] DKS: Loaded 22541 existing records from primary storage. [2025-09-14T17:42:57.117985] [INFO ] [MAIN ] DKS: Loaded 22541 existing records. [2025-09-14T17:42:57.325750] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:42:57.327769] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-14T17:42:57.327911] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-09-14T17:42:57.338907] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-09-14T17:42:57.339986] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-09-14T17:42:57.340071] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-09-14T17:42:57.370606] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-09-14T17:42:57.698233] [INFO ] [REMOTE ] DKS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:42:57.715562] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-14T17:42:57.811864] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T17:42:57.817915] [INFO ] [REMOTE ] DIS: Full fetch complete (58468 records). [2025-09-14T17:42:57.818111] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-09-14T17:42:58.163922] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-09-14T17:42:58.244133] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-09-14T17:42:58.244236] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-09-14T17:42:58.245011] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-09-14T17:42:58.245070] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-09-14T17:42:58.246446] [DEBUG] [LOCAL ] DIS: Trimmed 58468 records to 40528 (keeping 150 days of data) [2025-09-14T17:42:58.505872] [DEBUG] [LOCAL ] DIS: Primary data saved (40528 records). [2025-09-14T17:42:58.506044] [INFO ] [MAIN ] DIS: Full history saved. [2025-09-14T17:42:58.506143] [INFO ] [MAIN ] Update Progress: 625/2370 symbols completed. DIS took 26.8s. Estimated remaining: 3h 3m 40s. Rate: 9.5 symbols/min [2025-09-14T17:42:58.673610] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:42:58.687742] [DEBUG] [LOCAL ] DLB: Loaded 13644 existing records from primary storage. [2025-09-14T17:42:58.687911] [INFO ] [MAIN ] DLB: Loaded 13644 existing records. [2025-09-14T17:42:58.870702] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:42:58.871013] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-09-14T17:42:58.871087] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-09-14T17:42:58.871551] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-09-14T17:42:58.871624] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-09-14T17:42:58.963937] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-09-14T17:42:59.244987] [INFO ] [REMOTE ] DLB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:42:59.758852] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-09-14T17:42:59.990599] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-14T17:43:00.413438] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-14T17:43:00.558839] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-09-14T17:43:01.093500] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T17:43:01.358831] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-09-14T17:43:02.158851] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-09-14T17:43:02.877857] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-14T17:43:02.958819] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-09-14T17:43:03.277662] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T17:43:03.355102] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-14T17:43:03.758843] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-09-14T17:43:04.216454] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-14T17:43:04.558809] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-09-14T17:43:04.623149] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T17:43:05.358846] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-09-14T17:43:06.150244] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T17:43:06.160350] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-09-14T17:43:06.593301] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T17:43:06.958856] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-09-14T17:43:07.138563] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-14T17:43:07.758842] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-09-14T17:43:08.208360] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T17:43:08.558836] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-09-14T17:43:09.358832] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-09-14T17:43:09.575869] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T17:43:10.158837] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-09-14T17:43:10.400870] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T17:43:10.451300] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T17:43:10.958826] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-09-14T17:43:11.559190] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-14T17:43:11.758839] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-09-14T17:43:12.558865] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-09-14T17:43:13.072195] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-14T17:43:13.358840] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-09-14T17:43:13.606863] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-14T17:43:13.641710] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T17:43:14.158827] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-09-14T17:43:14.849574] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T17:43:14.851803] [INFO ] [REMOTE ] DKL: Full fetch complete (22236 records). [2025-09-14T17:43:14.851898] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-09-14T17:43:14.961532] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-09-14T17:43:15.260049] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-09-14T17:43:15.260348] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-09-14T17:43:15.261235] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-09-14T17:43:15.261309] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-09-14T17:43:15.262787] [DEBUG] [LOCAL ] DKL: Trimmed 22236 records to 13168 (keeping 150 days of data) [2025-09-14T17:43:15.360472] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-14T17:43:15.390821] [DEBUG] [LOCAL ] DKL: Primary data saved (13168 records). [2025-09-14T17:43:15.391081] [INFO ] [MAIN ] DKL: Full history saved. [2025-09-14T17:43:15.391225] [INFO ] [MAIN ] Update Progress: 626/2370 symbols completed. DKL took 23.9s. Estimated remaining: 3h 4m 3s. Rate: 9.5 symbols/min [2025-09-14T17:43:15.602403] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:43:15.607783] [DEBUG] [LOCAL ] DLNG: Loaded 2227 existing records from primary storage. [2025-09-14T17:43:15.607996] [INFO ] [MAIN ] DLNG: Loaded 2227 existing records. [2025-09-14T17:43:15.770307] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-09-14T17:43:15.792587] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:43:15.793692] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-09-14T17:43:15.793778] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-14T17:43:15.794075] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-09-14T17:43:15.794156] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-09-14T17:43:16.154948] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:43:16.461092] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T17:43:16.558833] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-09-14T17:43:17.358834] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-09-14T17:43:17.662997] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-14T17:43:18.118954] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T17:43:18.158802] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-09-14T17:43:18.958834] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-09-14T17:43:19.028681] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T17:43:19.758829] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-09-14T17:43:19.787062] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T17:43:19.942766] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-14T17:43:20.558830] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-09-14T17:43:21.330160] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-14T17:43:21.340448] [INFO ] [REMOTE ] DK: Full fetch complete (53678 records). [2025-09-14T17:43:21.341179] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-14T17:43:21.341258] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-09-14T17:43:21.364380] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-09-14T17:43:21.734468] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-09-14T17:43:21.734736] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-09-14T17:43:21.735607] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-09-14T17:43:21.735883] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-09-14T17:43:21.737528] [DEBUG] [LOCAL ] DK: Trimmed 53678 records to 37241 (keeping 150 days of data) [2025-09-14T17:43:21.864815] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T17:43:21.895295] [INFO ] [REMOTE ] DKS: Full fetch complete (54203 records). [2025-09-14T17:43:21.915904] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-09-14T17:43:22.162278] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-09-14T17:43:22.749405] [DEBUG] [LOCAL ] DK: Primary data saved (37241 records). [2025-09-14T17:43:22.749747] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-09-14T17:43:22.750040] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-09-14T17:43:22.749957] [INFO ] [MAIN ] DK: Full history saved. [2025-09-14T17:43:22.751701] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-09-14T17:43:22.751827] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-09-14T17:43:22.752096] [INFO ] [MAIN ] Update Progress: 627/2370 symbols completed. DK took 36.2s. Estimated remaining: 3h 3m 59s. Rate: 9.5 symbols/min [2025-09-14T17:43:22.862981] [DEBUG] [LOCAL ] DKS: Trimmed 54203 records to 37372 (keeping 150 days of data) [2025-09-14T17:43:23.012560] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-09-14T17:43:23.129381] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:43:23.154525] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-14T17:43:23.213313] [DEBUG] [LOCAL ] DLR: Loaded 22615 existing records from primary storage. [2025-09-14T17:43:23.222424] [INFO ] [MAIN ] DLR: Loaded 22615 existing records. [2025-09-14T17:43:23.508309] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:43:23.513025] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-09-14T17:43:23.516853] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-14T17:43:23.519724] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-09-14T17:43:23.521458] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-09-14T17:43:23.526062] [DEBUG] [LOCAL ] DKS: Primary data saved (37372 records). [2025-09-14T17:43:23.582101] [INFO ] [MAIN ] DKS: Full history saved. [2025-09-14T17:43:23.608225] [INFO ] [MAIN ] Update Progress: 628/2370 symbols completed. DKS took 26.7s. Estimated remaining: 3h 3m 38s. Rate: 9.5 symbols/min [2025-09-14T17:43:23.766803] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-09-14T17:43:24.019491] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-14T17:43:24.056086] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:43:24.080900] [INFO ] [REMOTE ] DLB: Full fetch complete (35146 records). [2025-09-14T17:43:24.153476] [INFO ] [REMOTE ] DLR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:43:24.153704] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-09-14T17:43:24.267220] [DEBUG] [LOCAL ] DLX: Loaded 12805 existing records from primary storage. [2025-09-14T17:43:24.271876] [INFO ] [MAIN ] DLX: Loaded 12805 existing records. [2025-09-14T17:43:24.565085] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-09-14T17:43:24.694725] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:43:24.716331] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-09-14T17:43:24.757089] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-09-14T17:43:24.773899] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-09-14T17:43:24.786723] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-09-14T17:43:24.788852] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-09-14T17:43:24.803377] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-09-14T17:43:24.824083] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-09-14T17:43:24.829534] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-09-14T17:43:24.916358] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-14T17:43:24.917961] [DEBUG] [LOCAL ] DLB: Trimmed 35146 records to 23969 (keeping 150 days of data) [2025-09-14T17:43:25.304092] [INFO ] [REMOTE ] DLX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:43:25.360749] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-09-14T17:43:25.369140] [DEBUG] [LOCAL ] DLB: Primary data saved (23969 records). [2025-09-14T17:43:25.369371] [INFO ] [MAIN ] DLB: Full history saved. [2025-09-14T17:43:25.369523] [INFO ] [MAIN ] Update Progress: 629/2370 symbols completed. DLB took 26.9s. Estimated remaining: 3h 3m 19s. Rate: 9.5 symbols/min [2025-09-14T17:43:25.555553] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:43:25.568246] [DEBUG] [LOCAL ] DLY: Loaded 9108 existing records from primary storage. [2025-09-14T17:43:25.568451] [INFO ] [MAIN ] DLY: Loaded 9108 existing records. [2025-09-14T17:43:25.752236] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:43:25.752789] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-09-14T17:43:25.752859] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-09-14T17:43:25.753384] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-09-14T17:43:25.753455] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-09-14T17:43:26.134463] [INFO ] [REMOTE ] DLY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:43:26.158826] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-09-14T17:43:26.468929] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-14T17:43:26.540301] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T17:43:26.958855] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-09-14T17:43:27.116276] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-14T17:43:27.758858] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-09-14T17:43:28.563917] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-09-14T17:43:28.577557] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-14T17:43:28.799127] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-14T17:43:29.021351] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-14T17:43:29.358835] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-09-14T17:43:30.010369] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-14T17:43:30.158884] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-09-14T17:43:30.958877] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-09-14T17:43:31.569954] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-14T17:43:31.758868] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-09-14T17:43:32.047893] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T17:43:32.558927] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-09-14T17:43:33.009428] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-14T17:43:33.208372] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-14T17:43:33.358845] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-09-14T17:43:34.158842] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-09-14T17:43:34.352868] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T17:43:34.958836] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-09-14T17:43:35.473188] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-14T17:43:35.758887] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-09-14T17:43:35.970533] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-14T17:43:36.354302] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T17:43:36.355888] [INFO ] [REMOTE ] DLNG: Full fetch complete (7420 records). [2025-09-14T17:43:36.355999] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-09-14T17:43:36.564019] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-09-14T17:43:36.714697] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-09-14T17:43:36.714805] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-09-14T17:43:36.715007] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-09-14T17:43:36.715059] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-09-14T17:43:36.715486] [DEBUG] [LOCAL ] DLNG: Trimmed 7420 records to 4441 (keeping 150 days of data) [2025-09-14T17:43:36.742773] [DEBUG] [LOCAL ] DLNG: Primary data saved (4441 records). [2025-09-14T17:43:36.742920] [INFO ] [MAIN ] DLNG: Full history saved. [2025-09-14T17:43:36.743054] [INFO ] [MAIN ] Update Progress: 630/2370 symbols completed. DLNG took 21.4s. Estimated remaining: 3h 3m 26s. Rate: 9.5 symbols/min [2025-09-14T17:43:36.914330] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:43:36.918636] [DEBUG] [LOCAL ] DMA: Loaded 2133 existing records from primary storage. [2025-09-14T17:43:36.918759] [INFO ] [MAIN ] DMA: Loaded 2133 existing records. [2025-09-14T17:43:37.099603] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:43:37.099923] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-09-14T17:43:37.099986] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-14T17:43:37.100212] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-09-14T17:43:37.100270] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-09-14T17:43:37.366747] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-09-14T17:43:37.457764] [INFO ] [REMOTE ] DMA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:43:38.158798] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-09-14T17:43:38.476740] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T17:43:38.511860] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T17:43:38.958807] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-09-14T17:43:39.274830] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T17:43:39.758824] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-09-14T17:43:40.558794] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-09-14T17:43:40.662852] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T17:43:40.973270] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-14T17:43:41.358867] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-09-14T17:43:41.819622] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T17:43:42.079429] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-14T17:43:42.158792] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-09-14T17:43:42.958870] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-09-14T17:43:43.466598] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-14T17:43:43.758812] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-09-14T17:43:43.964967] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-14T17:43:43.968128] [INFO ] [REMOTE ] DLY: Full fetch complete (20330 records). [2025-09-14T17:43:43.968233] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-09-14T17:43:44.282025] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-14T17:43:44.365250] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-09-14T17:43:44.365361] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-09-14T17:43:44.365924] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-09-14T17:43:44.365988] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-09-14T17:43:44.366658] [DEBUG] [LOCAL ] DLY: Trimmed 20330 records to 13869 (keeping 150 days of data) [2025-09-14T17:43:44.453937] [DEBUG] [LOCAL ] DLY: Primary data saved (13869 records). [2025-09-14T17:43:44.454124] [INFO ] [MAIN ] DLY: Full history saved. [2025-09-14T17:43:44.454267] [INFO ] [MAIN ] Update Progress: 631/2370 symbols completed. DLY took 19.1s. Estimated remaining: 3h 3m 24s. Rate: 9.5 symbols/min [2025-09-14T17:43:44.600923] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-09-14T17:43:44.674910] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:43:44.683095] [DEBUG] [LOCAL ] DMB: Loaded 4860 existing records from primary storage. [2025-09-14T17:43:44.683318] [INFO ] [MAIN ] DMB: Loaded 4860 existing records. [2025-09-14T17:43:44.868850] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:43:44.869173] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-09-14T17:43:44.869269] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-09-14T17:43:44.869578] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-09-14T17:43:44.869668] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-09-14T17:43:45.228834] [INFO ] [REMOTE ] DMB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:43:45.236230] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:43:45.239202] [INFO ] [REMOTE ] DLX: Full fetch complete (32570 records). [2025-09-14T17:43:45.239289] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-09-14T17:43:45.363885] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-09-14T17:43:45.611054] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-09-14T17:43:45.611167] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-09-14T17:43:45.611788] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-09-14T17:43:45.611857] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-09-14T17:43:45.612767] [DEBUG] [LOCAL ] DLX: Trimmed 32570 records to 21803 (keeping 150 days of data) [2025-09-14T17:43:45.759275] [DEBUG] [LOCAL ] DLX: Primary data saved (21803 records). [2025-09-14T17:43:45.759459] [INFO ] [MAIN ] DLX: Full history saved. [2025-09-14T17:43:45.759591] [INFO ] [MAIN ] Update Progress: 632/2370 symbols completed. DLX took 22.1s. Estimated remaining: 3h 3m 4s. Rate: 9.5 symbols/min [2025-09-14T17:43:45.935778] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:43:45.942512] [DEBUG] [LOCAL ] DMO: Loaded 4389 existing records from primary storage. [2025-09-14T17:43:45.942686] [INFO ] [MAIN ] DMO: Loaded 4389 existing records. [2025-09-14T17:43:46.121516] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:43:46.121799] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-09-14T17:43:46.121862] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-14T17:43:46.122177] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-09-14T17:43:46.122240] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-09-14T17:43:46.164361] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-09-14T17:43:46.487900] [INFO ] [REMOTE ] DMO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:43:46.857358] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-14T17:43:46.958841] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-09-14T17:43:47.153518] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T17:43:47.751771] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-14T17:43:47.758766] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-09-14T17:43:48.558835] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-09-14T17:43:48.599089] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-14T17:43:49.043218] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-14T17:43:49.358873] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-09-14T17:43:50.158859] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-09-14T17:43:50.958812] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-09-14T17:43:51.029883] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-14T17:43:51.102996] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T17:43:51.718208] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-14T17:43:51.758789] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-09-14T17:43:52.558884] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-09-14T17:43:52.604011] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-14T17:43:53.267115] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-14T17:43:53.358791] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-09-14T17:43:54.158845] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-09-14T17:43:54.178849] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T17:43:54.958843] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-09-14T17:43:55.726798] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-14T17:43:55.758895] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-09-14T17:43:55.894015] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-14T17:43:56.558872] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-09-14T17:43:56.577716] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-14T17:43:57.268152] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:43:57.275719] [INFO ] [REMOTE ] DLR: Full fetch complete (55849 records). [2025-09-14T17:43:57.275946] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-09-14T17:43:57.364044] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-09-14T17:43:57.661356] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-09-14T17:43:57.661465] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-09-14T17:43:57.662210] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-09-14T17:43:57.662270] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-09-14T17:43:57.663380] [DEBUG] [LOCAL ] DLR: Trimmed 55849 records to 38217 (keeping 150 days of data) [2025-09-14T17:43:57.913887] [DEBUG] [LOCAL ] DLR: Primary data saved (38217 records). [2025-09-14T17:43:57.914115] [INFO ] [MAIN ] DLR: Full history saved. [2025-09-14T17:43:57.914235] [INFO ] [MAIN ] Update Progress: 633/2370 symbols completed. DLR took 35.2s. Estimated remaining: 3h 3m 13s. Rate: 9.5 symbols/min [2025-09-14T17:43:57.992554] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-14T17:43:58.087926] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:43:58.111399] [DEBUG] [LOCAL ] DNA: Loaded 21739 existing records from primary storage. [2025-09-14T17:43:58.111573] [INFO ] [MAIN ] DNA: Loaded 21739 existing records. [2025-09-14T17:43:58.165637] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-09-14T17:43:58.292272] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:43:58.292596] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-09-14T17:43:58.292700] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-14T17:43:58.293415] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-09-14T17:43:58.293480] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-09-14T17:43:58.640802] [INFO ] [REMOTE ] DNA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:43:58.958867] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-09-14T17:43:59.044694] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-14T17:43:59.592972] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-14T17:43:59.758855] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-09-14T17:44:00.531412] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T17:44:00.533336] [INFO ] [REMOTE ] DMB: Full fetch complete (10769 records). [2025-09-14T17:44:00.533426] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-09-14T17:44:00.564057] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-09-14T17:44:00.911901] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-09-14T17:44:00.912010] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-09-14T17:44:00.912269] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-09-14T17:44:00.912320] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-09-14T17:44:00.912820] [DEBUG] [LOCAL ] DMB: Trimmed 10769 records to 8087 (keeping 150 days of data) [2025-09-14T17:44:00.961790] [DEBUG] [LOCAL ] DMB: Primary data saved (8087 records). [2025-09-14T17:44:00.961940] [INFO ] [MAIN ] DMB: Full history saved. [2025-09-14T17:44:00.962038] [INFO ] [MAIN ] Update Progress: 634/2370 symbols completed. DMB took 16.5s. Estimated remaining: 3h 2m 58s. Rate: 9.5 symbols/min [2025-09-14T17:44:01.129092] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:44:01.148670] [DEBUG] [LOCAL ] DNOW: Loaded 19765 existing records from primary storage. [2025-09-14T17:44:01.148851] [INFO ] [MAIN ] DNOW: Loaded 19765 existing records. [2025-09-14T17:44:01.324720] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:44:01.325075] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-09-14T17:44:01.328990] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-09-14T17:44:01.329551] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-14T17:44:01.331063] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-09-14T17:44:01.331454] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-09-14T17:44:01.363872] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-09-14T17:44:01.693986] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:44:02.158865] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-09-14T17:44:02.799565] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:44:02.800872] [INFO ] [REMOTE ] DMA: Full fetch complete (5011 records). [2025-09-14T17:44:02.800957] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-09-14T17:44:02.971419] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-09-14T17:44:03.155581] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-09-14T17:44:03.155706] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-09-14T17:44:03.155904] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-09-14T17:44:03.155958] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-09-14T17:44:03.156371] [DEBUG] [LOCAL ] DMA: Trimmed 5011 records to 3632 (keeping 150 days of data) [2025-09-14T17:44:03.179965] [DEBUG] [LOCAL ] DMA: Primary data saved (3632 records). [2025-09-14T17:44:03.180088] [INFO ] [MAIN ] DMA: Full history saved. [2025-09-14T17:44:03.180180] [INFO ] [MAIN ] Update Progress: 635/2370 symbols completed. DMA took 26.4s. Estimated remaining: 3h 2m 41s. Rate: 9.5 symbols/min [2025-09-14T17:44:03.347513] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:44:03.364297] [DEBUG] [LOCAL ] DNP: Loaded 14415 existing records from primary storage. [2025-09-14T17:44:03.364481] [INFO ] [MAIN ] DNP: Loaded 14415 existing records. [2025-09-14T17:44:03.540896] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:44:03.541284] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-09-14T17:44:03.541411] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-09-14T17:44:03.551546] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-09-14T17:44:03.564840] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-09-14T17:44:03.645081] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-14T17:44:03.765766] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-09-14T17:44:03.930766] [INFO ] [REMOTE ] DNP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:44:03.937278] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-14T17:44:04.558836] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-09-14T17:44:05.289893] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T17:44:05.358787] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-09-14T17:44:05.386996] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T17:44:06.158841] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-09-14T17:44:06.875236] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T17:44:06.958882] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-09-14T17:44:07.758795] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-09-14T17:44:07.790632] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T17:44:08.558831] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-09-14T17:44:08.709394] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T17:44:09.250963] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-14T17:44:09.358825] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-09-14T17:44:09.397094] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-14T17:44:10.158827] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-09-14T17:44:10.922320] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-14T17:44:10.958815] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-09-14T17:44:11.758867] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-09-14T17:44:11.915896] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-14T17:44:12.042596] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T17:44:12.558849] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-09-14T17:44:13.262450] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T17:44:13.274876] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T17:44:13.276356] [INFO ] [REMOTE ] DMO: Full fetch complete (10517 records). [2025-09-14T17:44:13.276466] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-09-14T17:44:13.363956] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-09-14T17:44:13.649489] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-09-14T17:44:13.649602] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-09-14T17:44:13.649923] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-09-14T17:44:13.649994] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-09-14T17:44:13.650552] [DEBUG] [LOCAL ] DMO: Trimmed 10517 records to 7071 (keeping 150 days of data) [2025-09-14T17:44:13.698536] [DEBUG] [LOCAL ] DMO: Primary data saved (7071 records). [2025-09-14T17:44:13.698770] [INFO ] [MAIN ] DMO: Full history saved. [2025-09-14T17:44:13.698892] [INFO ] [MAIN ] Update Progress: 636/2370 symbols completed. DMO took 27.9s. Estimated remaining: 3h 2m 46s. Rate: 9.5 symbols/min [2025-09-14T17:44:13.878871] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:44:13.904576] [DEBUG] [LOCAL ] DOC: Loaded 24019 existing records from primary storage. [2025-09-14T17:44:13.904792] [INFO ] [MAIN ] DOC: Loaded 24019 existing records. [2025-09-14T17:44:14.078699] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:44:14.078963] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-09-14T17:44:14.079027] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-09-14T17:44:14.079782] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-09-14T17:44:14.079849] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-09-14T17:44:14.169127] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-09-14T17:44:14.430020] [INFO ] [REMOTE ] DOC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:44:14.958868] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-09-14T17:44:15.389018] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-14T17:44:15.741041] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T17:44:15.758765] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-09-14T17:44:16.383062] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T17:44:16.558823] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-09-14T17:44:17.036457] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T17:44:17.358837] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-09-14T17:44:18.010601] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-14T17:44:18.158824] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-09-14T17:44:18.645078] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T17:44:18.958817] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-09-14T17:44:19.758836] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-09-14T17:44:20.105779] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-14T17:44:20.542930] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T17:44:20.558779] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-09-14T17:44:21.177025] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-14T17:44:21.358823] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-09-14T17:44:22.104111] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T17:44:22.158801] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-09-14T17:44:22.958773] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-09-14T17:44:23.463700] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-14T17:44:23.758832] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-09-14T17:44:24.032871] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T17:44:24.473785] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-14T17:44:24.558834] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-09-14T17:44:24.744609] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T17:44:25.358837] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-09-14T17:44:26.158821] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-09-14T17:44:26.364610] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T17:44:26.387767] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-14T17:44:26.391475] [INFO ] [REMOTE ] DNP: Full fetch complete (36392 records). [2025-09-14T17:44:26.391580] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-09-14T17:44:26.760031] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-09-14T17:44:26.760140] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-09-14T17:44:26.760727] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-09-14T17:44:26.760796] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-09-14T17:44:26.761813] [DEBUG] [LOCAL ] DNP: Trimmed 36392 records to 24884 (keeping 150 days of data) [2025-09-14T17:44:26.918853] [DEBUG] [LOCAL ] DNP: Primary data saved (24884 records). [2025-09-14T17:44:26.919034] [INFO ] [MAIN ] DNP: Full history saved. [2025-09-14T17:44:26.919139] [INFO ] [MAIN ] Update Progress: 637/2370 symbols completed. DNP took 23.7s. Estimated remaining: 3h 2m 58s. Rate: 9.5 symbols/min [2025-09-14T17:44:26.958799] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-09-14T17:44:27.758857] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-09-14T17:44:28.075497] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-14T17:44:28.231067] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T17:44:28.235515] [INFO ] [REMOTE ] DNOW: Full fetch complete (47501 records). [2025-09-14T17:44:28.235636] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-09-14T17:44:28.565394] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-09-14T17:44:28.616483] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-09-14T17:44:28.616686] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-09-14T17:44:28.617560] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-09-14T17:44:28.617703] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-09-14T17:44:28.619061] [DEBUG] [LOCAL ] DNOW: Trimmed 47501 records to 32346 (keeping 150 days of data) [2025-09-14T17:44:28.756037] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T17:44:28.852249] [DEBUG] [LOCAL ] DNOW: Primary data saved (32346 records). [2025-09-14T17:44:28.852434] [INFO ] [MAIN ] DNOW: Full history saved. [2025-09-14T17:44:28.852552] [INFO ] [MAIN ] Update Progress: 638/2370 symbols completed. DNOW took 27.9s. Estimated remaining: 3h 2m 40s. Rate: 9.5 symbols/min [2025-09-14T17:44:29.358882] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-09-14T17:44:30.229591] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-14T17:44:30.234840] [INFO ] [REMOTE ] DNA: Full fetch complete (53206 records). [2025-09-14T17:44:30.234990] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-09-14T17:44:30.638368] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-09-14T17:44:30.638488] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-09-14T17:44:30.639203] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-09-14T17:44:30.639262] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-09-14T17:44:30.640449] [DEBUG] [LOCAL ] DNA: Trimmed 53206 records to 36266 (keeping 150 days of data) [2025-09-14T17:44:30.854056] [DEBUG] [LOCAL ] DNA: Primary data saved (36266 records). [2025-09-14T17:44:30.854244] [INFO ] [MAIN ] DNA: Full history saved. [2025-09-14T17:44:30.854342] [INFO ] [MAIN ] Update Progress: 639/2370 symbols completed. DNA took 32.9s. Estimated remaining: 3h 2m 22s. Rate: 9.5 symbols/min [2025-09-14T17:44:31.375352] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-14T17:44:31.388296] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-09-14T17:44:33.285088] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T17:44:33.303360] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-09-14T17:44:33.598681] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-14T17:44:33.605112] [INFO ] [REMOTE ] DOC: Full fetch complete (58180 records). [2025-09-14T17:44:33.605344] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-09-14T17:44:34.161500] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-09-14T17:44:34.161729] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-09-14T17:44:34.163272] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-09-14T17:44:34.163384] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-09-14T17:44:34.165309] [DEBUG] [LOCAL ] DOC: Trimmed 58180 records to 40314 (keeping 150 days of data) [2025-09-14T17:44:34.515209] [DEBUG] [LOCAL ] DOC: Primary data saved (40314 records). [2025-09-14T17:44:34.515407] [INFO ] [MAIN ] DOC: Full history saved. [2025-09-14T17:44:34.515568] [INFO ] [MAIN ] Update Progress: 640/2370 symbols completed. DOC took 20.8s. Estimated remaining: 3h 2m 8s. Rate: 9.5 symbols/min [2025-09-14T17:44:35.127527] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:44:35.173027] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:44:35.201005] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:44:35.226344] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:44:35.269557] [DEBUG] [LOCAL ] DOCS: Loaded 22275 existing records from primary storage. [2025-09-14T17:44:35.270517] [INFO ] [MAIN ] DOCS: Loaded 22275 existing records. [2025-09-14T17:44:35.270419] [DEBUG] [LOCAL ] DOLE: Loaded 16980 existing records from primary storage. [2025-09-14T17:44:35.270079] [DEBUG] [LOCAL ] DOUG: Loaded 15055 existing records from primary storage. [2025-09-14T17:44:35.270772] [INFO ] [MAIN ] DOLE: Loaded 16980 existing records. [2025-09-14T17:44:35.276243] [INFO ] [MAIN ] DOUG: Loaded 15055 existing records. [2025-09-14T17:44:35.553889] [DEBUG] [LOCAL ] DOCN: Loaded 22968 existing records from primary storage. [2025-09-14T17:44:35.606109] [INFO ] [MAIN ] DOCN: Loaded 22968 existing records. [2025-09-14T17:44:35.744531] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:44:35.824293] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-09-14T17:44:35.912355] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:44:35.912590] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-09-14T17:44:35.950406] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-09-14T17:44:35.950289] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:44:35.960975] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-09-14T17:44:35.972040] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-09-14T17:44:35.983637] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-09-14T17:44:35.988881] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-09-14T17:44:35.998442] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-09-14T17:44:35.998498] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-09-14T17:44:35.994201] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-09-14T17:44:36.164374] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-09-14T17:44:36.242228] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-09-14T17:44:36.327749] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:44:36.516363] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-09-14T17:44:36.574048] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-09-14T17:44:36.788020] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-09-14T17:44:36.873531] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-09-14T17:44:37.207096] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:44:37.234291] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:44:37.285539] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-09-14T17:44:37.286022] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-09-14T17:44:37.559065] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:44:37.564210] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-09-14T17:44:37.642853] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:44:37.643182] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-09-14T17:44:38.663126] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-14T17:44:38.670607] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-09-14T17:44:38.994304] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T17:44:39.001511] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-09-14T17:44:39.248442] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T17:44:39.258419] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-09-14T17:44:39.286032] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-14T17:44:39.296271] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-09-14T17:44:40.100336] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T17:44:40.108136] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-09-14T17:44:40.188975] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-14T17:44:40.204498] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-09-14T17:44:40.936726] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-14T17:44:40.947414] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-09-14T17:44:41.122292] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T17:44:41.133820] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-09-14T17:44:41.500261] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-14T17:44:41.508620] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-09-14T17:44:41.571600] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-14T17:44:42.159016] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-09-14T17:44:42.468464] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-14T17:44:42.778533] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-14T17:44:42.958837] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-09-14T17:44:43.014703] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T17:44:43.687493] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-14T17:44:43.758847] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-09-14T17:44:44.520278] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-14T17:44:44.558776] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-09-14T17:44:45.358840] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-09-14T17:44:45.667583] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T17:44:46.158814] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-09-14T17:44:46.301625] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T17:44:46.911623] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T17:44:46.958847] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-09-14T17:44:47.201097] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-14T17:44:47.758829] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-09-14T17:44:48.445668] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-14T17:44:48.558817] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-09-14T17:44:49.358871] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-09-14T17:44:49.514049] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-14T17:44:50.078846] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-14T17:44:50.158779] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-09-14T17:44:50.848348] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-14T17:44:50.958775] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-09-14T17:44:51.758847] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-09-14T17:44:52.054515] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T17:44:52.303847] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T17:44:52.558828] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-09-14T17:44:52.916409] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T17:44:53.203985] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T17:44:53.210755] [INFO ] [REMOTE ] DOCN: Full fetch complete (54659 records). [2025-09-14T17:44:53.210994] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-09-14T17:44:53.365912] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-09-14T17:44:53.586249] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-09-14T17:44:53.586357] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-09-14T17:44:53.587094] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-09-14T17:44:53.587155] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-09-14T17:44:53.588332] [DEBUG] [LOCAL ] DOCN: Trimmed 54659 records to 38164 (keeping 150 days of data) [2025-09-14T17:44:53.819993] [DEBUG] [LOCAL ] DOCN: Primary data saved (38164 records). [2025-09-14T17:44:53.820407] [INFO ] [MAIN ] DOCN: Full history saved. [2025-09-14T17:44:53.820590] [INFO ] [MAIN ] Update Progress: 641/2370 symbols completed. DOCN took 19.3s. Estimated remaining: 3h 2m 37s. Rate: 9.5 symbols/min [2025-09-14T17:44:53.987673] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:44:54.008435] [DEBUG] [LOCAL ] DOV: Loaded 20083 existing records from primary storage. [2025-09-14T17:44:54.008619] [INFO ] [MAIN ] DOV: Loaded 20083 existing records. [2025-09-14T17:44:54.161285] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-09-14T17:44:54.182473] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:44:54.182760] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-09-14T17:44:54.182825] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-14T17:44:54.183582] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-09-14T17:44:54.183669] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-09-14T17:44:54.527771] [INFO ] [REMOTE ] DOV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:44:54.794124] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-14T17:44:54.799683] [INFO ] [REMOTE ] DOLE: Full fetch complete (40361 records). [2025-09-14T17:44:54.799943] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-09-14T17:44:54.965398] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-09-14T17:44:55.184616] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-09-14T17:44:55.184895] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-09-14T17:44:55.185571] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-09-14T17:44:55.185728] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-09-14T17:44:55.194834] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-14T17:44:55.199119] [INFO ] [REMOTE ] DOUG: Full fetch complete (37989 records). [2025-09-14T17:44:55.199249] [DEBUG] [LOCAL ] DOLE: Trimmed 40361 records to 28724 (keeping 150 days of data) [2025-09-14T17:44:55.199377] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-09-14T17:44:55.702054] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-09-14T17:44:55.706316] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-09-14T17:44:55.707098] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-09-14T17:44:55.729247] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-09-14T17:44:55.751451] [DEBUG] [LOCAL ] DOUG: Trimmed 37989 records to 26246 (keeping 150 days of data) [2025-09-14T17:44:55.758961] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-09-14T17:44:55.851426] [DEBUG] [LOCAL ] DOLE: Primary data saved (28724 records). [2025-09-14T17:44:55.855888] [INFO ] [MAIN ] DOLE: Full history saved. [2025-09-14T17:44:55.864857] [INFO ] [MAIN ] Update Progress: 642/2370 symbols completed. DOLE took 21.3s. Estimated remaining: 3h 2m 19s. Rate: 9.5 symbols/min [2025-09-14T17:44:56.042788] [DEBUG] [LOCAL ] DOUG: Primary data saved (26246 records). [2025-09-14T17:44:56.071900] [INFO ] [MAIN ] DOUG: Full history saved. [2025-09-14T17:44:56.088757] [INFO ] [MAIN ] Update Progress: 643/2370 symbols completed. DOUG took 21.6s. Estimated remaining: 3h 1m 56s. Rate: 9.5 symbols/min [2025-09-14T17:44:56.090074] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:44:56.270344] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:44:56.280883] [DEBUG] [LOCAL ] DOW: Loaded 24143 existing records from primary storage. [2025-09-14T17:44:56.283190] [INFO ] [MAIN ] DOW: Loaded 24143 existing records. [2025-09-14T17:44:56.377983] [DEBUG] [LOCAL ] DPG: Loaded 5995 existing records from primary storage. [2025-09-14T17:44:56.388626] [INFO ] [MAIN ] DPG: Loaded 5995 existing records. [2025-09-14T17:44:56.538588] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:44:56.612423] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-09-14T17:44:56.612828] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-09-14T17:44:56.618982] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-09-14T17:44:56.645021] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-09-14T17:44:56.751578] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:44:56.815509] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-09-14T17:44:56.828739] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-14T17:44:56.898779] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-09-14T17:44:56.935110] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-09-14T17:44:57.147343] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-14T17:44:57.223233] [INFO ] [REMOTE ] DOW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:44:57.248127] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-09-14T17:44:57.379450] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-09-14T17:44:57.515835] [INFO ] [REMOTE ] DPG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:44:57.675379] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-14T17:44:58.158873] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-09-14T17:44:58.740001] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-14T17:44:58.958843] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-09-14T17:44:58.997341] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T17:44:59.100604] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T17:44:59.758844] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-09-14T17:44:59.894870] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-14T17:45:00.558851] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-09-14T17:45:01.358954] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-09-14T17:45:02.158871] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-09-14T17:45:02.283153] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-14T17:45:02.465298] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-14T17:45:02.958896] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-09-14T17:45:03.758900] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-09-14T17:45:04.664549] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (3.31 seconds). [2025-09-14T17:45:04.676952] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-09-14T17:45:05.199834] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (3.04 seconds). [2025-09-14T17:45:05.358859] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-09-14T17:45:05.557410] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T17:45:05.562582] [INFO ] [REMOTE ] DOCS: Full fetch complete (56131 records). [2025-09-14T17:45:05.562749] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-09-14T17:45:05.946342] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-09-14T17:45:05.946449] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-09-14T17:45:05.947209] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-09-14T17:45:05.947268] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-09-14T17:45:05.948419] [DEBUG] [LOCAL ] DOCS: Trimmed 56131 records to 38355 (keeping 150 days of data) [2025-09-14T17:45:06.206841] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (3.25 seconds). [2025-09-14T17:45:06.224890] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-09-14T17:45:06.239838] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-14T17:45:06.250194] [DEBUG] [LOCAL ] DOCS: Primary data saved (38355 records). [2025-09-14T17:45:06.250864] [INFO ] [MAIN ] DOCS: Full history saved. [2025-09-14T17:45:06.251410] [INFO ] [MAIN ] Update Progress: 644/2370 symbols completed. DOCS took 31.7s. Estimated remaining: 3h 2m 0s. Rate: 9.5 symbols/min [2025-09-14T17:45:06.424799] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:45:06.464326] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-09-14T17:45:06.484797] [DEBUG] [LOCAL ] DQ: Loaded 20624 existing records from primary storage. [2025-09-14T17:45:06.485010] [INFO ] [MAIN ] DQ: Loaded 20624 existing records. [2025-09-14T17:45:06.663922] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:45:06.664191] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-09-14T17:45:06.664267] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-09-14T17:45:06.664924] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-09-14T17:45:06.665004] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-09-14T17:45:06.963960] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-09-14T17:45:07.017137] [INFO ] [REMOTE ] DQ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:45:07.758911] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-09-14T17:45:07.981869] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-14T17:45:08.558848] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-09-14T17:45:08.876913] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T17:45:09.341129] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-14T17:45:09.358774] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-09-14T17:45:09.542303] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T17:45:10.038265] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-14T17:45:10.158831] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-09-14T17:45:10.958831] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-09-14T17:45:11.758812] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-09-14T17:45:11.822919] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-14T17:45:12.558841] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-09-14T17:45:12.725736] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-14T17:45:13.029834] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-14T17:45:13.358839] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-09-14T17:45:14.158901] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-09-14T17:45:14.219019] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T17:45:14.958875] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-09-14T17:45:15.758812] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-09-14T17:45:15.963348] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-14T17:45:16.095998] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-14T17:45:16.098159] [INFO ] [REMOTE ] DPG: Full fetch complete (14329 records). [2025-09-14T17:45:16.098255] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-09-14T17:45:16.468456] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-09-14T17:45:16.468562] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-09-14T17:45:16.468944] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-09-14T17:45:16.468999] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-09-14T17:45:16.469511] [DEBUG] [LOCAL ] DPG: Trimmed 14329 records to 9966 (keeping 150 days of data) [2025-09-14T17:45:16.531482] [DEBUG] [LOCAL ] DPG: Primary data saved (9966 records). [2025-09-14T17:45:16.531666] [INFO ] [MAIN ] DPG: Full history saved. [2025-09-14T17:45:16.531769] [INFO ] [MAIN ] Update Progress: 645/2370 symbols completed. DPG took 20.4s. Estimated remaining: 3h 2m 5s. Rate: 9.5 symbols/min [2025-09-14T17:45:16.563924] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-09-14T17:45:16.704195] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:45:16.722324] [DEBUG] [LOCAL ] DRD: Loaded 16385 existing records from primary storage. [2025-09-14T17:45:16.722507] [INFO ] [MAIN ] DRD: Loaded 16385 existing records. [2025-09-14T17:45:16.902187] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:45:16.902537] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-09-14T17:45:16.902603] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-09-14T17:45:16.903150] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-09-14T17:45:16.903215] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-09-14T17:45:17.260120] [INFO ] [REMOTE ] DRD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:45:17.366527] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-09-14T17:45:17.369125] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T17:45:17.445528] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-14T17:45:18.158842] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-09-14T17:45:18.444997] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-14T17:45:18.539737] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-14T17:45:18.958877] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-09-14T17:45:19.464973] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-14T17:45:19.623713] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T17:45:19.629342] [INFO ] [REMOTE ] DOW: Full fetch complete (58411 records). [2025-09-14T17:45:19.629482] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-09-14T17:45:19.769808] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-09-14T17:45:20.018044] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-09-14T17:45:20.018161] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-09-14T17:45:20.018943] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-09-14T17:45:20.019013] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-09-14T17:45:20.020281] [DEBUG] [LOCAL ] DOW: Trimmed 58411 records to 40473 (keeping 150 days of data) [2025-09-14T17:45:20.271627] [DEBUG] [LOCAL ] DOW: Primary data saved (40473 records). [2025-09-14T17:45:20.271801] [INFO ] [MAIN ] DOW: Full history saved. [2025-09-14T17:45:20.271892] [INFO ] [MAIN ] Update Progress: 646/2370 symbols completed. DOW took 24.4s. Estimated remaining: 3h 1m 51s. Rate: 9.5 symbols/min [2025-09-14T17:45:20.440495] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:45:20.465343] [DEBUG] [LOCAL ] DRH: Loaded 22429 existing records from primary storage. [2025-09-14T17:45:20.465556] [INFO ] [MAIN ] DRH: Loaded 22429 existing records. [2025-09-14T17:45:20.567718] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-09-14T17:45:20.649286] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:45:20.649556] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-09-14T17:45:20.649623] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-09-14T17:45:20.650226] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-09-14T17:45:20.650298] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-09-14T17:45:21.003620] [INFO ] [REMOTE ] DRH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:45:21.358818] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-09-14T17:45:21.620029] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-14T17:45:22.158822] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-09-14T17:45:22.379325] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T17:45:22.959849] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-09-14T17:45:22.959740] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-14T17:45:23.430114] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T17:45:23.435095] [INFO ] [REMOTE ] DOV: Full fetch complete (49600 records). [2025-09-14T17:45:23.435333] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-09-14T17:45:23.778108] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-09-14T17:45:23.869553] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-09-14T17:45:23.869863] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-09-14T17:45:23.870675] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-09-14T17:45:23.870773] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-09-14T17:45:23.872236] [DEBUG] [LOCAL ] DOV: Trimmed 49600 records to 33991 (keeping 150 days of data) [2025-09-14T17:45:24.001532] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T17:45:24.129326] [DEBUG] [LOCAL ] DOV: Primary data saved (33991 records). [2025-09-14T17:45:24.129506] [INFO ] [MAIN ] DOV: Full history saved. [2025-09-14T17:45:24.129611] [INFO ] [MAIN ] Update Progress: 647/2370 symbols completed. DOV took 30.3s. Estimated remaining: 3h 1m 38s. Rate: 9.5 symbols/min [2025-09-14T17:45:24.298458] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:45:24.318883] [DEBUG] [LOCAL ] DRI: Loaded 20687 existing records from primary storage. [2025-09-14T17:45:24.319035] [INFO ] [MAIN ] DRI: Loaded 20687 existing records. [2025-09-14T17:45:24.503429] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:45:24.503761] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-09-14T17:45:24.503830] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-09-14T17:45:24.504467] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-09-14T17:45:24.504532] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-09-14T17:45:24.568686] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-09-14T17:45:24.858529] [INFO ] [REMOTE ] DRI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:45:25.358834] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-09-14T17:45:25.404508] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T17:45:26.158883] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-09-14T17:45:26.269470] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-14T17:45:26.278140] [INFO ] [REMOTE ] DQ: Full fetch complete (47303 records). [2025-09-14T17:45:26.278399] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-09-14T17:45:26.881789] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-09-14T17:45:26.881978] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-09-14T17:45:26.883487] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-09-14T17:45:26.883609] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-09-14T17:45:26.885487] [DEBUG] [LOCAL ] DQ: Trimmed 47303 records to 31915 (keeping 150 days of data) [2025-09-14T17:45:26.963382] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-09-14T17:45:27.151785] [DEBUG] [LOCAL ] DQ: Primary data saved (31915 records). [2025-09-14T17:45:27.151984] [INFO ] [MAIN ] DQ: Full history saved. [2025-09-14T17:45:27.152092] [INFO ] [MAIN ] Update Progress: 648/2370 symbols completed. DQ took 20.9s. Estimated remaining: 3h 1m 23s. Rate: 9.5 symbols/min [2025-09-14T17:45:27.326958] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:45:27.332882] [DEBUG] [LOCAL ] DRLL: Loaded 3741 existing records from primary storage. [2025-09-14T17:45:27.333008] [INFO ] [MAIN ] DRLL: Loaded 3741 existing records. [2025-09-14T17:45:27.511500] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:45:27.511792] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-09-14T17:45:27.511852] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-09-14T17:45:27.512145] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-09-14T17:45:27.512203] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-09-14T17:45:27.879524] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:45:27.879931] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-09-14T17:45:27.910010] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-09-14T17:45:28.191750] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-14T17:45:28.558831] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-09-14T17:45:28.791994] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T17:45:29.358812] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-09-14T17:45:29.416484] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-14T17:45:30.162702] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-09-14T17:45:30.168415] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-14T17:45:30.317592] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-14T17:45:30.958855] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-09-14T17:45:31.758955] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-09-14T17:45:32.027972] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T17:45:32.453819] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-14T17:45:32.558876] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-09-14T17:45:33.358924] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-09-14T17:45:33.481349] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-14T17:45:33.502321] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-14T17:45:34.158908] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-09-14T17:45:34.840797] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T17:45:34.958876] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-09-14T17:45:35.758888] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-09-14T17:45:35.872439] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-14T17:45:36.560834] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-09-14T17:45:36.563747] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T17:45:36.593104] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T17:45:37.358847] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-09-14T17:45:38.158899] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-09-14T17:45:38.334566] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T17:45:38.892000] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T17:45:38.958834] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-09-14T17:45:39.758844] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-09-14T17:45:39.914023] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-14T17:45:40.566197] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-09-14T17:45:40.579657] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-14T17:45:40.580981] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T17:45:41.358854] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-09-14T17:45:42.143965] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-14T17:45:42.158832] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-09-14T17:45:42.387491] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T17:45:42.943064] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-14T17:45:42.958781] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-09-14T17:45:43.632991] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T17:45:43.634462] [INFO ] [REMOTE ] DRLL: Full fetch complete (11182 records). [2025-09-14T17:45:43.634546] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-09-14T17:45:43.763918] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-09-14T17:45:44.002276] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-09-14T17:45:44.002390] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-09-14T17:45:44.002783] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-09-14T17:45:44.002853] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-09-14T17:45:44.003491] [DEBUG] [LOCAL ] DRLL: Trimmed 11182 records to 6601 (keeping 150 days of data) [2025-09-14T17:45:44.044804] [DEBUG] [LOCAL ] DRLL: Primary data saved (6601 records). [2025-09-14T17:45:44.044984] [INFO ] [MAIN ] DRLL: Full history saved. [2025-09-14T17:45:44.045121] [INFO ] [MAIN ] Update Progress: 649/2370 symbols completed. DRLL took 16.9s. Estimated remaining: 3h 1m 45s. Rate: 9.5 symbols/min [2025-09-14T17:45:44.215721] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:45:44.233173] [DEBUG] [LOCAL ] DSL: Loaded 13007 existing records from primary storage. [2025-09-14T17:45:44.233427] [INFO ] [MAIN ] DSL: Loaded 13007 existing records. [2025-09-14T17:45:44.414509] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:45:44.414808] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-09-14T17:45:44.414872] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-09-14T17:45:44.415397] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-09-14T17:45:44.415499] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-09-14T17:45:44.564041] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-09-14T17:45:44.780335] [INFO ] [REMOTE ] DSL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:45:45.353766] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T17:45:45.363872] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-09-14T17:45:46.065466] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-14T17:45:46.070488] [INFO ] [REMOTE ] DRD: Full fetch complete (38515 records). [2025-09-14T17:45:46.070605] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-09-14T17:45:46.166033] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-09-14T17:45:46.448195] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-09-14T17:45:46.448311] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-09-14T17:45:46.448945] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-09-14T17:45:46.449003] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-09-14T17:45:46.450167] [DEBUG] [LOCAL ] DRD: Trimmed 38515 records to 26676 (keeping 150 days of data) [2025-09-14T17:45:46.631903] [DEBUG] [LOCAL ] DRD: Primary data saved (26676 records). [2025-09-14T17:45:46.632018] [INFO ] [MAIN ] DRD: Full history saved. [2025-09-14T17:45:46.631811] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-14T17:45:46.637978] [INFO ] [MAIN ] Update Progress: 650/2370 symbols completed. DRD took 30.1s. Estimated remaining: 3h 1m 29s. Rate: 9.5 symbols/min [2025-09-14T17:45:46.812165] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:45:46.819637] [DEBUG] [LOCAL ] DSM: Loaded 5911 existing records from primary storage. [2025-09-14T17:45:46.819793] [INFO ] [MAIN ] DSM: Loaded 5911 existing records. [2025-09-14T17:45:46.964370] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-09-14T17:45:47.002593] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:45:47.003561] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-09-14T17:45:47.003626] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-14T17:45:47.003974] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-09-14T17:45:47.004048] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-09-14T17:45:47.360704] [INFO ] [REMOTE ] DSM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:45:47.687042] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-14T17:45:47.758839] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-09-14T17:45:48.120625] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T17:45:48.413957] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T17:45:48.419857] [INFO ] [REMOTE ] DRH: Full fetch complete (54405 records). [2025-09-14T17:45:48.419996] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-09-14T17:45:48.570548] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-09-14T17:45:48.821056] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-09-14T17:45:48.821163] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-09-14T17:45:48.821985] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-09-14T17:45:48.822046] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-09-14T17:45:48.824106] [DEBUG] [LOCAL ] DRH: Trimmed 54405 records to 37808 (keeping 150 days of data) [2025-09-14T17:45:49.048421] [DEBUG] [LOCAL ] DRH: Primary data saved (37808 records). [2025-09-14T17:45:49.048607] [INFO ] [MAIN ] DRH: Full history saved. [2025-09-14T17:45:49.048769] [INFO ] [MAIN ] Update Progress: 651/2370 symbols completed. DRH took 28.8s. Estimated remaining: 3h 1m 12s. Rate: 9.5 symbols/min [2025-09-14T17:45:49.223394] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:45:49.226065] [DEBUG] [LOCAL ] DSMC: Loaded 681 existing records from primary storage. [2025-09-14T17:45:49.226157] [INFO ] [MAIN ] DSMC: Loaded 681 existing records. [2025-09-14T17:45:49.363938] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-09-14T17:45:49.420228] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:45:49.421284] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-09-14T17:45:49.421357] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-14T17:45:49.421578] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-09-14T17:45:49.421637] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-09-14T17:45:49.774091] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:45:50.158862] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-09-14T17:45:50.266981] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T17:45:50.824067] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T17:45:50.958793] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-09-14T17:45:51.142461] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-14T17:45:51.758845] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-09-14T17:45:52.160410] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-14T17:45:52.243709] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-14T17:45:52.558833] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-09-14T17:45:53.358798] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-09-14T17:45:53.436080] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T17:45:54.158798] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-09-14T17:45:54.539927] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-14T17:45:54.958794] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-09-14T17:45:55.296986] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-14T17:45:55.519427] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-14T17:45:55.758848] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-09-14T17:45:56.168330] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T17:45:56.175083] [INFO ] [REMOTE ] DRI: Full fetch complete (52006 records). [2025-09-14T17:45:56.175275] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-09-14T17:45:56.565581] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-09-14T17:45:56.582388] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-09-14T17:45:56.583847] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-09-14T17:45:56.584544] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-09-14T17:45:56.584745] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-09-14T17:45:56.586069] [DEBUG] [LOCAL ] DRI: Trimmed 52006 records to 35431 (keeping 150 days of data) [2025-09-14T17:45:56.812903] [DEBUG] [LOCAL ] DRI: Primary data saved (35431 records). [2025-09-14T17:45:56.813068] [INFO ] [MAIN ] DRI: Full history saved. [2025-09-14T17:45:56.813224] [INFO ] [MAIN ] Update Progress: 652/2370 symbols completed. DRI took 32.7s. Estimated remaining: 3h 1m 10s. Rate: 9.5 symbols/min [2025-09-14T17:45:56.983225] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:45:56.994809] [DEBUG] [LOCAL ] DSU: Loaded 9890 existing records from primary storage. [2025-09-14T17:45:56.994954] [INFO ] [MAIN ] DSU: Loaded 9890 existing records. [2025-09-14T17:45:57.170580] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:45:57.170862] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-09-14T17:45:57.170922] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-09-14T17:45:57.171278] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-09-14T17:45:57.171337] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-09-14T17:45:57.365119] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-09-14T17:45:57.555794] [INFO ] [REMOTE ] DSU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:45:57.564880] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-14T17:45:57.981449] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-14T17:45:58.158844] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-09-14T17:45:58.958859] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-09-14T17:45:59.334135] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T17:45:59.693879] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-14T17:45:59.758798] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-09-14T17:46:00.188978] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-14T17:46:00.558829] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-09-14T17:46:01.358840] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-09-14T17:46:01.422543] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-14T17:46:01.766961] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-14T17:46:02.158832] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-09-14T17:46:02.958798] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-09-14T17:46:03.237456] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-14T17:46:03.694143] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-14T17:46:03.758866] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-09-14T17:46:04.378325] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T17:46:04.380232] [INFO ] [REMOTE ] DSM: Full fetch complete (18106 records). [2025-09-14T17:46:04.380325] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-09-14T17:46:04.571065] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-09-14T17:46:04.763612] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-09-14T17:46:04.763737] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-09-14T17:46:04.764138] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-09-14T17:46:04.764192] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-09-14T17:46:04.764782] [DEBUG] [LOCAL ] DSM: Trimmed 18106 records to 10547 (keeping 150 days of data) [2025-09-14T17:46:04.832812] [DEBUG] [LOCAL ] DSM: Primary data saved (10547 records). [2025-09-14T17:46:04.832990] [INFO ] [MAIN ] DSM: Full history saved. [2025-09-14T17:46:04.833116] [INFO ] [MAIN ] Update Progress: 653/2370 symbols completed. DSM took 18.2s. Estimated remaining: 3h 1m 8s. Rate: 9.5 symbols/min [2025-09-14T17:46:05.001659] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:46:05.015483] [DEBUG] [LOCAL ] DSX: Loaded 10867 existing records from primary storage. [2025-09-14T17:46:05.015658] [INFO ] [MAIN ] DSX: Loaded 10867 existing records. [2025-09-14T17:46:05.189014] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:46:05.189268] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-09-14T17:46:05.189328] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-09-14T17:46:05.189792] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-09-14T17:46:05.189855] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-09-14T17:46:05.361717] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-09-14T17:46:05.554519] [INFO ] [REMOTE ] DSX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:46:05.925719] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-14T17:46:05.944353] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-14T17:46:06.158853] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-09-14T17:46:06.958821] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-09-14T17:46:07.624793] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-14T17:46:07.758844] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-09-14T17:46:08.077438] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-14T17:46:08.233057] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-14T17:46:08.558840] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-09-14T17:46:09.358843] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-09-14T17:46:09.683047] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T17:46:10.158834] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-09-14T17:46:10.408762] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-14T17:46:10.958789] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-09-14T17:46:11.259267] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-14T17:46:11.262435] [INFO ] [REMOTE ] DSL: Full fetch complete (30740 records). [2025-09-14T17:46:11.262542] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-09-14T17:46:11.426466] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T17:46:11.470199] [INFO ] [REMOTE ] DSMC: Full fetch complete (2236 records). [2025-09-14T17:46:11.527310] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-09-14T17:46:11.774116] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-09-14T17:46:11.856862] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-09-14T17:46:11.901545] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-09-14T17:46:11.921026] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-09-14T17:46:11.923456] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-09-14T17:46:11.983525] [DEBUG] [LOCAL ] DSL: Trimmed 30740 records to 20334 (keeping 150 days of data) [2025-09-14T17:46:12.003670] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-09-14T17:46:12.004002] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-09-14T17:46:12.004129] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-09-14T17:46:12.004206] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-09-14T17:46:12.004677] [DEBUG] [LOCAL ] DSMC: Trimmed 2236 records to 1241 (keeping 150 days of data) [2025-09-14T17:46:12.013858] [DEBUG] [LOCAL ] DSMC: Primary data saved (1241 records). [2025-09-14T17:46:12.079143] [INFO ] [MAIN ] DSMC: Full history saved. [2025-09-14T17:46:12.079430] [INFO ] [MAIN ] Update Progress: 654/2370 symbols completed. DSMC took 23.0s. Estimated remaining: 3h 1m 4s. Rate: 9.5 symbols/min [2025-09-14T17:46:12.288615] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:46:12.320997] [DEBUG] [LOCAL ] DT: Loaded 23671 existing records from primary storage. [2025-09-14T17:46:12.322417] [INFO ] [MAIN ] DT: Loaded 23671 existing records. [2025-09-14T17:46:12.430422] [DEBUG] [LOCAL ] DSL: Primary data saved (20334 records). [2025-09-14T17:46:12.470049] [INFO ] [MAIN ] DSL: Full history saved. [2025-09-14T17:46:12.488089] [INFO ] [MAIN ] Update Progress: 655/2370 symbols completed. DSL took 28.4s. Estimated remaining: 3h 0m 42s. Rate: 9.5 symbols/min [2025-09-14T17:46:12.506692] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:46:12.569378] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-09-14T17:46:12.569559] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-09-14T17:46:12.608474] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-09-14T17:46:12.614579] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-09-14T17:46:12.635506] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-09-14T17:46:12.679121] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:46:12.797976] [DEBUG] [LOCAL ] DTB: Loaded 2630 existing records from primary storage. [2025-09-14T17:46:12.831550] [INFO ] [MAIN ] DTB: Loaded 2630 existing records. [2025-09-14T17:46:13.207278] [INFO ] [REMOTE ] DT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:46:13.211781] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:46:13.227080] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-09-14T17:46:13.227193] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-09-14T17:46:13.228267] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-14T17:46:13.233956] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-09-14T17:46:13.234137] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-09-14T17:46:13.374395] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-09-14T17:46:13.587633] [INFO ] [REMOTE ] DTB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:46:13.837842] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-14T17:46:14.158859] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-09-14T17:46:14.958840] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-09-14T17:46:15.123448] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T17:46:15.513008] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-14T17:46:15.577628] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-14T17:46:15.758839] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-09-14T17:46:16.558841] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-09-14T17:46:16.973113] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-14T17:46:17.358855] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-09-14T17:46:18.158844] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-09-14T17:46:18.428674] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T17:46:18.580061] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-14T17:46:18.958888] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-09-14T17:46:19.086699] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T17:46:19.758897] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-09-14T17:46:20.380010] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-14T17:46:20.558840] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-09-14T17:46:20.763606] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T17:46:21.358822] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-09-14T17:46:21.627153] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-14T17:46:22.158830] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-09-14T17:46:22.958833] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-09-14T17:46:23.128530] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-14T17:46:23.212812] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T17:46:23.550760] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-14T17:46:23.758838] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-09-14T17:46:24.558834] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-09-14T17:46:24.739636] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T17:46:24.742490] [INFO ] [REMOTE ] DSU: Full fetch complete (23252 records). [2025-09-14T17:46:24.742630] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-09-14T17:46:25.041735] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-14T17:46:25.125058] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-09-14T17:46:25.125163] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-09-14T17:46:25.125956] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-09-14T17:46:25.126217] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-09-14T17:46:25.127247] [DEBUG] [LOCAL ] DSU: Trimmed 23252 records to 15655 (keeping 150 days of data) [2025-09-14T17:46:25.224446] [DEBUG] [LOCAL ] DSU: Primary data saved (15655 records). [2025-09-14T17:46:25.224625] [INFO ] [MAIN ] DSU: Full history saved. [2025-09-14T17:46:25.224746] [INFO ] [MAIN ] Update Progress: 656/2370 symbols completed. DSU took 28.4s. Estimated remaining: 3h 0m 52s. Rate: 9.5 symbols/min [2025-09-14T17:46:25.363927] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-09-14T17:46:25.393731] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:46:25.415900] [DEBUG] [LOCAL ] DTE: Loaded 21312 existing records from primary storage. [2025-09-14T17:46:25.416078] [INFO ] [MAIN ] DTE: Loaded 21312 existing records. [2025-09-14T17:46:25.598228] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:46:25.598498] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-09-14T17:46:25.598559] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-14T17:46:25.599298] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-09-14T17:46:25.599363] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-09-14T17:46:25.954993] [INFO ] [REMOTE ] DTE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:46:26.158877] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-09-14T17:46:26.958870] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-09-14T17:46:27.167776] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T17:46:27.594174] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-14T17:46:27.758887] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-09-14T17:46:27.869661] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T17:46:28.558838] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-09-14T17:46:29.358837] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-09-14T17:46:29.686060] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-14T17:46:30.016269] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-14T17:46:30.158809] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-09-14T17:46:30.366086] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T17:46:30.958871] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-09-14T17:46:31.758856] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-09-14T17:46:31.868530] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T17:46:32.253841] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-14T17:46:32.558843] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-09-14T17:46:33.004415] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-14T17:46:33.010013] [INFO ] [REMOTE ] DT: Full fetch complete (57571 records). [2025-09-14T17:46:33.010162] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-09-14T17:46:33.382940] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-09-14T17:46:33.440200] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-09-14T17:46:33.440376] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-09-14T17:46:33.441149] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-09-14T17:46:33.441208] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-09-14T17:46:33.442464] [DEBUG] [LOCAL ] DT: Trimmed 57571 records to 39809 (keeping 150 days of data) [2025-09-14T17:46:33.697999] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T17:46:33.728188] [DEBUG] [LOCAL ] DT: Primary data saved (39809 records). [2025-09-14T17:46:33.728375] [INFO ] [MAIN ] DT: Full history saved. [2025-09-14T17:46:33.728477] [INFO ] [MAIN ] Update Progress: 657/2370 symbols completed. DT took 21.6s. Estimated remaining: 3h 0m 52s. Rate: 9.5 symbols/min [2025-09-14T17:46:33.899564] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:46:33.899809] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-09-14T17:46:33.899863] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-09-14T17:46:33.899978] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-09-14T17:46:33.900030] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-14T17:46:33.900082] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-14T17:46:33.900135] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-09-14T17:46:34.163922] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-09-14T17:46:34.183909] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-14T17:46:34.267212] [INFO ] [REMOTE ] DTF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:46:34.958846] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-09-14T17:46:35.315032] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-14T17:46:35.319554] [INFO ] [REMOTE ] DSX: Full fetch complete (27420 records). [2025-09-14T17:46:35.319881] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-09-14T17:46:35.619219] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T17:46:35.647132] [INFO ] [REMOTE ] DTB: Full fetch complete (4909 records). [2025-09-14T17:46:35.701996] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-09-14T17:46:35.741276] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-09-14T17:46:35.771398] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-09-14T17:46:35.763895] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-09-14T17:46:35.779159] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-09-14T17:46:35.789658] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-09-14T17:46:35.825488] [DEBUG] [LOCAL ] DSX: Trimmed 27420 records to 17812 (keeping 150 days of data) [2025-09-14T17:46:36.156463] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-14T17:46:36.157466] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-09-14T17:46:36.159886] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-09-14T17:46:36.160629] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-09-14T17:46:36.161519] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-09-14T17:46:36.163049] [DEBUG] [LOCAL ] DTB: Trimmed 4909 records to 3720 (keeping 150 days of data) [2025-09-14T17:46:36.193928] [DEBUG] [LOCAL ] DTB: Primary data saved (3720 records). [2025-09-14T17:46:36.195069] [INFO ] [MAIN ] DTB: Full history saved. [2025-09-14T17:46:36.196214] [INFO ] [MAIN ] Update Progress: 658/2370 symbols completed. DTB took 23.7s. Estimated remaining: 3h 0m 35s. Rate: 9.5 symbols/min [2025-09-14T17:46:36.373958] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:46:36.378690] [DEBUG] [LOCAL ] DSX: Primary data saved (17812 records). [2025-09-14T17:46:36.378833] [INFO ] [MAIN ] DSX: Full history saved. [2025-09-14T17:46:36.378931] [INFO ] [MAIN ] Update Progress: 659/2370 symbols completed. DSX took 31.5s. Estimated remaining: 3h 0m 13s. Rate: 9.5 symbols/min [2025-09-14T17:46:36.480001] [DEBUG] [LOCAL ] DTG: Loaded 2706 existing records from primary storage. [2025-09-14T17:46:36.482297] [INFO ] [MAIN ] DTG: Loaded 2706 existing records. [2025-09-14T17:46:36.572001] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-09-14T17:46:36.636821] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:46:36.734369] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:46:36.734748] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-09-14T17:46:36.734846] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-14T17:46:36.735253] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-09-14T17:46:36.735329] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-09-14T17:46:36.865162] [DEBUG] [LOCAL ] DTM: Loaded 18965 existing records from primary storage. [2025-09-14T17:46:36.898629] [INFO ] [MAIN ] DTM: Loaded 18965 existing records. [2025-09-14T17:46:37.268508] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:46:37.289791] [INFO ] [REMOTE ] DTG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:46:37.289914] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-09-14T17:46:37.290020] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-09-14T17:46:37.290901] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-09-14T17:46:37.290968] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-09-14T17:46:37.364316] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-09-14T17:46:37.637281] [INFO ] [REMOTE ] DTM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:46:38.099818] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-14T17:46:38.158779] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-09-14T17:46:38.421792] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T17:46:38.958859] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-09-14T17:46:39.000975] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-14T17:46:39.758839] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-09-14T17:46:40.121204] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-14T17:46:40.547577] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T17:46:40.558773] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-09-14T17:46:41.358827] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-09-14T17:46:41.738149] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-14T17:46:42.158812] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-09-14T17:46:42.467578] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T17:46:42.958826] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-09-14T17:46:43.353322] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-14T17:46:43.547266] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T17:46:43.758875] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-09-14T17:46:44.030628] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-14T17:46:44.558848] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-09-14T17:46:45.358874] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-09-14T17:46:46.158853] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-09-14T17:46:46.301673] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T17:46:46.812489] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-14T17:46:46.958876] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-09-14T17:46:47.216372] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-14T17:46:47.219880] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T17:46:47.758878] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-09-14T17:46:48.042195] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-14T17:46:48.558858] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-09-14T17:46:49.212033] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-14T17:46:49.358836] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-14T17:46:49.621605] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-14T17:46:49.622500] [INFO ] [REMOTE ] DTF: Full fetch complete (1332 records). [2025-09-14T17:46:49.622591] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-09-14T17:46:49.623027] [FATAL] [VALIDATOR ] DTF: Data is stale - most recent date (2025-09-11) is before last completed trading day (2025-09-12). Symbol may be delisted or halted. [2025-09-14T17:46:49.623103] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:46:49.623150] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:46:49.623196] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-14T17:46:49.623264] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-14T17:46:49.623310] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-09-14T17:46:49.623389] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-09-14T17:46:49.623471] [INFO ] [MAIN ] Update Progress: 660/2370 symbols completed. DTF took 15.9s. Estimated remaining: 3h 0m 25s. Rate: 9.5 symbols/min [2025-09-14T17:46:49.794193] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:46:49.798098] [DEBUG] [LOCAL ] DTW: Loaded 2142 existing records from primary storage. [2025-09-14T17:46:49.798222] [INFO ] [MAIN ] DTW: Loaded 2142 existing records. [2025-09-14T17:46:49.975325] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:46:49.975609] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-09-14T17:46:49.975686] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-09-14T17:46:49.975966] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-09-14T17:46:49.976030] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-09-14T17:46:50.159301] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-09-14T17:46:50.350350] [INFO ] [REMOTE ] DTW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:46:50.958813] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-09-14T17:46:51.758884] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-09-14T17:46:52.003674] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T17:46:52.158617] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-14T17:46:52.558814] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-09-14T17:46:52.645799] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T17:46:53.358866] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-09-14T17:46:54.026408] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T17:46:54.031527] [INFO ] [REMOTE ] DTE: Full fetch complete (52205 records). [2025-09-14T17:46:54.031713] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-09-14T17:46:54.173554] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-09-14T17:46:54.414906] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-09-14T17:46:54.415029] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-09-14T17:46:54.415943] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-09-14T17:46:54.416093] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-09-14T17:46:54.417582] [DEBUG] [LOCAL ] DTE: Trimmed 52205 records to 35858 (keeping 150 days of data) [2025-09-14T17:46:54.440354] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-14T17:46:54.687728] [DEBUG] [LOCAL ] DTE: Primary data saved (35858 records). [2025-09-14T17:46:54.687908] [INFO ] [MAIN ] DTE: Full history saved. [2025-09-14T17:46:54.688065] [INFO ] [MAIN ] Update Progress: 661/2370 symbols completed. DTE took 29.5s. Estimated remaining: 3h 0m 15s. Rate: 9.5 symbols/min [2025-09-14T17:46:54.867294] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:46:54.886620] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-14T17:46:54.897160] [DEBUG] [LOCAL ] DUK: Loaded 23903 existing records from primary storage. [2025-09-14T17:46:54.897301] [INFO ] [MAIN ] DUK: Loaded 23903 existing records. [2025-09-14T17:46:54.963944] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-09-14T17:46:55.077880] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:46:55.078203] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-09-14T17:46:55.078280] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-09-14T17:46:55.079084] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-09-14T17:46:55.079166] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-09-14T17:46:55.428838] [INFO ] [REMOTE ] DUK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:46:55.758868] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-09-14T17:46:56.406303] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-14T17:46:56.528221] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-14T17:46:56.558783] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-09-14T17:46:57.358820] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-09-14T17:46:58.158860] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-09-14T17:46:58.437401] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T17:46:58.565476] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-14T17:46:58.958817] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-09-14T17:46:58.974900] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-14T17:46:59.758832] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-09-14T17:47:00.387530] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-14T17:47:00.558812] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-09-14T17:47:00.889999] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T17:47:01.207124] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-14T17:47:01.358827] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-09-14T17:47:01.831102] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-14T17:47:02.158883] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-09-14T17:47:02.850560] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-14T17:47:02.958802] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-09-14T17:47:03.758833] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-09-14T17:47:04.381995] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-14T17:47:04.558873] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-09-14T17:47:05.235901] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-14T17:47:05.309842] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-14T17:47:05.358792] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-09-14T17:47:06.041237] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:47:06.042490] [INFO ] [REMOTE ] DTW: Full fetch complete (5159 records). [2025-09-14T17:47:06.042584] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-09-14T17:47:06.163927] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-09-14T17:47:06.415859] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-09-14T17:47:06.415992] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-09-14T17:47:06.416230] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-09-14T17:47:06.416297] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-09-14T17:47:06.416780] [DEBUG] [LOCAL ] DTW: Trimmed 5159 records to 3562 (keeping 150 days of data) [2025-09-14T17:47:06.439029] [DEBUG] [LOCAL ] DTW: Primary data saved (3562 records). [2025-09-14T17:47:06.439143] [INFO ] [MAIN ] DTW: Full history saved. [2025-09-14T17:47:06.439287] [INFO ] [MAIN ] Update Progress: 662/2370 symbols completed. DTW took 16.8s. Estimated remaining: 3h 0m 23s. Rate: 9.5 symbols/min [2025-09-14T17:47:06.609106] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:47:06.613690] [DEBUG] [LOCAL ] DUKB: Loaded 2763 existing records from primary storage. [2025-09-14T17:47:06.613807] [INFO ] [MAIN ] DUKB: Loaded 2763 existing records. [2025-09-14T17:47:06.791165] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:47:06.791425] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-09-14T17:47:06.791502] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-09-14T17:47:06.791805] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-09-14T17:47:06.791879] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-09-14T17:47:06.895227] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T17:47:06.912309] [INFO ] [REMOTE ] DTG: Full fetch complete (6416 records). [2025-09-14T17:47:06.922671] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-09-14T17:47:06.958786] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-09-14T17:47:07.424101] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:47:07.531736] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-09-14T17:47:07.532032] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-09-14T17:47:07.532240] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-09-14T17:47:07.532299] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-09-14T17:47:07.532823] [DEBUG] [LOCAL ] DTG: Trimmed 6416 records to 4209 (keeping 150 days of data) [2025-09-14T17:47:07.559809] [DEBUG] [LOCAL ] DTG: Primary data saved (4209 records). [2025-09-14T17:47:07.559962] [INFO ] [MAIN ] DTG: Full history saved. [2025-09-14T17:47:07.560060] [INFO ] [MAIN ] Update Progress: 663/2370 symbols completed. DTG took 31.4s. Estimated remaining: 3h 0m 3s. Rate: 9.5 symbols/min [2025-09-14T17:47:07.738108] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:47:07.750029] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-14T17:47:07.754675] [INFO ] [REMOTE ] DTM: Full fetch complete (48802 records). [2025-09-14T17:47:07.754817] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-09-14T17:47:07.766490] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-09-14T17:47:07.884963] [DEBUG] [LOCAL ] DV: Loaded 22743 existing records from primary storage. [2025-09-14T17:47:07.923885] [INFO ] [MAIN ] DV: Loaded 22743 existing records. [2025-09-14T17:47:08.305736] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:47:08.338031] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-09-14T17:47:08.338099] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-09-14T17:47:08.338214] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-09-14T17:47:08.338330] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-09-14T17:47:08.339287] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-09-14T17:47:08.339413] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-09-14T17:47:08.340281] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-09-14T17:47:08.340389] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-09-14T17:47:08.416992] [DEBUG] [LOCAL ] DTM: Trimmed 48802 records to 32519 (keeping 150 days of data) [2025-09-14T17:47:08.586091] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-09-14T17:47:08.807659] [INFO ] [REMOTE ] DV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:47:08.920378] [DEBUG] [LOCAL ] DTM: Primary data saved (32519 records). [2025-09-14T17:47:08.920563] [INFO ] [MAIN ] DTM: Full history saved. [2025-09-14T17:47:08.920688] [INFO ] [MAIN ] Update Progress: 664/2370 symbols completed. DTM took 32.5s. Estimated remaining: 2h 59m 44s. Rate: 9.5 symbols/min [2025-09-14T17:47:09.088459] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:47:09.107874] [DEBUG] [LOCAL ] DVA: Loaded 18463 existing records from primary storage. [2025-09-14T17:47:09.108080] [INFO ] [MAIN ] DVA: Loaded 18463 existing records. [2025-09-14T17:47:09.291090] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:47:09.291345] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-09-14T17:47:09.291408] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-09-14T17:47:09.292082] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-09-14T17:47:09.292148] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-09-14T17:47:09.361381] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-09-14T17:47:09.401517] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-14T17:47:09.678188] [INFO ] [REMOTE ] DVA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:47:09.714903] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-14T17:47:10.158834] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-09-14T17:47:10.958844] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-09-14T17:47:11.149961] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-14T17:47:11.551319] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T17:47:11.626600] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-14T17:47:11.758898] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-09-14T17:47:12.558897] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-09-14T17:47:13.358793] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-09-14T17:47:13.779385] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-14T17:47:14.158842] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-09-14T17:47:14.638905] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-14T17:47:14.958867] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-09-14T17:47:15.096372] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-14T17:47:15.727944] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T17:47:15.758792] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-09-14T17:47:16.558802] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-09-14T17:47:16.781618] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-14T17:47:17.164820] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-14T17:47:17.358829] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-09-14T17:47:18.050232] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-14T17:47:18.158824] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-09-14T17:47:18.560928] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T17:47:18.958844] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-09-14T17:47:19.723160] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-14T17:47:19.758817] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-09-14T17:47:19.854915] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T17:47:20.511913] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-14T17:47:20.558788] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-09-14T17:47:21.358833] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-09-14T17:47:21.927453] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-14T17:47:22.158837] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-09-14T17:47:22.257548] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-14T17:47:22.958830] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-09-14T17:47:23.567558] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-14T17:47:23.643452] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-14T17:47:23.758826] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-09-14T17:47:24.413239] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-14T17:47:24.558828] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-09-14T17:47:25.358837] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-09-14T17:47:26.158790] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-09-14T17:47:26.385959] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T17:47:26.750088] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T17:47:26.751228] [INFO ] [REMOTE ] DUKB: Full fetch complete (6948 records). [2025-09-14T17:47:26.751312] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-09-14T17:47:26.963963] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-09-14T17:47:27.122154] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-09-14T17:47:27.122333] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-09-14T17:47:27.122636] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-09-14T17:47:27.122776] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-09-14T17:47:27.123339] [DEBUG] [LOCAL ] DUKB: Trimmed 6948 records to 4720 (keeping 150 days of data) [2025-09-14T17:47:27.153187] [DEBUG] [LOCAL ] DUKB: Primary data saved (4720 records). [2025-09-14T17:47:27.153444] [INFO ] [MAIN ] DUKB: Full history saved. [2025-09-14T17:47:27.153550] [INFO ] [MAIN ] Update Progress: 665/2370 symbols completed. DUKB took 20.7s. Estimated remaining: 3h 0m 8s. Rate: 9.5 symbols/min [2025-09-14T17:47:27.232872] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-14T17:47:27.371029] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:47:27.395877] [DEBUG] [LOCAL ] DVN: Loaded 24112 existing records from primary storage. [2025-09-14T17:47:27.396115] [INFO ] [MAIN ] DVN: Loaded 24112 existing records. [2025-09-14T17:47:27.571232] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:47:27.571504] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-09-14T17:47:27.571575] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-09-14T17:47:27.572165] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-09-14T17:47:27.572231] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-09-14T17:47:27.764206] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-09-14T17:47:27.931607] [INFO ] [REMOTE ] DVN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:47:28.516557] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-14T17:47:28.558791] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-09-14T17:47:29.022884] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-14T17:47:29.027511] [INFO ] [REMOTE ] DVA: Full fetch complete (45940 records). [2025-09-14T17:47:29.027670] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-09-14T17:47:29.361384] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-09-14T17:47:29.446609] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-09-14T17:47:29.446813] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-09-14T17:47:29.447579] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-09-14T17:47:29.447668] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-09-14T17:47:29.449032] [DEBUG] [LOCAL ] DVA: Trimmed 45940 records to 30946 (keeping 150 days of data) [2025-09-14T17:47:29.572765] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T17:47:29.696470] [DEBUG] [LOCAL ] DVA: Primary data saved (30946 records). [2025-09-14T17:47:29.696692] [INFO ] [MAIN ] DVA: Full history saved. [2025-09-14T17:47:29.696804] [INFO ] [MAIN ] Update Progress: 666/2370 symbols completed. DVA took 20.8s. Estimated remaining: 2h 59m 52s. Rate: 9.5 symbols/min [2025-09-14T17:47:29.867982] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:47:29.893313] [DEBUG] [LOCAL ] DX: Loaded 23455 existing records from primary storage. [2025-09-14T17:47:29.893505] [INFO ] [MAIN ] DX: Loaded 23455 existing records. [2025-09-14T17:47:30.080258] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:47:30.080632] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-09-14T17:47:30.080837] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-09-14T17:47:30.081483] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-09-14T17:47:30.081549] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-09-14T17:47:30.164762] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-09-14T17:47:30.178992] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T17:47:30.229077] [INFO ] [REMOTE ] DUK: Full fetch complete (58150 records). [2025-09-14T17:47:30.257730] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-09-14T17:47:30.616459] [INFO ] [REMOTE ] DX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:47:30.854121] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-09-14T17:47:30.854237] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-09-14T17:47:30.855029] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-09-14T17:47:30.855101] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-09-14T17:47:30.856589] [DEBUG] [LOCAL ] DUK: Trimmed 58150 records to 40227 (keeping 150 days of data) [2025-09-14T17:47:30.960724] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-09-14T17:47:31.128868] [DEBUG] [LOCAL ] DUK: Primary data saved (40227 records). [2025-09-14T17:47:31.129040] [INFO ] [MAIN ] DUK: Full history saved. [2025-09-14T17:47:31.129147] [INFO ] [MAIN ] Update Progress: 667/2370 symbols completed. DUK took 36.4s. Estimated remaining: 2h 59m 33s. Rate: 9.5 symbols/min [2025-09-14T17:47:31.302917] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:47:31.326042] [DEBUG] [LOCAL ] DXC: Loaded 22555 existing records from primary storage. [2025-09-14T17:47:31.326238] [INFO ] [MAIN ] DXC: Loaded 22555 existing records. [2025-09-14T17:47:31.521359] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:47:31.521680] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-09-14T17:47:31.521754] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-09-14T17:47:31.522383] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-09-14T17:47:31.522446] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-09-14T17:47:31.764047] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-09-14T17:47:31.863713] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-14T17:47:31.917096] [INFO ] [REMOTE ] DV: Full fetch complete (55514 records). [2025-09-14T17:47:31.922618] [INFO ] [REMOTE ] DXC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:47:31.923262] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-09-14T17:47:32.337439] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-09-14T17:47:32.337576] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-09-14T17:47:32.338597] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-09-14T17:47:32.338861] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-09-14T17:47:32.352008] [DEBUG] [LOCAL ] DV: Trimmed 55514 records to 38284 (keeping 150 days of data) [2025-09-14T17:47:32.374657] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-14T17:47:32.562199] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-09-14T17:47:32.618705] [DEBUG] [LOCAL ] DV: Primary data saved (38284 records). [2025-09-14T17:47:32.618899] [INFO ] [MAIN ] DV: Full history saved. [2025-09-14T17:47:32.619018] [INFO ] [MAIN ] Update Progress: 668/2370 symbols completed. DV took 25.1s. Estimated remaining: 2h 59m 15s. Rate: 9.5 symbols/min [2025-09-14T17:47:32.790592] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:47:32.806521] [DEBUG] [LOCAL ] DXYZ: Loaded 15671 existing records from primary storage. [2025-09-14T17:47:32.806717] [INFO ] [MAIN ] DXYZ: Loaded 15671 existing records. [2025-09-14T17:47:32.983668] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:47:32.983953] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-09-14T17:47:32.984017] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-09-14T17:47:32.984527] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-09-14T17:47:32.984603] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-09-14T17:47:33.348632] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:47:33.358780] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-09-14T17:47:33.625912] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T17:47:34.154527] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T17:47:34.163454] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-09-14T17:47:34.958878] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-09-14T17:47:35.549617] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-14T17:47:35.758864] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-09-14T17:47:36.080566] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T17:47:36.558856] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-09-14T17:47:36.855247] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T17:47:37.358943] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-09-14T17:47:37.758127] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-14T17:47:38.158812] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-09-14T17:47:38.276692] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T17:47:38.958859] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-09-14T17:47:39.087920] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T17:47:39.758832] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-09-14T17:47:40.169106] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-14T17:47:40.558872] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-09-14T17:47:40.905545] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-14T17:47:41.358862] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-09-14T17:47:41.425188] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-14T17:47:42.158853] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-09-14T17:47:42.336158] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T17:47:42.958941] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-09-14T17:47:43.299567] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-14T17:47:43.758804] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-09-14T17:47:43.802102] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T17:47:44.462981] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T17:47:44.558792] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-09-14T17:47:45.185283] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T17:47:45.358817] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-09-14T17:47:46.158865] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-09-14T17:47:46.442224] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T17:47:46.930857] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-14T17:47:46.958821] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-09-14T17:47:47.758915] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-09-14T17:47:48.105078] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-14T17:47:48.558825] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-09-14T17:47:48.605184] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-14T17:47:49.358891] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-09-14T17:47:49.712148] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-14T17:47:50.158871] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-09-14T17:47:50.258678] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T17:47:50.958885] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-09-14T17:47:51.068469] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T17:47:51.758898] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-09-14T17:47:51.829217] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-14T17:47:51.833674] [INFO ] [REMOTE ] DXYZ: Full fetch complete (40639 records). [2025-09-14T17:47:51.833901] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-09-14T17:47:52.237326] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-09-14T17:47:52.237507] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-09-14T17:47:52.238612] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-09-14T17:47:52.238741] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-09-14T17:47:52.240393] [DEBUG] [LOCAL ] DXYZ: Trimmed 40639 records to 26884 (keeping 150 days of data) [2025-09-14T17:47:52.410932] [DEBUG] [LOCAL ] DXYZ: Primary data saved (26884 records). [2025-09-14T17:47:52.411154] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-09-14T17:47:52.411291] [INFO ] [MAIN ] Update Progress: 669/2370 symbols completed. DXYZ took 19.8s. Estimated remaining: 2h 59m 42s. Rate: 9.5 symbols/min [2025-09-14T17:47:52.563448] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-09-14T17:47:52.600332] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:47:52.644085] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-14T17:47:52.654529] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-14T17:47:52.666543] [INFO ] [REMOTE ] DVN: Full fetch complete (58379 records). [2025-09-14T17:47:52.666852] [INFO ] [REMOTE ] DX: Full fetch complete (56960 records). [2025-09-14T17:47:52.673171] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-09-14T17:47:52.674752] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-09-14T17:47:52.676081] [DEBUG] [LOCAL ] DY: Loaded 12140 existing records from primary storage. [2025-09-14T17:47:52.724507] [INFO ] [MAIN ] DY: Loaded 12140 existing records. [2025-09-14T17:47:53.412345] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:47:53.562404] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-09-14T17:47:53.615823] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-09-14T17:47:53.687668] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-09-14T17:47:53.698884] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-09-14T17:47:53.699230] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-09-14T17:47:53.699142] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-09-14T17:47:53.700548] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-09-14T17:47:53.738045] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-09-14T17:47:53.777618] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-09-14T17:47:53.797463] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-09-14T17:47:53.813407] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-09-14T17:47:53.839757] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-09-14T17:47:53.857807] [DEBUG] [LOCAL ] DVN: Trimmed 58379 records to 40439 (keeping 150 days of data) [2025-09-14T17:47:53.977197] [DEBUG] [LOCAL ] DX: Trimmed 56960 records to 39442 (keeping 150 days of data) [2025-09-14T17:47:54.393327] [INFO ] [REMOTE ] DY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:47:54.396250] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-09-14T17:47:54.553149] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-14T17:47:54.577861] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-09-14T17:47:54.623786] [DEBUG] [LOCAL ] DX: Primary data saved (39442 records). [2025-09-14T17:47:54.625990] [INFO ] [MAIN ] DX: Full history saved. [2025-09-14T17:47:54.626857] [INFO ] [MAIN ] Update Progress: 670/2370 symbols completed. DX took 24.9s. Estimated remaining: 2h 59m 26s. Rate: 9.5 symbols/min [2025-09-14T17:47:54.920782] [DEBUG] [LOCAL ] DVN: Primary data saved (40439 records). [2025-09-14T17:47:54.949450] [INFO ] [MAIN ] DVN: Full history saved. [2025-09-14T17:47:54.949708] [INFO ] [MAIN ] Update Progress: 671/2370 symbols completed. DVN took 27.8s. Estimated remaining: 2h 59m 4s. Rate: 9.5 symbols/min [2025-09-14T17:47:54.949296] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:47:55.141712] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:47:55.142895] [DEBUG] [LOCAL ] E: Loaded 14413 existing records from primary storage. [2025-09-14T17:47:55.143697] [INFO ] [MAIN ] E: Loaded 14413 existing records. [2025-09-14T17:47:55.331023] [DEBUG] [LOCAL ] EAF: Loaded 18628 existing records from primary storage. [2025-09-14T17:47:55.353731] [INFO ] [MAIN ] EAF: Loaded 18628 existing records. [2025-09-14T17:47:55.353902] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:47:55.428782] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-09-14T17:47:55.460390] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-09-14T17:47:55.469316] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-09-14T17:47:55.508496] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-09-14T17:47:55.555723] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:47:55.625596] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-09-14T17:47:55.676761] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-09-14T17:47:55.767409] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-09-14T17:47:55.861169] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-09-14T17:47:56.061254] [INFO ] [REMOTE ] E: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:47:56.061977] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-09-14T17:47:56.281212] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T17:47:56.344779] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-09-14T17:47:56.378526] [INFO ] [REMOTE ] EAF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:47:56.422247] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-14T17:47:56.558922] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-09-14T17:47:57.358842] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-09-14T17:47:57.397340] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T17:47:57.948936] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-14T17:47:58.158908] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-09-14T17:47:58.219239] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T17:47:58.747618] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-14T17:47:58.958850] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-09-14T17:47:59.310567] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-14T17:47:59.758868] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-09-14T17:48:00.558877] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-09-14T17:48:00.624187] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T17:48:01.072379] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-14T17:48:01.358855] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-09-14T17:48:01.734762] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-14T17:48:02.158862] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-09-14T17:48:02.958814] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-09-14T17:48:03.758892] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-09-14T17:48:04.138552] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (2.78 seconds). [2025-09-14T17:48:04.558869] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-09-14T17:48:04.599888] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-14T17:48:04.606558] [INFO ] [REMOTE ] DXC: Full fetch complete (53224 records). [2025-09-14T17:48:04.606915] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-09-14T17:48:05.021184] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-09-14T17:48:05.021369] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-09-14T17:48:05.022809] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-09-14T17:48:05.022895] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-09-14T17:48:05.031753] [DEBUG] [LOCAL ] DXC: Trimmed 53224 records to 37447 (keeping 150 days of data) [2025-09-14T17:48:05.042315] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-14T17:48:05.286498] [DEBUG] [LOCAL ] DXC: Primary data saved (37447 records). [2025-09-14T17:48:05.286781] [INFO ] [MAIN ] DXC: Full history saved. [2025-09-14T17:48:05.286952] [INFO ] [MAIN ] Update Progress: 672/2370 symbols completed. DXC took 34.2s. Estimated remaining: 2h 59m 8s. Rate: 9.5 symbols/min [2025-09-14T17:48:05.371472] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-09-14T17:48:05.477540] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:48:05.483212] [DEBUG] [LOCAL ] EAI: Loaded 1656 existing records from primary storage. [2025-09-14T17:48:05.483512] [INFO ] [MAIN ] EAI: Loaded 1656 existing records. [2025-09-14T17:48:05.626986] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (3.47 seconds). [2025-09-14T17:48:05.726248] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:48:05.726593] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-09-14T17:48:05.726682] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-09-14T17:48:05.726996] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-09-14T17:48:05.727063] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-09-14T17:48:06.123827] [INFO ] [REMOTE ] EAI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:48:06.158878] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-09-14T17:48:06.246558] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T17:48:06.433163] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-14T17:48:06.622675] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-14T17:48:06.958831] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-09-14T17:48:07.544027] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-14T17:48:07.758863] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-09-14T17:48:08.558901] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-09-14T17:48:09.358844] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-09-14T17:48:09.453669] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-14T17:48:09.499248] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T17:48:10.158837] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-09-14T17:48:10.750658] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T17:48:10.958932] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-09-14T17:48:11.758888] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-09-14T17:48:11.864519] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-14T17:48:12.270108] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-14T17:48:12.558857] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-09-14T17:48:13.266282] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T17:48:13.358818] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-09-14T17:48:14.158902] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-09-14T17:48:14.479594] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-14T17:48:14.958965] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-09-14T17:48:15.368384] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-14T17:48:15.740372] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T17:48:15.758828] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-09-14T17:48:16.100102] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-14T17:48:16.104182] [INFO ] [REMOTE ] DY: Full fetch complete (33449 records). [2025-09-14T17:48:16.104461] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-09-14T17:48:16.499967] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-09-14T17:48:16.500137] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-09-14T17:48:16.501157] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-09-14T17:48:16.501232] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-09-14T17:48:16.502458] [DEBUG] [LOCAL ] DY: Trimmed 33449 records to 21411 (keeping 150 days of data) [2025-09-14T17:48:16.573930] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-09-14T17:48:16.625955] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T17:48:16.676525] [DEBUG] [LOCAL ] DY: Primary data saved (21411 records). [2025-09-14T17:48:16.676733] [INFO ] [MAIN ] DY: Full history saved. [2025-09-14T17:48:16.676852] [INFO ] [MAIN ] Update Progress: 673/2370 symbols completed. DY took 24.3s. Estimated remaining: 2h 59m 14s. Rate: 9.5 symbols/min [2025-09-14T17:48:16.850933] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:48:16.863060] [DEBUG] [LOCAL ] EARN: Loaded 11109 existing records from primary storage. [2025-09-14T17:48:16.863242] [INFO ] [MAIN ] EARN: Loaded 11109 existing records. [2025-09-14T17:48:17.039602] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:48:17.039910] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-09-14T17:48:17.039973] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-09-14T17:48:17.040385] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-09-14T17:48:17.040444] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-09-14T17:48:17.366710] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-09-14T17:48:17.394109] [INFO ] [REMOTE ] EARN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:48:17.555783] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-14T17:48:18.027220] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-14T17:48:18.158846] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-09-14T17:48:18.958827] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-09-14T17:48:19.353805] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-14T17:48:19.758823] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-09-14T17:48:19.938004] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T17:48:19.941362] [INFO ] [REMOTE ] E: Full fetch complete (36533 records). [2025-09-14T17:48:19.941465] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-09-14T17:48:20.317412] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-09-14T17:48:20.317516] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-09-14T17:48:20.318107] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-09-14T17:48:20.318167] [DEBUG] [LOCAL ] E: Saving primary data. [2025-09-14T17:48:20.319202] [DEBUG] [LOCAL ] E: Trimmed 36533 records to 25020 (keeping 150 days of data) [2025-09-14T17:48:20.420436] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-14T17:48:20.483652] [DEBUG] [LOCAL ] E: Primary data saved (25020 records). [2025-09-14T17:48:20.483818] [INFO ] [MAIN ] E: Full history saved. [2025-09-14T17:48:20.483927] [INFO ] [MAIN ] Update Progress: 674/2370 symbols completed. E took 25.9s. Estimated remaining: 2h 59m 2s. Rate: 9.5 symbols/min [2025-09-14T17:48:20.563984] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-09-14T17:48:20.666939] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:48:20.692825] [DEBUG] [LOCAL ] EAT: Loaded 21973 existing records from primary storage. [2025-09-14T17:48:20.693037] [INFO ] [MAIN ] EAT: Loaded 21973 existing records. [2025-09-14T17:48:20.876058] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:48:20.876353] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-09-14T17:48:20.876418] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-14T17:48:20.877064] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-09-14T17:48:20.877128] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-09-14T17:48:21.227596] [INFO ] [REMOTE ] EAT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:48:21.358874] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-09-14T17:48:22.158853] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-09-14T17:48:22.241495] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-14T17:48:22.757869] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-14T17:48:22.958832] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-09-14T17:48:23.317838] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-14T17:48:23.758860] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-09-14T17:48:24.558825] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-09-14T17:48:24.675257] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T17:48:24.710456] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-14T17:48:24.713548] [INFO ] [REMOTE ] EAF: Full fetch complete (48957 records). [2025-09-14T17:48:24.713679] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-09-14T17:48:25.084785] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-09-14T17:48:25.084888] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-09-14T17:48:25.085630] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-09-14T17:48:25.085718] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-09-14T17:48:25.086774] [DEBUG] [LOCAL ] EAF: Trimmed 48957 records to 33346 (keeping 150 days of data) [2025-09-14T17:48:25.277969] [DEBUG] [LOCAL ] EAF: Primary data saved (33346 records). [2025-09-14T17:48:25.278135] [INFO ] [MAIN ] EAF: Full history saved. [2025-09-14T17:48:25.278272] [INFO ] [MAIN ] Update Progress: 675/2370 symbols completed. EAF took 30.3s. Estimated remaining: 2h 58m 51s. Rate: 9.5 symbols/min [2025-09-14T17:48:25.367529] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-09-14T17:48:25.450287] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:48:25.467156] [DEBUG] [LOCAL ] EB: Loaded 16215 existing records from primary storage. [2025-09-14T17:48:25.467315] [INFO ] [MAIN ] EB: Loaded 16215 existing records. [2025-09-14T17:48:25.640865] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:48:25.641176] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-09-14T17:48:25.641246] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-09-14T17:48:25.641844] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-09-14T17:48:25.641920] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-09-14T17:48:25.986897] [INFO ] [REMOTE ] EB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:48:26.158835] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-09-14T17:48:26.427354] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T17:48:26.874962] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T17:48:26.958830] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-09-14T17:48:27.759211] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-09-14T17:48:27.761582] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-14T17:48:28.505696] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T17:48:28.558780] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-09-14T17:48:28.973609] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-14T17:48:28.974633] [INFO ] [REMOTE ] EAI: Full fetch complete (4327 records). [2025-09-14T17:48:28.974734] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-09-14T17:48:29.322659] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-09-14T17:48:29.322759] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-09-14T17:48:29.322894] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-09-14T17:48:29.322944] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-09-14T17:48:29.323327] [DEBUG] [LOCAL ] EAI: Trimmed 4327 records to 2854 (keeping 150 days of data) [2025-09-14T17:48:29.342371] [DEBUG] [LOCAL ] EAI: Primary data saved (2854 records). [2025-09-14T17:48:29.342448] [INFO ] [MAIN ] EAI: Full history saved. [2025-09-14T17:48:29.342552] [INFO ] [MAIN ] Update Progress: 676/2370 symbols completed. EAI took 24.1s. Estimated remaining: 2h 58m 39s. Rate: 9.5 symbols/min [2025-09-14T17:48:29.363967] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-09-14T17:48:29.515800] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:48:29.526770] [DEBUG] [LOCAL ] EBF: Loaded 8239 existing records from primary storage. [2025-09-14T17:48:29.526924] [INFO ] [MAIN ] EBF: Loaded 8239 existing records. [2025-09-14T17:48:29.701938] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:48:29.702373] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-09-14T17:48:29.702486] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-09-14T17:48:29.702896] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-09-14T17:48:29.708105] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-09-14T17:48:29.792384] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-14T17:48:30.083547] [INFO ] [REMOTE ] EBF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:48:30.158875] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-09-14T17:48:30.958878] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-09-14T17:48:31.420506] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-14T17:48:31.464274] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-14T17:48:31.758865] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-09-14T17:48:32.226953] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T17:48:32.558843] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-09-14T17:48:32.814917] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-14T17:48:32.817863] [INFO ] [REMOTE ] EARN: Full fetch complete (34557 records). [2025-09-14T17:48:32.817957] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-09-14T17:48:33.188828] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-09-14T17:48:33.188961] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-09-14T17:48:33.189544] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-09-14T17:48:33.189599] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-09-14T17:48:33.190407] [DEBUG] [LOCAL ] EARN: Trimmed 34557 records to 20708 (keeping 150 days of data) [2025-09-14T17:48:33.314413] [DEBUG] [LOCAL ] EARN: Primary data saved (20708 records). [2025-09-14T17:48:33.314566] [INFO ] [MAIN ] EARN: Full history saved. [2025-09-14T17:48:33.314672] [INFO ] [MAIN ] Update Progress: 677/2370 symbols completed. EARN took 16.6s. Estimated remaining: 2h 58m 27s. Rate: 9.5 symbols/min [2025-09-14T17:48:33.358823] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-09-14T17:48:34.139388] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T17:48:34.158770] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-09-14T17:48:34.203875] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-14T17:48:34.958883] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-09-14T17:48:35.765584] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-09-14T17:48:35.781173] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-14T17:48:36.558790] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-09-14T17:48:36.919212] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-14T17:48:36.950764] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-14T17:48:37.358882] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-09-14T17:48:37.929453] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T17:48:38.158943] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-09-14T17:48:38.958853] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-09-14T17:48:39.175188] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T17:48:39.696113] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T17:48:39.758809] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-09-14T17:48:39.817583] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-14T17:48:40.558860] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-09-14T17:48:41.322918] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T17:48:41.358805] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-09-14T17:48:41.554891] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-14T17:48:42.158888] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-09-14T17:48:42.547836] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-14T17:48:42.551434] [INFO ] [REMOTE ] EB: Full fetch complete (41676 records). [2025-09-14T17:48:42.551598] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-09-14T17:48:42.929383] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-09-14T17:48:42.929496] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-09-14T17:48:42.930349] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-09-14T17:48:42.930425] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-09-14T17:48:42.941754] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-14T17:48:42.946006] [DEBUG] [LOCAL ] EB: Trimmed 41676 records to 27695 (keeping 150 days of data) [2025-09-14T17:48:42.993020] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-09-14T17:48:43.102687] [DEBUG] [LOCAL ] EB: Primary data saved (27695 records). [2025-09-14T17:48:43.102853] [INFO ] [MAIN ] EB: Full history saved. [2025-09-14T17:48:43.102949] [INFO ] [MAIN ] Update Progress: 678/2370 symbols completed. EB took 17.8s. Estimated remaining: 2h 58m 30s. Rate: 9.5 symbols/min [2025-09-14T17:48:43.758882] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-09-14T17:48:44.082577] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-14T17:48:44.558831] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-09-14T17:48:45.329860] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-14T17:48:45.358782] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-09-14T17:48:45.576056] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-14T17:48:46.158822] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-09-14T17:48:47.067693] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-14T17:48:47.070058] [INFO ] [REMOTE ] EBF: Full fetch complete (21518 records). [2025-09-14T17:48:47.070273] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-09-14T17:48:47.282806] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-14T17:48:47.398775] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-09-14T17:48:47.482866] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-09-14T17:48:47.482977] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-09-14T17:48:47.483502] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-09-14T17:48:47.483569] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-09-14T17:48:47.484203] [DEBUG] [LOCAL ] EBF: Trimmed 21518 records to 14154 (keeping 150 days of data) [2025-09-14T17:48:47.574392] [DEBUG] [LOCAL ] EBF: Primary data saved (14154 records). [2025-09-14T17:48:47.574587] [INFO ] [MAIN ] EBF: Full history saved. [2025-09-14T17:48:47.574720] [INFO ] [MAIN ] Update Progress: 679/2370 symbols completed. EBF took 18.2s. Estimated remaining: 2h 58m 19s. Rate: 9.5 symbols/min [2025-09-14T17:48:48.115492] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T17:48:48.120715] [INFO ] [REMOTE ] EAT: Full fetch complete (54343 records). [2025-09-14T17:48:48.120843] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-09-14T17:48:48.496103] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-09-14T17:48:48.496209] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-09-14T17:48:48.497066] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-09-14T17:48:48.497131] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-09-14T17:48:48.498295] [DEBUG] [LOCAL ] EAT: Trimmed 54343 records to 37345 (keeping 150 days of data) [2025-09-14T17:48:48.725509] [DEBUG] [LOCAL ] EAT: Primary data saved (37345 records). [2025-09-14T17:48:48.725717] [INFO ] [MAIN ] EAT: Full history saved. [2025-09-14T17:48:48.725820] [INFO ] [MAIN ] Update Progress: 680/2370 symbols completed. EAT took 28.2s. Estimated remaining: 2h 57m 59s. Rate: 9.5 symbols/min [2025-09-14T17:48:49.405011] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:48:49.394208] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:48:49.444782] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:48:49.443960] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:48:49.477909] [DEBUG] [LOCAL ] EBR: Loaded 19235 existing records from primary storage. [2025-09-14T17:48:49.483436] [INFO ] [MAIN ] EBR: Loaded 19235 existing records. [2025-09-14T17:48:49.484061] [DEBUG] [LOCAL ] ECAT: Loaded 13971 existing records from primary storage. [2025-09-14T17:48:49.498102] [DEBUG] [LOCAL ] EC: Loaded 21590 existing records from primary storage. [2025-09-14T17:48:49.499048] [DEBUG] [LOCAL ] EBS: Loaded 21227 existing records from primary storage. [2025-09-14T17:48:49.504349] [INFO ] [MAIN ] EC: Loaded 21590 existing records. [2025-09-14T17:48:49.499131] [INFO ] [MAIN ] ECAT: Loaded 13971 existing records. [2025-09-14T17:48:49.549634] [INFO ] [MAIN ] EBS: Loaded 21227 existing records. [2025-09-14T17:48:50.105586] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:48:50.197424] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:48:50.226885] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-09-14T17:48:50.230667] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-09-14T17:48:50.226797] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:48:50.230476] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:48:50.230576] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-09-14T17:48:50.231316] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-09-14T17:48:50.231127] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-09-14T17:48:50.231156] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-09-14T17:48:50.231575] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-14T17:48:50.231681] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-09-14T17:48:50.231715] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-09-14T17:48:50.232090] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-09-14T17:48:50.237690] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-09-14T17:48:50.252315] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-09-14T17:48:50.272798] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-09-14T17:48:50.237742] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-09-14T17:48:50.303527] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-09-14T17:48:50.298308] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-09-14T17:48:51.394570] [INFO ] [REMOTE ] EBS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:48:51.460133] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-09-14T17:48:51.605251] [INFO ] [REMOTE ] EBR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:48:51.610290] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:48:51.610596] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-09-14T17:48:51.610908] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-09-14T17:48:51.679092] [INFO ] [REMOTE ] EC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:48:51.679559] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-09-14T17:48:53.089023] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T17:48:53.098157] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-09-14T17:48:53.115155] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-14T17:48:53.121631] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-09-14T17:48:53.143225] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T17:48:53.150854] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-09-14T17:48:53.211217] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T17:48:53.358788] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-09-14T17:48:54.238025] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T17:48:54.245571] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-09-14T17:48:54.671323] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T17:48:54.851259] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T17:48:54.958809] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-14T17:48:54.958937] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-09-14T17:48:55.113123] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-14T17:48:55.758844] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-09-14T17:48:56.558804] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-09-14T17:48:56.593626] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T17:48:57.358843] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-09-14T17:48:57.444717] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T17:48:57.603422] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-14T17:48:58.158890] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-09-14T17:48:58.958817] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-09-14T17:48:59.275422] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T17:48:59.758807] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-09-14T17:48:59.788514] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T17:49:00.255100] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-14T17:49:00.558887] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-09-14T17:49:01.358906] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-09-14T17:49:01.621490] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T17:49:02.158896] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-09-14T17:49:02.707199] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-14T17:49:02.833119] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-14T17:49:02.958874] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-09-14T17:49:03.758841] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-09-14T17:49:03.878198] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T17:49:04.558860] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-09-14T17:49:04.929531] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-14T17:49:04.983318] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-14T17:49:05.358843] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-09-14T17:49:06.158844] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-09-14T17:49:06.295263] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T17:49:06.537109] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T17:49:06.958864] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-09-14T17:49:07.758836] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-09-14T17:49:07.876532] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T17:49:08.403189] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-14T17:49:08.558841] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-09-14T17:49:09.358830] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-09-14T17:49:09.469034] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T17:49:09.787268] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-14T17:49:09.792418] [INFO ] [REMOTE ] EBS: Full fetch complete (51133 records). [2025-09-14T17:49:09.792579] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-09-14T17:49:10.164042] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-09-14T17:49:10.181365] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-09-14T17:49:10.181506] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-09-14T17:49:10.182384] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-09-14T17:49:10.182614] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-09-14T17:49:10.183891] [DEBUG] [LOCAL ] EBS: Trimmed 51133 records to 35421 (keeping 150 days of data) [2025-09-14T17:49:10.392123] [DEBUG] [LOCAL ] EBS: Primary data saved (35421 records). [2025-09-14T17:49:10.392302] [INFO ] [MAIN ] EBS: Full history saved. [2025-09-14T17:49:10.392404] [INFO ] [MAIN ] Update Progress: 681/2370 symbols completed. EBS took 21.7s. Estimated remaining: 2h 58m 31s. Rate: 9.5 symbols/min [2025-09-14T17:49:10.571175] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:49:10.591712] [DEBUG] [LOCAL ] ECC: Loaded 19237 existing records from primary storage. [2025-09-14T17:49:10.591877] [INFO ] [MAIN ] ECC: Loaded 19237 existing records. [2025-09-14T17:49:10.768108] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:49:10.768544] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-09-14T17:49:10.768662] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-09-14T17:49:10.769300] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-09-14T17:49:10.769490] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-09-14T17:49:10.922028] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-14T17:49:10.978057] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-09-14T17:49:11.169144] [INFO ] [REMOTE ] ECC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:49:11.758856] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-09-14T17:49:11.842656] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-14T17:49:11.847796] [INFO ] [REMOTE ] EC: Full fetch complete (54027 records). [2025-09-14T17:49:11.847921] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-09-14T17:49:12.156613] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-14T17:49:12.181345] [INFO ] [REMOTE ] ECAT: Full fetch complete (32210 records). [2025-09-14T17:49:12.191732] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-09-14T17:49:12.364701] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-09-14T17:49:12.364855] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-09-14T17:49:12.365985] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-09-14T17:49:12.376549] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-09-14T17:49:12.427135] [DEBUG] [LOCAL ] EC: Trimmed 54027 records to 36834 (keeping 150 days of data) [2025-09-14T17:49:12.579596] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-09-14T17:49:12.778235] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-09-14T17:49:12.787425] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-09-14T17:49:12.788799] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-09-14T17:49:12.838120] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-09-14T17:49:12.864215] [DEBUG] [LOCAL ] ECAT: Trimmed 32210 records to 21834 (keeping 150 days of data) [2025-09-14T17:49:13.029151] [DEBUG] [LOCAL ] ECAT: Primary data saved (21834 records). [2025-09-14T17:49:13.035392] [INFO ] [MAIN ] ECAT: Full history saved. [2025-09-14T17:49:13.035929] [INFO ] [MAIN ] Update Progress: 682/2370 symbols completed. ECAT took 24.3s. Estimated remaining: 2h 58m 16s. Rate: 9.5 symbols/min [2025-09-14T17:49:13.043050] [DEBUG] [LOCAL ] EC: Primary data saved (36834 records). [2025-09-14T17:49:13.088579] [INFO ] [MAIN ] EC: Full history saved. [2025-09-14T17:49:13.117746] [INFO ] [MAIN ] Update Progress: 683/2370 symbols completed. EC took 24.4s. Estimated remaining: 2h 57m 54s. Rate: 9.5 symbols/min [2025-09-14T17:49:13.347782] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:49:13.426297] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:49:13.429485] [DEBUG] [LOCAL ] ECCC: Loaded 278 existing records from primary storage. [2025-09-14T17:49:13.430282] [INFO ] [MAIN ] ECCC: Loaded 278 existing records. [2025-09-14T17:49:13.492870] [DEBUG] [LOCAL ] ECCU: Loaded 965 existing records from primary storage. [2025-09-14T17:49:13.519847] [INFO ] [MAIN ] ECCU: Loaded 965 existing records. [2025-09-14T17:49:13.753262] [WARN ] [MAIN ] ECCC: Insufficient historical data. Have data from 2025-06-17, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:49:13.795122] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-09-14T17:49:13.822541] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-14T17:49:13.842426] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-14T17:49:13.863515] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:49:13.879895] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-09-14T17:49:13.879357] [DEBUG] [LOCAL ] ECCC: Deleted primary data file. [2025-09-14T17:49:13.880359] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-14T17:49:13.881277] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-09-14T17:49:13.893516] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-09-14T17:49:13.894350] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-09-14T17:49:13.894128] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-09-14T17:49:14.588342] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:49:14.657287] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-09-14T17:49:14.656558] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:49:14.682290] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-14T17:49:14.958872] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-09-14T17:49:15.051205] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-14T17:49:15.223250] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-14T17:49:15.228058] [INFO ] [REMOTE ] EBR: Full fetch complete (46377 records). [2025-09-14T17:49:15.228180] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-09-14T17:49:15.649707] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-09-14T17:49:15.649867] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-09-14T17:49:15.650804] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-09-14T17:49:15.650873] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-09-14T17:49:15.652154] [DEBUG] [LOCAL ] EBR: Trimmed 46377 records to 31998 (keeping 150 days of data) [2025-09-14T17:49:15.759124] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-09-14T17:49:15.882685] [DEBUG] [LOCAL ] EBR: Primary data saved (31998 records). [2025-09-14T17:49:15.883000] [INFO ] [MAIN ] EBR: Full history saved. [2025-09-14T17:49:15.883161] [INFO ] [MAIN ] Update Progress: 684/2370 symbols completed. EBR took 27.2s. Estimated remaining: 2h 57m 39s. Rate: 9.5 symbols/min [2025-09-14T17:49:16.170301] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:49:16.174251] [DEBUG] [LOCAL ] ECCW: Loaded 505 existing records from primary storage. [2025-09-14T17:49:16.174474] [INFO ] [MAIN ] ECCW: Loaded 505 existing records. [2025-09-14T17:49:16.212894] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-14T17:49:16.470882] [WARN ] [MAIN ] ECCW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:49:16.471518] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-09-14T17:49:16.471634] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-14T17:49:16.472019] [DEBUG] [LOCAL ] ECCW: Deleted primary data file. [2025-09-14T17:49:16.472127] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-09-14T17:49:16.564102] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-09-14T17:49:16.921611] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:49:16.953662] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-14T17:49:17.027040] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-14T17:49:17.358860] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-09-14T17:49:18.158869] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-09-14T17:49:18.778628] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-14T17:49:18.958875] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-09-14T17:49:19.143273] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-14T17:49:19.374524] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-14T17:49:19.758829] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-09-14T17:49:20.405246] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-14T17:49:20.558826] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-09-14T17:49:21.021594] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-14T17:49:21.358824] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-09-14T17:49:21.722517] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-14T17:49:22.158828] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-09-14T17:49:22.700942] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-14T17:49:22.958812] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-09-14T17:49:23.395300] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-14T17:49:23.758816] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-09-14T17:49:24.280871] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-14T17:49:24.558842] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-09-14T17:49:24.931014] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-14T17:49:25.358827] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-09-14T17:49:25.838122] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-14T17:49:26.158840] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-09-14T17:49:26.726251] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-14T17:49:26.958843] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-09-14T17:49:27.313808] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-14T17:49:27.758835] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-14T17:49:28.143990] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T17:49:28.144806] [INFO ] [REMOTE ] ECCU: Full fetch complete (3160 records). [2025-09-14T17:49:28.144898] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-09-14T17:49:28.493728] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-09-14T17:49:28.493831] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-09-14T17:49:28.493956] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-09-14T17:49:28.494008] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-09-14T17:49:28.494421] [DEBUG] [LOCAL ] ECCU: Trimmed 3160 records to 1685 (keeping 150 days of data) [2025-09-14T17:49:28.505398] [DEBUG] [LOCAL ] ECCU: Primary data saved (1685 records). [2025-09-14T17:49:28.505490] [INFO ] [MAIN ] ECCU: Full history saved. [2025-09-14T17:49:28.505587] [INFO ] [MAIN ] Update Progress: 685/2370 symbols completed. ECCU took 15.4s. Estimated remaining: 2h 57m 48s. Rate: 9.5 symbols/min [2025-09-14T17:49:28.566636] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-09-14T17:49:28.681447] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:49:28.683857] [DEBUG] [LOCAL ] ECCX: Loaded 463 existing records from primary storage. [2025-09-14T17:49:28.683948] [INFO ] [MAIN ] ECCX: Loaded 463 existing records. [2025-09-14T17:49:28.856932] [WARN ] [MAIN ] ECCX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:49:28.857202] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-09-14T17:49:28.857278] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-14T17:49:28.857508] [DEBUG] [LOCAL ] ECCX: Deleted primary data file. [2025-09-14T17:49:28.857571] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-09-14T17:49:29.106766] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-14T17:49:29.208541] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:49:29.358833] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-09-14T17:49:29.723590] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-14T17:49:30.158861] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-09-14T17:49:30.538710] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-14T17:49:30.958840] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-09-14T17:49:31.475844] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-14T17:49:31.758866] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-09-14T17:49:32.273958] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-14T17:49:32.558862] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-09-14T17:49:33.358935] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-09-14T17:49:33.818010] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-14T17:49:34.158844] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-09-14T17:49:34.228013] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-14T17:49:34.618364] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-14T17:49:34.958830] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-09-14T17:49:35.356008] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-14T17:49:35.758842] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-14T17:49:36.064546] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T17:49:36.065337] [INFO ] [REMOTE ] ECCC: Full fetch complete (946 records). [2025-09-14T17:49:36.065424] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-09-14T17:49:36.240099] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-14T17:49:36.240309] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:49:36.240361] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:49:36.240409] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-14T17:49:36.240474] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-14T17:49:36.240520] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-09-14T17:49:36.240587] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-09-14T17:49:36.240681] [INFO ] [MAIN ] Update Progress: 686/2370 symbols completed. ECCC took 23.2s. Estimated remaining: 2h 57m 45s. Rate: 9.5 symbols/min [2025-09-14T17:49:36.436858] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:49:36.451881] [DEBUG] [LOCAL ] ECG: Loaded 14015 existing records from primary storage. [2025-09-14T17:49:36.452030] [INFO ] [MAIN ] ECG: Loaded 14015 existing records. [2025-09-14T17:49:36.564041] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-09-14T17:49:36.633128] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:49:36.633407] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-09-14T17:49:36.633468] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-09-14T17:49:36.634078] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-09-14T17:49:36.634142] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-09-14T17:49:36.984481] [INFO ] [REMOTE ] ECG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:49:37.074508] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-14T17:49:37.358897] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-09-14T17:49:38.158897] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-09-14T17:49:38.673560] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-14T17:49:38.958869] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-09-14T17:49:39.663290] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T17:49:39.758784] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-09-14T17:49:40.514963] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T17:49:40.558772] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-09-14T17:49:41.358870] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-09-14T17:49:41.516206] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T17:49:41.680026] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-14T17:49:42.082003] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-14T17:49:42.158845] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-09-14T17:49:42.559732] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-14T17:49:42.958864] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-09-14T17:49:43.758857] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-14T17:49:44.133614] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-14T17:49:44.134529] [INFO ] [REMOTE ] ECCW: Full fetch complete (1177 records). [2025-09-14T17:49:44.134614] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-09-14T17:49:44.324250] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 143 unique days, need 150 days [2025-09-14T17:49:44.324571] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:49:44.324690] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:49:44.324823] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-14T17:49:44.325002] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-14T17:49:44.325145] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-14T17:49:44.325301] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-09-14T17:49:44.325528] [INFO ] [MAIN ] Update Progress: 687/2370 symbols completed. ECCW took 28.4s. Estimated remaining: 2h 57m 43s. Rate: 9.5 symbols/min [2025-09-14T17:49:44.500527] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:49:44.523922] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T17:49:44.551509] [DEBUG] [LOCAL ] ECL: Loaded 20439 existing records from primary storage. [2025-09-14T17:49:44.551694] [INFO ] [MAIN ] ECL: Loaded 20439 existing records. [2025-09-14T17:49:44.563911] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-09-14T17:49:44.727480] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:49:44.727775] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-09-14T17:49:44.727842] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-09-14T17:49:44.728490] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-09-14T17:49:44.728553] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-09-14T17:49:45.068635] [INFO ] [REMOTE ] ECL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:49:45.358842] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-09-14T17:49:45.795497] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-14T17:49:45.936066] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T17:49:46.158867] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-09-14T17:49:46.958880] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-09-14T17:49:47.358153] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-14T17:49:47.762597] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-09-14T17:49:47.767482] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T17:49:48.558837] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-14T17:49:48.959107] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-14T17:49:48.959962] [INFO ] [REMOTE ] ECCX: Full fetch complete (1148 records). [2025-09-14T17:49:48.960044] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-09-14T17:49:49.141049] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-14T17:49:49.141277] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:49:49.141413] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:49:49.141523] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-14T17:49:49.141613] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-14T17:49:49.141693] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-14T17:49:49.141791] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-09-14T17:49:49.141890] [INFO ] [MAIN ] Update Progress: 688/2370 symbols completed. ECCX took 20.6s. Estimated remaining: 2h 57m 33s. Rate: 9.5 symbols/min [2025-09-14T17:49:49.274401] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-14T17:49:49.335073] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:49:49.344240] [DEBUG] [LOCAL ] ECO: Loaded 7702 existing records from primary storage. [2025-09-14T17:49:49.344374] [INFO ] [MAIN ] ECO: Loaded 7702 existing records. [2025-09-14T17:49:49.364577] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-09-14T17:49:49.523865] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:49:49.524108] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-09-14T17:49:49.524167] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-09-14T17:49:49.524511] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-09-14T17:49:49.524567] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-09-14T17:49:49.903744] [INFO ] [REMOTE ] ECO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:49:50.158868] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-09-14T17:49:50.958830] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-09-14T17:49:51.170615] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T17:49:51.247433] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T17:49:51.758853] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-09-14T17:49:52.434077] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-14T17:49:52.438903] [INFO ] [REMOTE ] ECC: Full fetch complete (46662 records). [2025-09-14T17:49:52.439041] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-09-14T17:49:52.563922] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-09-14T17:49:52.835877] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-09-14T17:49:52.836020] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-09-14T17:49:52.836795] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-09-14T17:49:52.836873] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-09-14T17:49:52.850009] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T17:49:52.854670] [DEBUG] [LOCAL ] ECC: Trimmed 46662 records to 32304 (keeping 150 days of data) [2025-09-14T17:49:53.063339] [DEBUG] [LOCAL ] ECC: Primary data saved (32304 records). [2025-09-14T17:49:53.063581] [INFO ] [MAIN ] ECC: Full history saved. [2025-09-14T17:49:53.063733] [INFO ] [MAIN ] Update Progress: 689/2370 symbols completed. ECC took 42.7s. Estimated remaining: 2h 57m 21s. Rate: 9.5 symbols/min [2025-09-14T17:49:53.248249] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:49:53.273245] [DEBUG] [LOCAL ] ECVT: Loaded 19414 existing records from primary storage. [2025-09-14T17:49:53.273491] [INFO ] [MAIN ] ECVT: Loaded 19414 existing records. [2025-09-14T17:49:53.364061] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-09-14T17:49:53.466517] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:49:53.466844] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-09-14T17:49:53.466911] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-09-14T17:49:53.467533] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-09-14T17:49:53.467613] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-09-14T17:49:53.829113] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:49:54.158881] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-09-14T17:49:54.485758] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T17:49:54.536088] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T17:49:54.549748] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T17:49:54.553477] [INFO ] [REMOTE ] ECG: Full fetch complete (39074 records). [2025-09-14T17:49:54.553633] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-09-14T17:49:54.966358] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-09-14T17:49:54.965411] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-09-14T17:49:54.967436] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-09-14T17:49:54.968410] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-09-14T17:49:54.968487] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-09-14T17:49:54.969926] [DEBUG] [LOCAL ] ECG: Trimmed 39074 records to 24863 (keeping 150 days of data) [2025-09-14T17:49:55.115659] [DEBUG] [LOCAL ] ECG: Primary data saved (24863 records). [2025-09-14T17:49:55.115827] [INFO ] [MAIN ] ECG: Full history saved. [2025-09-14T17:49:55.115939] [INFO ] [MAIN ] Update Progress: 690/2370 symbols completed. ECG took 18.9s. Estimated remaining: 2h 57m 4s. Rate: 9.5 symbols/min [2025-09-14T17:49:55.283910] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:49:55.306926] [DEBUG] [LOCAL ] ED: Loaded 23576 existing records from primary storage. [2025-09-14T17:49:55.307097] [INFO ] [MAIN ] ED: Loaded 23576 existing records. [2025-09-14T17:49:55.482714] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:49:55.482969] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-09-14T17:49:55.483028] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-09-14T17:49:55.483816] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-09-14T17:49:55.483883] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-09-14T17:49:55.764080] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-09-14T17:49:55.857960] [INFO ] [REMOTE ] ED: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:49:56.559081] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-09-14T17:49:56.950224] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T17:49:56.987431] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-14T17:49:57.358860] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-09-14T17:49:57.612633] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T17:49:58.158918] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-09-14T17:49:58.958823] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-09-14T17:49:59.105501] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T17:49:59.715866] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T17:49:59.758780] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-09-14T17:49:59.776614] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T17:50:00.558857] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-09-14T17:50:01.012452] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-14T17:50:01.358859] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-09-14T17:50:02.075779] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T17:50:02.158884] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-09-14T17:50:02.964133] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-09-14T17:50:02.979476] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-14T17:50:03.238019] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-14T17:50:03.758836] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-09-14T17:50:04.558851] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-09-14T17:50:04.807577] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T17:50:04.929038] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-14T17:50:05.358879] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-09-14T17:50:05.854782] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-14T17:50:06.091428] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T17:50:06.093570] [INFO ] [REMOTE ] ECO: Full fetch complete (20577 records). [2025-09-14T17:50:06.093679] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-09-14T17:50:06.163918] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-09-14T17:50:06.476147] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-09-14T17:50:06.476287] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-09-14T17:50:06.476853] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-09-14T17:50:06.476924] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-09-14T17:50:06.478046] [DEBUG] [LOCAL ] ECO: Trimmed 20577 records to 13176 (keeping 150 days of data) [2025-09-14T17:50:06.563926] [DEBUG] [LOCAL ] ECO: Primary data saved (13176 records). [2025-09-14T17:50:06.564138] [INFO ] [MAIN ] ECO: Full history saved. [2025-09-14T17:50:06.564352] [INFO ] [MAIN ] Update Progress: 691/2370 symbols completed. ECO took 17.4s. Estimated remaining: 2h 57m 10s. Rate: 9.5 symbols/min [2025-09-14T17:50:06.736862] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:50:06.750776] [DEBUG] [LOCAL ] EDD: Loaded 13013 existing records from primary storage. [2025-09-14T17:50:06.750933] [INFO ] [MAIN ] EDD: Loaded 13013 existing records. [2025-09-14T17:50:06.924962] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:50:06.925210] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-09-14T17:50:06.925271] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-09-14T17:50:06.925723] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-09-14T17:50:06.925798] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-09-14T17:50:06.967721] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-09-14T17:50:07.281198] [INFO ] [REMOTE ] EDD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:50:07.758833] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-09-14T17:50:07.902996] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T17:50:08.558975] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-09-14T17:50:08.708439] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T17:50:08.760261] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-14T17:50:09.358916] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-09-14T17:50:10.127724] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-14T17:50:10.158792] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-09-14T17:50:10.958825] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-09-14T17:50:11.338178] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-14T17:50:11.758886] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-09-14T17:50:11.861559] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T17:50:11.923704] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-14T17:50:12.558833] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-09-14T17:50:13.358852] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-09-14T17:50:13.790301] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-14T17:50:13.818148] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-14T17:50:14.158832] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-09-14T17:50:14.876926] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-14T17:50:14.958807] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-09-14T17:50:15.393991] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-14T17:50:15.758842] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-09-14T17:50:15.941802] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T17:50:15.946537] [INFO ] [REMOTE ] ECVT: Full fetch complete (46167 records). [2025-09-14T17:50:15.946706] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-09-14T17:50:16.326033] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-09-14T17:50:16.326142] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-09-14T17:50:16.326823] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-09-14T17:50:16.326879] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-09-14T17:50:16.327906] [DEBUG] [LOCAL ] ECVT: Trimmed 46167 records to 32268 (keeping 150 days of data) [2025-09-14T17:50:16.525274] [DEBUG] [LOCAL ] ECVT: Primary data saved (32268 records). [2025-09-14T17:50:16.525511] [INFO ] [MAIN ] ECVT: Full history saved. [2025-09-14T17:50:16.525685] [INFO ] [MAIN ] Update Progress: 692/2370 symbols completed. ECVT took 23.5s. Estimated remaining: 2h 57m 13s. Rate: 9.5 symbols/min [2025-09-14T17:50:16.563924] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-09-14T17:50:16.703979] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:50:16.710973] [DEBUG] [LOCAL ] EDF: Loaded 5276 existing records from primary storage. [2025-09-14T17:50:16.711168] [INFO ] [MAIN ] EDF: Loaded 5276 existing records. [2025-09-14T17:50:16.887933] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:50:16.888196] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-09-14T17:50:16.888255] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-09-14T17:50:16.888552] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-09-14T17:50:16.888618] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-09-14T17:50:17.260060] [INFO ] [REMOTE ] EDF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:50:17.274777] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:50:17.280456] [INFO ] [REMOTE ] ECL: Full fetch complete (50910 records). [2025-09-14T17:50:17.280621] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-09-14T17:50:17.365743] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-09-14T17:50:17.687169] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-09-14T17:50:17.687495] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-09-14T17:50:17.688914] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-09-14T17:50:17.689286] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-09-14T17:50:17.692184] [DEBUG] [LOCAL ] ECL: Trimmed 50910 records to 34722 (keeping 150 days of data) [2025-09-14T17:50:17.841135] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-14T17:50:17.988468] [DEBUG] [LOCAL ] ECL: Primary data saved (34722 records). [2025-09-14T17:50:17.988677] [INFO ] [MAIN ] ECL: Full history saved. [2025-09-14T17:50:17.988797] [INFO ] [MAIN ] Update Progress: 693/2370 symbols completed. ECL took 33.7s. Estimated remaining: 2h 56m 54s. Rate: 9.5 symbols/min [2025-09-14T17:50:18.159512] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-09-14T17:50:18.161804] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:50:18.173531] [DEBUG] [LOCAL ] EDN: Loaded 7851 existing records from primary storage. [2025-09-14T17:50:18.173747] [INFO ] [MAIN ] EDN: Loaded 7851 existing records. [2025-09-14T17:50:18.371075] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:50:18.382351] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-09-14T17:50:18.383004] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-09-14T17:50:18.383429] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T17:50:18.387986] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-09-14T17:50:18.388762] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-09-14T17:50:18.746017] [INFO ] [REMOTE ] EDN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:50:18.958814] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-09-14T17:50:19.759007] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-09-14T17:50:20.041986] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-14T17:50:20.117422] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-14T17:50:20.558834] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-09-14T17:50:20.596028] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-14T17:50:21.358862] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-09-14T17:50:22.158866] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-09-14T17:50:22.379291] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-14T17:50:22.443488] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T17:50:22.915773] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-14T17:50:22.958792] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-09-14T17:50:23.758825] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-09-14T17:50:24.004855] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-14T17:50:24.558846] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-09-14T17:50:24.756114] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-14T17:50:25.358788] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-09-14T17:50:25.738581] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-14T17:50:26.158841] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-09-14T17:50:26.830503] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-14T17:50:26.958876] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-09-14T17:50:27.194017] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T17:50:27.758878] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-09-14T17:50:28.073478] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-14T17:50:28.558829] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-09-14T17:50:29.237617] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T17:50:29.258692] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-14T17:50:29.358846] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-09-14T17:50:30.158838] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-09-14T17:50:30.261782] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T17:50:30.837554] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-14T17:50:30.958807] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-09-14T17:50:31.758804] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-09-14T17:50:31.952320] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T17:50:32.558787] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-09-14T17:50:32.941979] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-14T17:50:33.358816] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-09-14T17:50:33.640330] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-14T17:50:33.643984] [INFO ] [REMOTE ] EDD: Full fetch complete (29727 records). [2025-09-14T17:50:33.644122] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-09-14T17:50:34.011085] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-09-14T17:50:34.011190] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-09-14T17:50:34.011839] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-09-14T17:50:34.011920] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-09-14T17:50:34.012740] [DEBUG] [LOCAL ] EDD: Trimmed 29727 records to 20453 (keeping 150 days of data) [2025-09-14T17:50:34.132935] [DEBUG] [LOCAL ] EDD: Primary data saved (20453 records). [2025-09-14T17:50:34.133098] [INFO ] [MAIN ] EDD: Full history saved. [2025-09-14T17:50:34.133214] [INFO ] [MAIN ] Update Progress: 694/2370 symbols completed. EDD took 27.6s. Estimated remaining: 2h 57m 12s. Rate: 9.5 symbols/min [2025-09-14T17:50:34.164008] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-09-14T17:50:34.307297] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:50:34.326724] [DEBUG] [LOCAL ] EDU: Loaded 19969 existing records from primary storage. [2025-09-14T17:50:34.326929] [INFO ] [MAIN ] EDU: Loaded 19969 existing records. [2025-09-14T17:50:34.506525] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:50:34.506867] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-09-14T17:50:34.507102] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-09-14T17:50:34.513353] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-09-14T17:50:34.520824] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T17:50:34.520203] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-09-14T17:50:34.874249] [INFO ] [REMOTE ] EDU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:50:34.907290] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T17:50:34.912900] [INFO ] [REMOTE ] ED: Full fetch complete (57401 records). [2025-09-14T17:50:34.913087] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-09-14T17:50:34.966269] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-09-14T17:50:35.298142] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-09-14T17:50:35.298267] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-09-14T17:50:35.299190] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-09-14T17:50:35.299253] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-09-14T17:50:35.300816] [DEBUG] [LOCAL ] ED: Trimmed 57401 records to 39716 (keeping 150 days of data) [2025-09-14T17:50:35.572257] [DEBUG] [LOCAL ] ED: Primary data saved (39716 records). [2025-09-14T17:50:35.572456] [INFO ] [MAIN ] ED: Full history saved. [2025-09-14T17:50:35.572591] [INFO ] [MAIN ] Update Progress: 695/2370 symbols completed. ED took 40.5s. Estimated remaining: 2h 56m 54s. Rate: 9.5 symbols/min [2025-09-14T17:50:35.776322] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-09-14T17:50:35.779060] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:50:35.797919] [DEBUG] [LOCAL ] EE: Loaded 14896 existing records from primary storage. [2025-09-14T17:50:35.798095] [INFO ] [MAIN ] EE: Loaded 14896 existing records. [2025-09-14T17:50:35.988573] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:50:35.988889] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-09-14T17:50:35.988952] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-14T17:50:35.989484] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-09-14T17:50:35.989555] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-09-14T17:50:36.341133] [INFO ] [REMOTE ] EE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:50:36.558802] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-09-14T17:50:36.647588] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T17:50:36.650417] [INFO ] [REMOTE ] EDN: Full fetch complete (19755 records). [2025-09-14T17:50:36.650523] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-09-14T17:50:37.019414] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-09-14T17:50:37.019663] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-09-14T17:50:37.020115] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-09-14T17:50:37.020203] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-09-14T17:50:37.021102] [DEBUG] [LOCAL ] EDN: Trimmed 19755 records to 13165 (keeping 150 days of data) [2025-09-14T17:50:37.108517] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-14T17:50:37.130973] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T17:50:37.143065] [DEBUG] [LOCAL ] EDN: Primary data saved (13165 records). [2025-09-14T17:50:37.145106] [INFO ] [MAIN ] EDN: Full history saved. [2025-09-14T17:50:37.145224] [INFO ] [MAIN ] Update Progress: 696/2370 symbols completed. EDN took 19.2s. Estimated remaining: 2h 56m 36s. Rate: 9.5 symbols/min [2025-09-14T17:50:37.188735] [INFO ] [REMOTE ] EDF: Full fetch complete (15198 records). [2025-09-14T17:50:37.225390] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-09-14T17:50:37.363880] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-09-14T17:50:37.420328] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:50:37.487195] [DEBUG] [LOCAL ] EEA: Loaded 1247 existing records from primary storage. [2025-09-14T17:50:37.511598] [INFO ] [MAIN ] EEA: Loaded 1247 existing records. [2025-09-14T17:50:37.867346] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-09-14T17:50:37.871804] [WARN ] [MAIN ] EEA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:50:37.871960] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-09-14T17:50:37.872387] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-09-14T17:50:37.872587] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-09-14T17:50:37.872626] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-09-14T17:50:37.872853] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-14T17:50:37.873413] [DEBUG] [LOCAL ] EDF: Trimmed 15198 records to 9711 (keeping 150 days of data) [2025-09-14T17:50:37.873463] [DEBUG] [LOCAL ] EEA: Deleted primary data file. [2025-09-14T17:50:37.873596] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-09-14T17:50:38.168933] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-09-14T17:50:38.306000] [INFO ] [REMOTE ] EEA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:50:38.313233] [DEBUG] [LOCAL ] EDF: Primary data saved (9711 records). [2025-09-14T17:50:38.313405] [INFO ] [MAIN ] EDF: Full history saved. [2025-09-14T17:50:38.313507] [INFO ] [MAIN ] Update Progress: 697/2370 symbols completed. EDF took 21.8s. Estimated remaining: 2h 56m 17s. Rate: 9.5 symbols/min [2025-09-14T17:50:38.485060] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:50:38.490406] [DEBUG] [LOCAL ] EEX: Loaded 3564 existing records from primary storage. [2025-09-14T17:50:38.490537] [INFO ] [MAIN ] EEX: Loaded 3564 existing records. [2025-09-14T17:50:38.680196] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:50:38.680466] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-09-14T17:50:38.680527] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-09-14T17:50:38.680888] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-09-14T17:50:38.680968] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-09-14T17:50:38.963887] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-09-14T17:50:39.038025] [INFO ] [REMOTE ] EEX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:50:39.225411] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T17:50:39.315354] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-14T17:50:39.503912] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-14T17:50:39.758865] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-09-14T17:50:40.558871] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-09-14T17:50:40.570884] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-14T17:50:41.188763] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-14T17:50:41.358843] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-09-14T17:50:42.158894] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-09-14T17:50:42.679677] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-14T17:50:42.958822] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-09-14T17:50:43.603567] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-14T17:50:43.680298] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-14T17:50:43.758850] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-09-14T17:50:44.558899] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-09-14T17:50:44.926258] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-14T17:50:45.364737] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-09-14T17:50:45.366553] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T17:50:45.874190] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-14T17:50:46.158847] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-09-14T17:50:46.958833] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-09-14T17:50:47.485329] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-14T17:50:47.747265] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T17:50:47.758771] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-09-14T17:50:48.239429] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-14T17:50:48.558846] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-09-14T17:50:49.358837] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-09-14T17:50:49.936175] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-14T17:50:50.158885] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-09-14T17:50:50.958797] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-14T17:50:51.047259] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T17:50:51.389834] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T17:50:51.390685] [INFO ] [REMOTE ] EEA: Full fetch complete (3063 records). [2025-09-14T17:50:51.390766] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-09-14T17:50:51.767428] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-09-14T17:50:51.749884] [DEBUG] [VALIDATOR ] EEA: All expected trading days are present. [2025-09-14T17:50:51.769147] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T17:50:51.769263] [DEBUG] [VALIDATOR ] EEA: Primary data validation passed. [2025-09-14T17:50:51.777569] [INFO ] [MAIN ] EEA: Fetched primary data is valid. [2025-09-14T17:50:51.777684] [DEBUG] [LOCAL ] EEA: Saving primary data. [2025-09-14T17:50:51.778580] [DEBUG] [LOCAL ] EEA: Trimmed 3063 records to 2030 (keeping 150 days of data) [2025-09-14T17:50:51.791824] [DEBUG] [LOCAL ] EEA: Primary data saved (2030 records). [2025-09-14T17:50:51.792005] [INFO ] [MAIN ] EEA: Full history saved. [2025-09-14T17:50:51.792117] [INFO ] [MAIN ] Update Progress: 698/2370 symbols completed. EEA took 14.6s. Estimated remaining: 2h 56m 28s. Rate: 9.5 symbols/min [2025-09-14T17:50:51.972529] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:50:51.993423] [DEBUG] [LOCAL ] EFC: Loaded 20603 existing records from primary storage. [2025-09-14T17:50:51.993592] [INFO ] [MAIN ] EFC: Loaded 20603 existing records. [2025-09-14T17:50:52.176347] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:50:52.176632] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-09-14T17:50:52.176704] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-09-14T17:50:52.177435] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-09-14T17:50:52.177498] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-09-14T17:50:52.543328] [INFO ] [REMOTE ] EFC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:50:52.558783] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-09-14T17:50:53.358878] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-09-14T17:50:53.667700] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-14T17:50:54.104760] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-14T17:50:54.158867] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-09-14T17:50:54.242367] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T17:50:54.868250] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-14T17:50:54.958791] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-09-14T17:50:55.758828] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-09-14T17:50:55.829075] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T17:50:56.558825] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-09-14T17:50:57.358854] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-09-14T17:50:57.566142] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T17:50:57.971532] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-14T17:50:58.158974] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-09-14T17:50:58.771909] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-14T17:50:58.958833] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-09-14T17:50:59.049360] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-14T17:50:59.758881] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-09-14T17:51:00.443727] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-14T17:51:00.558834] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-09-14T17:51:01.161963] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-14T17:51:01.168471] [INFO ] [REMOTE ] EDU: Full fetch complete (49945 records). [2025-09-14T17:51:01.168727] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-09-14T17:51:01.364087] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-09-14T17:51:01.771925] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-09-14T17:51:01.772104] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-09-14T17:51:01.773235] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-09-14T17:51:01.773317] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-09-14T17:51:01.774894] [DEBUG] [LOCAL ] EDU: Trimmed 49945 records to 33261 (keeping 150 days of data) [2025-09-14T17:51:02.056052] [DEBUG] [LOCAL ] EDU: Primary data saved (33261 records). [2025-09-14T17:51:02.056285] [INFO ] [MAIN ] EDU: Full history saved. [2025-09-14T17:51:02.056424] [INFO ] [MAIN ] Update Progress: 699/2370 symbols completed. EDU took 27.9s. Estimated remaining: 2h 56m 31s. Rate: 9.5 symbols/min [2025-09-14T17:51:02.164034] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-09-14T17:51:02.304809] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:51:02.314267] [DEBUG] [LOCAL ] EFR: Loaded 6770 existing records from primary storage. [2025-09-14T17:51:02.314449] [INFO ] [MAIN ] EFR: Loaded 6770 existing records. [2025-09-14T17:51:02.510075] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:51:02.510372] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-09-14T17:51:02.510450] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-14T17:51:02.510928] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-09-14T17:51:02.511024] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-09-14T17:51:02.866433] [INFO ] [REMOTE ] EFR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:51:02.963901] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-09-14T17:51:02.978843] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-14T17:51:03.580863] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-14T17:51:03.584852] [INFO ] [REMOTE ] EE: Full fetch complete (34453 records). [2025-09-14T17:51:03.585047] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-09-14T17:51:03.767878] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-09-14T17:51:03.993432] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-09-14T17:51:03.993601] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-09-14T17:51:03.994850] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-09-14T17:51:03.994923] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-09-14T17:51:03.996474] [DEBUG] [LOCAL ] EE: Trimmed 34453 records to 24503 (keeping 150 days of data) [2025-09-14T17:51:04.145202] [DEBUG] [LOCAL ] EE: Primary data saved (24503 records). [2025-09-14T17:51:04.145395] [INFO ] [MAIN ] EE: Full history saved. [2025-09-14T17:51:04.145621] [INFO ] [MAIN ] Update Progress: 700/2370 symbols completed. EE took 28.6s. Estimated remaining: 2h 56m 15s. Rate: 9.5 symbols/min [2025-09-14T17:51:04.313464] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:51:04.321836] [DEBUG] [LOCAL ] EFT: Loaded 5289 existing records from primary storage. [2025-09-14T17:51:04.321989] [INFO ] [MAIN ] EFT: Loaded 5289 existing records. [2025-09-14T17:51:04.494672] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:51:04.494999] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-09-14T17:51:04.495061] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-14T17:51:04.495389] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-09-14T17:51:04.495472] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-09-14T17:51:04.685763] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-14T17:51:04.704784] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-09-14T17:51:04.791594] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-09-14T17:51:04.872949] [INFO ] [REMOTE ] EFT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:51:05.358781] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-09-14T17:51:05.687096] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-14T17:51:05.847804] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-14T17:51:05.858729] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-14T17:51:06.158862] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-09-14T17:51:06.958821] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-09-14T17:51:07.668352] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T17:51:07.758839] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-09-14T17:51:07.844781] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T17:51:08.558855] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-09-14T17:51:08.844364] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T17:51:09.358844] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-09-14T17:51:09.583917] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-14T17:51:09.981453] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-14T17:51:10.158828] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-09-14T17:51:10.958826] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-09-14T17:51:11.758809] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-09-14T17:51:11.949008] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T17:51:12.012235] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-14T17:51:12.458870] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T17:51:12.460296] [INFO ] [REMOTE ] EEX: Full fetch complete (13802 records). [2025-09-14T17:51:12.460392] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-09-14T17:51:12.560265] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-09-14T17:51:12.817763] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-09-14T17:51:12.817877] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-09-14T17:51:12.818225] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-09-14T17:51:12.818296] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-09-14T17:51:12.818859] [DEBUG] [LOCAL ] EEX: Trimmed 13802 records to 7466 (keeping 150 days of data) [2025-09-14T17:51:12.862166] [DEBUG] [LOCAL ] EEX: Primary data saved (7466 records). [2025-09-14T17:51:12.862307] [INFO ] [MAIN ] EEX: Full history saved. [2025-09-14T17:51:12.862425] [INFO ] [MAIN ] Update Progress: 701/2370 symbols completed. EEX took 34.5s. Estimated remaining: 2h 56m 14s. Rate: 9.5 symbols/min [2025-09-14T17:51:13.029547] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:51:13.050152] [DEBUG] [LOCAL ] EFX: Loaded 19847 existing records from primary storage. [2025-09-14T17:51:13.050320] [INFO ] [MAIN ] EFX: Loaded 19847 existing records. [2025-09-14T17:51:13.232494] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:51:13.232965] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-09-14T17:51:13.233057] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-09-14T17:51:13.233832] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-09-14T17:51:13.233920] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-09-14T17:51:13.372787] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-09-14T17:51:13.589069] [INFO ] [REMOTE ] EFX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:51:14.158864] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-09-14T17:51:14.794907] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-14T17:51:14.958831] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-09-14T17:51:15.406368] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-14T17:51:15.758814] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-09-14T17:51:15.967259] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-14T17:51:15.981044] [INFO ] [REMOTE ] EFC: Full fetch complete (50080 records). [2025-09-14T17:51:15.995191] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-09-14T17:51:16.042356] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T17:51:16.393885] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-09-14T17:51:16.394062] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-09-14T17:51:16.394846] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-09-14T17:51:16.394916] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-09-14T17:51:16.404575] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-14T17:51:16.410346] [DEBUG] [LOCAL ] EFC: Trimmed 50080 records to 34360 (keeping 150 days of data) [2025-09-14T17:51:16.586521] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-09-14T17:51:16.638967] [DEBUG] [LOCAL ] EFC: Primary data saved (34360 records). [2025-09-14T17:51:16.639112] [INFO ] [MAIN ] EFC: Full history saved. [2025-09-14T17:51:16.639209] [INFO ] [MAIN ] Update Progress: 702/2370 symbols completed. EFC took 24.8s. Estimated remaining: 2h 56m 2s. Rate: 9.5 symbols/min [2025-09-14T17:51:16.809680] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:51:16.823695] [DEBUG] [LOCAL ] EFXT: Loaded 13067 existing records from primary storage. [2025-09-14T17:51:16.823889] [INFO ] [MAIN ] EFXT: Loaded 13067 existing records. [2025-09-14T17:51:16.997832] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:51:16.998098] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-09-14T17:51:16.998155] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-09-14T17:51:16.998636] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-09-14T17:51:16.998724] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-09-14T17:51:17.364553] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-09-14T17:51:17.369759] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:51:17.420495] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-14T17:51:18.158825] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-09-14T17:51:18.845352] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-14T17:51:18.958801] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-09-14T17:51:19.059584] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T17:51:19.705406] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T17:51:19.707322] [INFO ] [REMOTE ] EFT: Full fetch complete (13105 records). [2025-09-14T17:51:19.707408] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-09-14T17:51:19.768288] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-09-14T17:51:20.084941] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-09-14T17:51:20.085102] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-09-14T17:51:20.085734] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-09-14T17:51:20.085807] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-09-14T17:51:20.086897] [DEBUG] [LOCAL ] EFT: Trimmed 13105 records to 9263 (keeping 150 days of data) [2025-09-14T17:51:20.151766] [DEBUG] [LOCAL ] EFT: Primary data saved (9263 records). [2025-09-14T17:51:20.152047] [INFO ] [MAIN ] EFT: Full history saved. [2025-09-14T17:51:20.152194] [INFO ] [MAIN ] Update Progress: 703/2370 symbols completed. EFT took 16.0s. Estimated remaining: 2h 55m 48s. Rate: 9.5 symbols/min [2025-09-14T17:51:20.337663] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:51:20.352331] [DEBUG] [LOCAL ] EG: Loaded 11541 existing records from primary storage. [2025-09-14T17:51:20.352598] [INFO ] [MAIN ] EG: Loaded 11541 existing records. [2025-09-14T17:51:20.536252] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:51:20.536628] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-09-14T17:51:20.536748] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-09-14T17:51:20.537451] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-09-14T17:51:20.537523] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-09-14T17:51:20.568557] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-09-14T17:51:20.896460] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-14T17:51:20.981824] [INFO ] [REMOTE ] EG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:51:21.358866] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-09-14T17:51:21.744317] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T17:51:22.158886] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-09-14T17:51:22.392792] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-14T17:51:22.958808] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-09-14T17:51:23.432537] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-14T17:51:23.758876] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-09-14T17:51:23.997897] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-14T17:51:24.558838] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-09-14T17:51:25.363010] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-09-14T17:51:25.368361] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-14T17:51:26.158869] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-09-14T17:51:26.333978] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-14T17:51:26.861036] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-14T17:51:26.863122] [INFO ] [REMOTE ] EFR: Full fetch complete (14647 records). [2025-09-14T17:51:26.863218] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-09-14T17:51:26.963929] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-09-14T17:51:27.244623] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-09-14T17:51:27.244777] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-09-14T17:51:27.245228] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-09-14T17:51:27.245303] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-09-14T17:51:27.245986] [DEBUG] [LOCAL ] EFR: Trimmed 14647 records to 10568 (keeping 150 days of data) [2025-09-14T17:51:27.310039] [DEBUG] [LOCAL ] EFR: Primary data saved (10568 records). [2025-09-14T17:51:27.310227] [INFO ] [MAIN ] EFR: Full history saved. [2025-09-14T17:51:27.310353] [INFO ] [MAIN ] Update Progress: 704/2370 symbols completed. EFR took 25.3s. Estimated remaining: 2h 55m 44s. Rate: 9.5 symbols/min [2025-09-14T17:51:27.478905] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:51:27.500678] [DEBUG] [LOCAL ] EGO: Loaded 22922 existing records from primary storage. [2025-09-14T17:51:27.500853] [INFO ] [MAIN ] EGO: Loaded 22922 existing records. [2025-09-14T17:51:27.679035] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:51:27.679344] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-09-14T17:51:27.679439] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-14T17:51:27.680066] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-09-14T17:51:27.680144] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-09-14T17:51:27.764482] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-09-14T17:51:28.061253] [INFO ] [REMOTE ] EGO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:51:28.385417] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-14T17:51:28.492298] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-14T17:51:28.558786] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-09-14T17:51:28.740208] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-14T17:51:29.358833] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-09-14T17:51:30.158900] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-09-14T17:51:30.348078] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T17:51:30.441732] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T17:51:30.958872] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-09-14T17:51:31.758893] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-09-14T17:51:31.922496] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T17:51:32.406781] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-14T17:51:32.558881] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-09-14T17:51:32.749775] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T17:51:33.358861] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-09-14T17:51:34.158831] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-09-14T17:51:34.295247] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-14T17:51:34.711841] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T17:51:34.958867] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-09-14T17:51:35.074017] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-14T17:51:35.758859] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-09-14T17:51:36.558889] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-09-14T17:51:36.743774] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-14T17:51:36.949726] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-14T17:51:37.358905] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-09-14T17:51:38.158858] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-09-14T17:51:38.317383] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T17:51:38.548539] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-14T17:51:38.958886] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-09-14T17:51:39.758910] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-09-14T17:51:39.895306] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T17:51:40.371478] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T17:51:40.374579] [INFO ] [REMOTE ] EG: Full fetch complete (32162 records). [2025-09-14T17:51:40.374710] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-09-14T17:51:40.563556] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-09-14T17:51:40.750472] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-09-14T17:51:40.750597] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-09-14T17:51:40.751399] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-09-14T17:51:40.751597] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-09-14T17:51:40.752918] [DEBUG] [LOCAL ] EG: Trimmed 32162 records to 21242 (keeping 150 days of data) [2025-09-14T17:51:40.867874] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-14T17:51:40.918748] [DEBUG] [LOCAL ] EG: Primary data saved (21242 records). [2025-09-14T17:51:40.918907] [INFO ] [MAIN ] EG: Full history saved. [2025-09-14T17:51:40.919046] [INFO ] [MAIN ] Update Progress: 705/2370 symbols completed. EG took 20.8s. Estimated remaining: 2h 55m 55s. Rate: 9.5 symbols/min [2025-09-14T17:51:41.096303] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:51:41.113250] [DEBUG] [LOCAL ] EGP: Loaded 13823 existing records from primary storage. [2025-09-14T17:51:41.113427] [INFO ] [MAIN ] EGP: Loaded 13823 existing records. [2025-09-14T17:51:41.287196] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:51:41.287486] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-09-14T17:51:41.287561] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-14T17:51:41.288110] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-09-14T17:51:41.288173] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-09-14T17:51:41.364079] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-09-14T17:51:41.648264] [INFO ] [REMOTE ] EGP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:51:41.854282] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-14T17:51:41.859587] [INFO ] [REMOTE ] EFX: Full fetch complete (49050 records). [2025-09-14T17:51:41.859845] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-09-14T17:51:42.160019] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-09-14T17:51:42.222056] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-14T17:51:42.280114] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-09-14T17:51:42.280510] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-09-14T17:51:42.281498] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-09-14T17:51:42.281582] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-09-14T17:51:42.283562] [DEBUG] [LOCAL ] EFX: Trimmed 49050 records to 33339 (keeping 150 days of data) [2025-09-14T17:51:42.511449] [DEBUG] [LOCAL ] EFX: Primary data saved (33339 records). [2025-09-14T17:51:42.511733] [INFO ] [MAIN ] EFX: Full history saved. [2025-09-14T17:51:42.511863] [INFO ] [MAIN ] Update Progress: 706/2370 symbols completed. EFX took 29.6s. Estimated remaining: 2h 55m 37s. Rate: 9.5 symbols/min [2025-09-14T17:51:42.705406] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:51:42.723026] [DEBUG] [LOCAL ] EGY: Loaded 18092 existing records from primary storage. [2025-09-14T17:51:42.723234] [INFO ] [MAIN ] EGY: Loaded 18092 existing records. [2025-09-14T17:51:42.906405] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:51:42.906731] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-09-14T17:51:42.906795] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-09-14T17:51:42.907416] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-09-14T17:51:42.907493] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-09-14T17:51:42.970371] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-09-14T17:51:43.274170] [INFO ] [REMOTE ] EGY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:51:43.506103] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-14T17:51:43.758822] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-09-14T17:51:44.297039] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-14T17:51:44.558837] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-09-14T17:51:45.267598] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T17:51:45.358828] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-09-14T17:51:46.135365] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-14T17:51:46.158772] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-09-14T17:51:46.244157] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-14T17:51:46.248502] [INFO ] [REMOTE ] EFXT: Full fetch complete (32361 records). [2025-09-14T17:51:46.248710] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-09-14T17:51:46.635783] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-09-14T17:51:46.635919] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-09-14T17:51:46.636522] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-09-14T17:51:46.636584] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-09-14T17:51:46.637568] [DEBUG] [LOCAL ] EFXT: Trimmed 32361 records to 21439 (keeping 150 days of data) [2025-09-14T17:51:46.767448] [DEBUG] [LOCAL ] EFXT: Primary data saved (21439 records). [2025-09-14T17:51:46.767656] [INFO ] [MAIN ] EFXT: Full history saved. [2025-09-14T17:51:46.767786] [INFO ] [MAIN ] Update Progress: 707/2370 symbols completed. EFXT took 30.1s. Estimated remaining: 2h 55m 26s. Rate: 9.5 symbols/min [2025-09-14T17:51:46.937876] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:51:46.952484] [DEBUG] [LOCAL ] EHAB: Loaded 14201 existing records from primary storage. [2025-09-14T17:51:46.952693] [INFO ] [MAIN ] EHAB: Loaded 14201 existing records. [2025-09-14T17:51:46.958834] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-09-14T17:51:47.143323] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:51:47.143719] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-09-14T17:51:47.143791] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-14T17:51:47.144451] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-09-14T17:51:47.144524] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-09-14T17:51:47.510470] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:51:47.554538] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-14T17:51:47.758851] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-09-14T17:51:48.558888] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-09-14T17:51:48.877545] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T17:51:49.366746] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-09-14T17:51:49.370598] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-14T17:51:49.556997] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T17:51:50.158839] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-09-14T17:51:50.651325] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T17:51:50.958886] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-09-14T17:51:51.488577] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T17:51:51.758858] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-09-14T17:51:52.264543] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-14T17:51:52.558857] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-09-14T17:51:53.124055] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-14T17:51:53.358845] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-09-14T17:51:53.581523] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-14T17:51:54.158890] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-09-14T17:51:54.842949] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T17:51:54.958853] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-09-14T17:51:55.527074] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-14T17:51:55.758870] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-09-14T17:51:56.294335] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-14T17:51:56.558882] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-09-14T17:51:57.262110] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T17:51:57.358802] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-09-14T17:51:57.856145] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T17:51:57.859859] [INFO ] [REMOTE ] EGP: Full fetch complete (34631 records). [2025-09-14T17:51:57.859958] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-09-14T17:51:58.163916] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-09-14T17:51:58.238769] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-09-14T17:51:58.238942] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-09-14T17:51:58.239574] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-09-14T17:51:58.239704] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-09-14T17:51:58.240919] [DEBUG] [LOCAL ] EGP: Trimmed 34631 records to 22583 (keeping 150 days of data) [2025-09-14T17:51:58.357060] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-14T17:51:58.418186] [DEBUG] [LOCAL ] EGP: Primary data saved (22583 records). [2025-09-14T17:51:58.418356] [INFO ] [MAIN ] EGP: Full history saved. [2025-09-14T17:51:58.418499] [INFO ] [MAIN ] Update Progress: 708/2370 symbols completed. EGP took 17.5s. Estimated remaining: 2h 55m 32s. Rate: 9.5 symbols/min [2025-09-14T17:51:58.586318] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:51:58.605266] [DEBUG] [LOCAL ] EHC: Loaded 18581 existing records from primary storage. [2025-09-14T17:51:58.605426] [INFO ] [MAIN ] EHC: Loaded 18581 existing records. [2025-09-14T17:51:58.784434] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:51:58.784759] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-09-14T17:51:58.784827] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-09-14T17:51:58.785418] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-09-14T17:51:58.785510] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-09-14T17:51:58.969347] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-09-14T17:51:59.136832] [INFO ] [REMOTE ] EHC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:51:59.627399] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T17:51:59.758785] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-09-14T17:52:00.558885] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-09-14T17:52:00.683389] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T17:52:01.358832] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-09-14T17:52:01.449222] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T17:52:01.609718] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-14T17:52:02.158853] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-09-14T17:52:02.958841] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-09-14T17:52:02.984161] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-14T17:52:02.990077] [INFO ] [REMOTE ] EGO: Full fetch complete (55805 records). [2025-09-14T17:52:02.990245] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-09-14T17:52:03.398057] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-09-14T17:52:03.398214] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-09-14T17:52:03.399322] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-09-14T17:52:03.399394] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-09-14T17:52:03.402564] [DEBUG] [LOCAL ] EGO: Trimmed 55805 records to 38604 (keeping 150 days of data) [2025-09-14T17:52:03.642349] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-14T17:52:03.687039] [DEBUG] [LOCAL ] EGO: Primary data saved (38604 records). [2025-09-14T17:52:03.687321] [INFO ] [MAIN ] EGO: Full history saved. [2025-09-14T17:52:03.687578] [INFO ] [MAIN ] Update Progress: 709/2370 symbols completed. EGO took 36.4s. Estimated remaining: 2h 55m 24s. Rate: 9.5 symbols/min [2025-09-14T17:52:03.765466] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-09-14T17:52:03.874762] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:52:03.884811] [DEBUG] [LOCAL ] EHI: Loaded 4906 existing records from primary storage. [2025-09-14T17:52:03.885041] [INFO ] [MAIN ] EHI: Loaded 4906 existing records. [2025-09-14T17:52:04.090626] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:52:04.091121] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-09-14T17:52:04.091194] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-14T17:52:04.091675] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-09-14T17:52:04.091750] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-09-14T17:52:04.464772] [INFO ] [REMOTE ] EHI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:52:04.474197] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:52:04.477563] [INFO ] [REMOTE ] EHAB: Full fetch complete (32297 records). [2025-09-14T17:52:04.477762] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-09-14T17:52:04.558801] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-09-14T17:52:04.863902] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-09-14T17:52:04.864221] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-09-14T17:52:04.865008] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-09-14T17:52:04.884743] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-09-14T17:52:04.889301] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-14T17:52:04.899165] [DEBUG] [LOCAL ] EHAB: Trimmed 32297 records to 22977 (keeping 150 days of data) [2025-09-14T17:52:05.041588] [DEBUG] [LOCAL ] EHAB: Primary data saved (22977 records). [2025-09-14T17:52:05.041782] [INFO ] [MAIN ] EHAB: Full history saved. [2025-09-14T17:52:05.041964] [INFO ] [MAIN ] Update Progress: 710/2370 symbols completed. EHAB took 18.3s. Estimated remaining: 2h 55m 6s. Rate: 9.5 symbols/min [2025-09-14T17:52:05.212836] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:52:05.224752] [DEBUG] [LOCAL ] EIC: Loaded 10407 existing records from primary storage. [2025-09-14T17:52:05.224896] [INFO ] [MAIN ] EIC: Loaded 10407 existing records. [2025-09-14T17:52:05.365730] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-09-14T17:52:05.404441] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:52:05.404609] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-09-14T17:52:05.404687] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-09-14T17:52:05.405143] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-09-14T17:52:05.405207] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-09-14T17:52:05.757953] [INFO ] [REMOTE ] EIC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:52:06.168423] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-09-14T17:52:06.170689] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T17:52:06.297920] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-14T17:52:06.958841] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-09-14T17:52:07.758803] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-09-14T17:52:07.785635] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-14T17:52:08.489135] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-14T17:52:08.518114] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T17:52:08.558823] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-09-14T17:52:09.358841] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-09-14T17:52:09.956453] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-14T17:52:09.962852] [INFO ] [REMOTE ] EGY: Full fetch complete (45896 records). [2025-09-14T17:52:09.963110] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-09-14T17:52:10.166539] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-09-14T17:52:10.361238] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-09-14T17:52:10.361357] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-09-14T17:52:10.362141] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-09-14T17:52:10.362217] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-09-14T17:52:10.363281] [DEBUG] [LOCAL ] EGY: Trimmed 45896 records to 31091 (keeping 150 days of data) [2025-09-14T17:52:10.560633] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-14T17:52:10.580743] [DEBUG] [LOCAL ] EGY: Primary data saved (31091 records). [2025-09-14T17:52:10.580908] [INFO ] [MAIN ] EGY: Full history saved. [2025-09-14T17:52:10.581039] [INFO ] [MAIN ] Update Progress: 711/2370 symbols completed. EGY took 28.1s. Estimated remaining: 2h 54m 57s. Rate: 9.5 symbols/min [2025-09-14T17:52:10.749321] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:52:10.751556] [DEBUG] [LOCAL ] EICA: Loaded 404 existing records from primary storage. [2025-09-14T17:52:10.751662] [INFO ] [MAIN ] EICA: Loaded 404 existing records. [2025-09-14T17:52:10.928979] [WARN ] [MAIN ] EICA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:52:10.929259] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-09-14T17:52:10.929318] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-14T17:52:10.929490] [DEBUG] [LOCAL ] EICA: Deleted primary data file. [2025-09-14T17:52:10.929551] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-09-14T17:52:10.964023] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-09-14T17:52:11.322015] [INFO ] [REMOTE ] EICA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:52:11.758862] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-09-14T17:52:11.802888] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-14T17:52:12.138221] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-14T17:52:12.229844] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T17:52:12.558832] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-09-14T17:52:13.358877] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-09-14T17:52:13.763861] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T17:52:14.164324] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-09-14T17:52:14.167887] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-14T17:52:14.958937] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-09-14T17:52:15.310978] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-14T17:52:15.758874] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-09-14T17:52:16.167005] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-14T17:52:16.528705] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T17:52:16.558815] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-09-14T17:52:17.358844] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-09-14T17:52:17.969632] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T17:52:18.150884] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-14T17:52:18.158766] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-09-14T17:52:18.958806] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-09-14T17:52:19.190436] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-14T17:52:19.758821] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-09-14T17:52:20.563911] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-09-14T17:52:20.579259] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-14T17:52:20.642760] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-14T17:52:21.358854] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-09-14T17:52:21.695599] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-14T17:52:21.755635] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-14T17:52:22.158846] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-09-14T17:52:22.545877] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-14T17:52:22.958842] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-09-14T17:52:23.759251] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-09-14T17:52:23.760099] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-14T17:52:24.558857] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-09-14T17:52:25.124454] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-14T17:52:25.358880] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-09-14T17:52:25.900232] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-14T17:52:26.158869] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-09-14T17:52:26.501018] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-14T17:52:26.598625] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T17:52:26.602783] [INFO ] [REMOTE ] EHC: Full fetch complete (45298 records). [2025-09-14T17:52:26.602922] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-09-14T17:52:26.962287] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-09-14T17:52:26.977830] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-09-14T17:52:26.977943] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-09-14T17:52:26.978715] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-09-14T17:52:26.978871] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-09-14T17:52:26.979979] [DEBUG] [LOCAL ] EHC: Trimmed 45298 records to 31562 (keeping 150 days of data) [2025-09-14T17:52:27.189595] [DEBUG] [LOCAL ] EHC: Primary data saved (31562 records). [2025-09-14T17:52:27.189802] [INFO ] [MAIN ] EHC: Full history saved. [2025-09-14T17:52:27.189915] [INFO ] [MAIN ] Update Progress: 712/2370 symbols completed. EHC took 28.8s. Estimated remaining: 2h 55m 15s. Rate: 9.5 symbols/min [2025-09-14T17:52:27.357040] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:52:27.360134] [DEBUG] [LOCAL ] EICB: Loaded 1011 existing records from primary storage. [2025-09-14T17:52:27.360228] [INFO ] [MAIN ] EICB: Loaded 1011 existing records. [2025-09-14T17:52:27.450810] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-14T17:52:27.536605] [WARN ] [MAIN ] EICB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:52:27.536903] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-09-14T17:52:27.536972] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-14T17:52:27.537230] [DEBUG] [LOCAL ] EICB: Deleted primary data file. [2025-09-14T17:52:27.537287] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-09-14T17:52:27.768051] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-09-14T17:52:27.881830] [INFO ] [REMOTE ] EICB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:52:28.449733] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:52:28.451476] [INFO ] [REMOTE ] EHI: Full fetch complete (11448 records). [2025-09-14T17:52:28.451580] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-09-14T17:52:28.563925] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-09-14T17:52:28.813829] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-09-14T17:52:28.813978] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-09-14T17:52:28.814330] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-09-14T17:52:28.814399] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-09-14T17:52:28.814912] [DEBUG] [LOCAL ] EHI: Trimmed 11448 records to 7822 (keeping 150 days of data) [2025-09-14T17:52:28.862116] [DEBUG] [LOCAL ] EHI: Primary data saved (7822 records). [2025-09-14T17:52:28.862297] [INFO ] [MAIN ] EHI: Full history saved. [2025-09-14T17:52:28.862428] [INFO ] [MAIN ] Update Progress: 713/2370 symbols completed. EHI took 25.2s. Estimated remaining: 2h 54m 58s. Rate: 9.5 symbols/min [2025-09-14T17:52:29.033891] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:52:29.036383] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-14T17:52:29.043153] [DEBUG] [LOCAL ] EICC: Loaded 4350 existing records from primary storage. [2025-09-14T17:52:29.043269] [INFO ] [MAIN ] EICC: Loaded 4350 existing records. [2025-09-14T17:52:29.218234] [WARN ] [MAIN ] EICC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:52:29.218518] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-09-14T17:52:29.218579] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-14T17:52:29.219140] [DEBUG] [LOCAL ] EICC: Deleted primary data file. [2025-09-14T17:52:29.219206] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-09-14T17:52:29.366355] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-09-14T17:52:29.572587] [INFO ] [REMOTE ] EICC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:52:30.158825] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-09-14T17:52:30.645026] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-14T17:52:30.891763] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-14T17:52:30.894256] [INFO ] [REMOTE ] EIC: Full fetch complete (27054 records). [2025-09-14T17:52:30.894506] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-09-14T17:52:30.963934] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-09-14T17:52:31.279143] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-09-14T17:52:31.279248] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-09-14T17:52:31.279833] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-09-14T17:52:31.279897] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-09-14T17:52:31.280600] [DEBUG] [LOCAL ] EIC: Trimmed 27054 records to 18009 (keeping 150 days of data) [2025-09-14T17:52:31.395558] [DEBUG] [LOCAL ] EIC: Primary data saved (18009 records). [2025-09-14T17:52:31.395758] [INFO ] [MAIN ] EIC: Full history saved. [2025-09-14T17:52:31.395927] [INFO ] [MAIN ] Update Progress: 714/2370 symbols completed. EIC took 26.4s. Estimated remaining: 2h 54m 43s. Rate: 9.5 symbols/min [2025-09-14T17:52:31.511804] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-14T17:52:31.572491] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:52:31.583160] [DEBUG] [LOCAL ] EIG: Loaded 9773 existing records from primary storage. [2025-09-14T17:52:31.583340] [INFO ] [MAIN ] EIG: Loaded 9773 existing records. [2025-09-14T17:52:31.762906] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-09-14T17:52:31.762808] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:52:31.764444] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-09-14T17:52:31.764679] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-09-14T17:52:31.765044] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-09-14T17:52:31.765103] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-09-14T17:52:32.113819] [INFO ] [REMOTE ] EIG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:52:32.261735] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-14T17:52:32.558840] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-09-14T17:52:33.021544] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-14T17:52:33.358864] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-14T17:52:33.634930] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-09-14T17:52:33.635775] [INFO ] [REMOTE ] EICA: Full fetch complete (870 records). [2025-09-14T17:52:33.635872] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-09-14T17:52:33.816076] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 144 unique days, need 150 days [2025-09-14T17:52:33.816329] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:52:33.816423] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:52:33.816517] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-14T17:52:33.816610] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-14T17:52:33.816716] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-09-14T17:52:33.816816] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-09-14T17:52:33.816944] [INFO ] [MAIN ] Update Progress: 715/2370 symbols completed. EICA took 23.2s. Estimated remaining: 2h 54m 27s. Rate: 9.5 symbols/min [2025-09-14T17:52:33.992741] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:52:34.016969] [DEBUG] [LOCAL ] EIX: Loaded 23962 existing records from primary storage. [2025-09-14T17:52:34.017149] [INFO ] [MAIN ] EIX: Loaded 23962 existing records. [2025-09-14T17:52:34.164186] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-09-14T17:52:34.205539] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:52:34.205840] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-09-14T17:52:34.205918] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-14T17:52:34.206598] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-09-14T17:52:34.206712] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-09-14T17:52:34.575613] [INFO ] [REMOTE ] EIX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:52:34.705062] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-14T17:52:34.958874] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-09-14T17:52:35.758883] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-09-14T17:52:36.558890] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-09-14T17:52:36.713086] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T17:52:36.754499] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-14T17:52:37.074278] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-14T17:52:37.358863] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-09-14T17:52:38.158803] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-09-14T17:52:38.425304] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-14T17:52:38.601118] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-14T17:52:38.958878] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-09-14T17:52:39.463578] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-14T17:52:39.758890] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-09-14T17:52:40.216087] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-14T17:52:40.558898] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-09-14T17:52:41.358864] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-09-14T17:52:41.826702] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-14T17:52:42.158845] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-09-14T17:52:42.557016] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-14T17:52:42.679401] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-14T17:52:42.958838] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-09-14T17:52:43.758872] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-09-14T17:52:44.204263] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-14T17:52:44.558885] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-09-14T17:52:44.938045] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T17:52:45.358892] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-09-14T17:52:45.772086] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T17:52:45.883105] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-14T17:52:46.158893] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-09-14T17:52:46.683057] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-14T17:52:46.958926] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-09-14T17:52:47.456216] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-14T17:52:47.758871] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-14T17:52:48.169612] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T17:52:48.170538] [INFO ] [REMOTE ] EICB: Full fetch complete (1985 records). [2025-09-14T17:52:48.170624] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-09-14T17:52:48.356486] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-14T17:52:48.356739] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:52:48.356796] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:52:48.356857] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-14T17:52:48.356970] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-14T17:52:48.357053] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-09-14T17:52:48.357126] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-09-14T17:52:48.357209] [INFO ] [MAIN ] Update Progress: 716/2370 symbols completed. EICB took 21.2s. Estimated remaining: 2h 54m 40s. Rate: 9.5 symbols/min [2025-09-14T17:52:48.562484] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-09-14T17:52:48.564201] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:52:48.590311] [DEBUG] [LOCAL ] EL: Loaded 24025 existing records from primary storage. [2025-09-14T17:52:48.590544] [INFO ] [MAIN ] EL: Loaded 24025 existing records. [2025-09-14T17:52:48.771671] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:52:48.771942] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-09-14T17:52:48.772005] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-09-14T17:52:48.772700] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-09-14T17:52:48.772764] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-09-14T17:52:49.062220] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T17:52:49.074951] [INFO ] [REMOTE ] EICC: Full fetch complete (6264 records). [2025-09-14T17:52:49.091071] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-09-14T17:52:49.249422] [INFO ] [REMOTE ] EL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:52:49.364096] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-09-14T17:52:49.531186] [DEBUG] [VALIDATOR ] EICC: All expected trading days are present. [2025-09-14T17:52:49.531291] [DEBUG] [VALIDATOR ] EICC: Primary data validation passed. [2025-09-14T17:52:49.531490] [INFO ] [MAIN ] EICC: Fetched primary data is valid. [2025-09-14T17:52:49.531545] [DEBUG] [LOCAL ] EICC: Saving primary data. [2025-09-14T17:52:49.531987] [DEBUG] [LOCAL ] EICC: Trimmed 6264 records to 4350 (keeping 150 days of data) [2025-09-14T17:52:49.558479] [DEBUG] [LOCAL ] EICC: Primary data saved (4350 records). [2025-09-14T17:52:49.558566] [INFO ] [MAIN ] EICC: Full history saved. [2025-09-14T17:52:49.558672] [INFO ] [MAIN ] Update Progress: 717/2370 symbols completed. EICC took 20.7s. Estimated remaining: 2h 54m 22s. Rate: 9.5 symbols/min [2025-09-14T17:52:50.158899] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-09-14T17:52:50.958840] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-09-14T17:52:51.254526] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-14T17:52:51.428437] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-14T17:52:51.758922] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-09-14T17:52:52.558881] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-09-14T17:52:52.628143] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-14T17:52:52.839569] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T17:52:53.358925] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-09-14T17:52:54.158872] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-09-14T17:52:54.380861] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T17:52:54.551460] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-14T17:52:54.958822] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-09-14T17:52:55.758815] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-09-14T17:52:56.037526] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-14T17:52:56.086505] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-14T17:52:56.558877] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-09-14T17:52:56.879492] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-14T17:52:56.882123] [INFO ] [REMOTE ] EIG: Full fetch complete (21632 records). [2025-09-14T17:52:56.882211] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-09-14T17:52:57.247165] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-09-14T17:52:57.247276] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-09-14T17:52:57.247789] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-09-14T17:52:57.247893] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-09-14T17:52:57.248610] [DEBUG] [LOCAL ] EIG: Trimmed 21632 records to 15585 (keeping 150 days of data) [2025-09-14T17:52:57.346873] [DEBUG] [LOCAL ] EIG: Primary data saved (15585 records). [2025-09-14T17:52:57.347053] [INFO ] [MAIN ] EIG: Full history saved. [2025-09-14T17:52:57.347160] [INFO ] [MAIN ] Update Progress: 718/2370 symbols completed. EIG took 26.0s. Estimated remaining: 2h 54m 19s. Rate: 9.5 symbols/min [2025-09-14T17:52:57.358851] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-09-14T17:52:57.908463] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-14T17:52:58.158792] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-09-14T17:52:59.088345] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-14T17:52:59.100442] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-09-14T17:53:00.373944] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-14T17:53:00.386252] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-09-14T17:53:00.998684] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T17:53:01.010970] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-09-14T17:53:01.678144] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T17:53:01.683785] [INFO ] [REMOTE ] EIX: Full fetch complete (58038 records). [2025-09-14T17:53:01.683920] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-09-14T17:53:02.064769] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-09-14T17:53:02.064906] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-09-14T17:53:02.065753] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-09-14T17:53:02.065823] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-09-14T17:53:02.067147] [DEBUG] [LOCAL ] EIX: Trimmed 58038 records to 40171 (keeping 150 days of data) [2025-09-14T17:53:02.326346] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-14T17:53:02.339475] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-09-14T17:53:02.366924] [DEBUG] [LOCAL ] EIX: Primary data saved (40171 records). [2025-09-14T17:53:02.367190] [INFO ] [MAIN ] EIX: Full history saved. [2025-09-14T17:53:02.367337] [INFO ] [MAIN ] Update Progress: 719/2370 symbols completed. EIX took 28.6s. Estimated remaining: 2h 54m 9s. Rate: 9.5 symbols/min [2025-09-14T17:53:04.682128] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-14T17:53:04.694816] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-09-14T17:53:06.676732] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-14T17:53:06.688708] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-09-14T17:53:07.003308] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T17:53:07.009823] [INFO ] [REMOTE ] EL: Full fetch complete (58159 records). [2025-09-14T17:53:07.009957] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-09-14T17:53:07.396604] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-09-14T17:53:07.396732] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-09-14T17:53:07.397492] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-09-14T17:53:07.397550] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-09-14T17:53:07.398816] [DEBUG] [LOCAL ] EL: Trimmed 58159 records to 40296 (keeping 150 days of data) [2025-09-14T17:53:07.663691] [DEBUG] [LOCAL ] EL: Primary data saved (40296 records). [2025-09-14T17:53:07.663853] [INFO ] [MAIN ] EL: Full history saved. [2025-09-14T17:53:07.663949] [INFO ] [MAIN ] Update Progress: 720/2370 symbols completed. EL took 19.3s. Estimated remaining: 2h 54m 1s. Rate: 9.5 symbols/min [2025-09-14T17:53:08.278835] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:53:08.408555] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:53:08.451978] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:53:08.419406] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:53:08.457713] [DEBUG] [LOCAL ] ELC: Loaded 1702 existing records from primary storage. [2025-09-14T17:53:08.458215] [INFO ] [MAIN ] ELC: Loaded 1702 existing records. [2025-09-14T17:53:08.600846] [DEBUG] [LOCAL ] ELME: Loaded 18347 existing records from primary storage. [2025-09-14T17:53:08.618352] [INFO ] [MAIN ] ELME: Loaded 18347 existing records. [2025-09-14T17:53:08.687004] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:53:08.693239] [DEBUG] [LOCAL ] ELAN: Loaded 23813 existing records from primary storage. [2025-09-14T17:53:08.704566] [INFO ] [MAIN ] ELAN: Loaded 23813 existing records. [2025-09-14T17:53:08.720490] [DEBUG] [LOCAL ] ELF: Loaded 23240 existing records from primary storage. [2025-09-14T17:53:08.742224] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-09-14T17:53:08.736926] [INFO ] [MAIN ] ELF: Loaded 23240 existing records. [2025-09-14T17:53:08.780299] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-14T17:53:08.955055] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-09-14T17:53:09.022104] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-09-14T17:53:09.222112] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:53:09.287088] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-09-14T17:53:09.343685] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:53:09.365895] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-09-14T17:53:09.360316] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:53:09.379414] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-09-14T17:53:09.379818] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-09-14T17:53:09.379954] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-09-14T17:53:09.380266] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-09-14T17:53:09.386068] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-09-14T17:53:09.386147] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-09-14T17:53:09.386325] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-09-14T17:53:09.401949] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-09-14T17:53:09.391556] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-09-14T17:53:09.531932] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-09-14T17:53:10.074686] [INFO ] [REMOTE ] ELC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:53:10.135044] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-09-14T17:53:10.782352] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:53:10.839038] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-09-14T17:53:10.861716] [INFO ] [REMOTE ] ELME: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:53:10.900367] [INFO ] [REMOTE ] ELF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:53:10.900737] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-14T17:53:10.901553] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-09-14T17:53:10.903800] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-09-14T17:53:10.901941] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-09-14T17:53:11.452819] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-14T17:53:11.454253] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-09-14T17:53:12.073958] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-14T17:53:12.075589] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-09-14T17:53:12.368748] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-14T17:53:12.377091] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-09-14T17:53:12.620825] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-14T17:53:12.622371] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-09-14T17:53:12.698932] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T17:53:12.710022] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-09-14T17:53:13.211360] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-14T17:53:13.222537] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-09-14T17:53:13.266697] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-14T17:53:13.268553] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-09-14T17:53:13.664334] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-14T17:53:13.666036] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-09-14T17:53:13.843991] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T17:53:14.158830] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-09-14T17:53:14.210928] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-14T17:53:14.332955] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-14T17:53:14.958862] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-09-14T17:53:15.358983] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-14T17:53:15.722000] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-14T17:53:15.758830] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-09-14T17:53:16.558867] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-09-14T17:53:16.891280] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-14T17:53:17.358877] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-09-14T17:53:17.890338] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-14T17:53:18.037964] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-14T17:53:18.158829] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-09-14T17:53:18.678874] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T17:53:18.680204] [INFO ] [REMOTE ] ELC: Full fetch complete (3810 records). [2025-09-14T17:53:18.680300] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-09-14T17:53:18.964155] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-09-14T17:53:19.069136] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-09-14T17:53:19.069312] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-09-14T17:53:19.069555] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-09-14T17:53:19.069714] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-09-14T17:53:19.070338] [DEBUG] [LOCAL ] ELC: Trimmed 3810 records to 2672 (keeping 150 days of data) [2025-09-14T17:53:19.088573] [DEBUG] [LOCAL ] ELC: Primary data saved (2672 records). [2025-09-14T17:53:19.088875] [INFO ] [MAIN ] ELC: Full history saved. [2025-09-14T17:53:19.089016] [INFO ] [MAIN ] Update Progress: 721/2370 symbols completed. ELC took 11.4s. Estimated remaining: 2h 54m 6s. Rate: 9.5 symbols/min [2025-09-14T17:53:19.261747] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-14T17:53:19.329758] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:53:19.343381] [DEBUG] [LOCAL ] ELP: Loaded 11525 existing records from primary storage. [2025-09-14T17:53:19.343580] [INFO ] [MAIN ] ELP: Loaded 11525 existing records. [2025-09-14T17:53:19.526712] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:53:19.527179] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-09-14T17:53:19.527242] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-09-14T17:53:19.527634] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-09-14T17:53:19.527743] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-09-14T17:53:19.765368] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-09-14T17:53:19.930848] [INFO ] [REMOTE ] ELP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:53:20.418215] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-14T17:53:20.558826] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-09-14T17:53:21.336636] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T17:53:21.358774] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-09-14T17:53:22.093316] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T17:53:22.158845] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-09-14T17:53:22.958871] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-09-14T17:53:23.220086] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T17:53:23.246591] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T17:53:23.758882] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-09-14T17:53:24.558844] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-09-14T17:53:24.652362] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T17:53:24.815942] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T17:53:25.358850] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-09-14T17:53:26.158883] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-09-14T17:53:26.410206] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-14T17:53:26.438839] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T17:53:26.958865] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-09-14T17:53:27.758839] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-09-14T17:53:27.849428] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T17:53:28.533605] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-14T17:53:28.539213] [INFO ] [REMOTE ] ELAN: Full fetch complete (57746 records). [2025-09-14T17:53:28.539336] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-09-14T17:53:28.570364] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-09-14T17:53:28.928695] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-09-14T17:53:28.928808] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-09-14T17:53:28.930238] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-09-14T17:53:28.930298] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-09-14T17:53:28.931588] [DEBUG] [LOCAL ] ELAN: Trimmed 57746 records to 40091 (keeping 150 days of data) [2025-09-14T17:53:29.178884] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-14T17:53:29.205012] [DEBUG] [LOCAL ] ELAN: Primary data saved (40091 records). [2025-09-14T17:53:29.205183] [INFO ] [MAIN ] ELAN: Full history saved. [2025-09-14T17:53:29.205293] [INFO ] [MAIN ] Update Progress: 722/2370 symbols completed. ELAN took 21.5s. Estimated remaining: 2h 54m 8s. Rate: 9.5 symbols/min [2025-09-14T17:53:29.373451] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-09-14T17:53:29.376056] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:53:29.379982] [DEBUG] [LOCAL ] ELPC: Loaded 311 existing records from primary storage. [2025-09-14T17:53:29.380236] [INFO ] [MAIN ] ELPC: Loaded 311 existing records. [2025-09-14T17:53:29.559363] [WARN ] [MAIN ] ELPC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:53:29.559617] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-09-14T17:53:29.559696] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-14T17:53:29.560053] [DEBUG] [LOCAL ] ELPC: Deleted primary data file. [2025-09-14T17:53:29.560117] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-09-14T17:53:29.908247] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:53:30.036529] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T17:53:30.041524] [INFO ] [REMOTE ] ELME: Full fetch complete (42728 records). [2025-09-14T17:53:30.041732] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-09-14T17:53:30.163945] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-09-14T17:53:30.418191] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-09-14T17:53:30.418371] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-09-14T17:53:30.419218] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-09-14T17:53:30.419313] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-09-14T17:53:30.420500] [DEBUG] [LOCAL ] ELME: Trimmed 42728 records to 29297 (keeping 150 days of data) [2025-09-14T17:53:30.557470] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-14T17:53:30.642877] [DEBUG] [LOCAL ] ELME: Primary data saved (29297 records). [2025-09-14T17:53:30.643048] [INFO ] [MAIN ] ELME: Full history saved. [2025-09-14T17:53:30.643168] [INFO ] [MAIN ] Update Progress: 723/2370 symbols completed. ELME took 23.0s. Estimated remaining: 2h 53m 51s. Rate: 9.5 symbols/min [2025-09-14T17:53:30.814466] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:53:30.838274] [DEBUG] [LOCAL ] ELS: Loaded 22338 existing records from primary storage. [2025-09-14T17:53:30.838444] [INFO ] [MAIN ] ELS: Loaded 22338 existing records. [2025-09-14T17:53:30.963948] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-09-14T17:53:31.021510] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:53:31.021802] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-09-14T17:53:31.021872] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-14T17:53:31.022534] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-09-14T17:53:31.022595] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-09-14T17:53:31.380217] [INFO ] [REMOTE ] ELS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:53:31.473274] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-14T17:53:31.521995] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-14T17:53:31.758865] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-09-14T17:53:32.558847] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-09-14T17:53:33.358804] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-09-14T17:53:33.820753] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-14T17:53:33.895920] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T17:53:34.158840] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-09-14T17:53:34.963920] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-09-14T17:53:34.978020] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-14T17:53:35.403927] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-14T17:53:35.758849] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-09-14T17:53:36.237674] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-14T17:53:36.392398] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-14T17:53:36.558880] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-09-14T17:53:37.358867] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-09-14T17:53:38.047477] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T17:53:38.052817] [INFO ] [REMOTE ] ELF: Full fetch complete (57026 records). [2025-09-14T17:53:38.052959] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-09-14T17:53:38.163993] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-09-14T17:53:38.442583] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-09-14T17:53:38.442861] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-09-14T17:53:38.443804] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-09-14T17:53:38.444317] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-09-14T17:53:38.445869] [DEBUG] [LOCAL ] ELF: Trimmed 57026 records to 39284 (keeping 150 days of data) [2025-09-14T17:53:38.541054] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-14T17:53:38.742051] [DEBUG] [LOCAL ] ELF: Primary data saved (39284 records). [2025-09-14T17:53:38.742302] [INFO ] [MAIN ] ELF: Full history saved. [2025-09-14T17:53:38.742472] [INFO ] [MAIN ] Update Progress: 724/2370 symbols completed. ELF took 31.1s. Estimated remaining: 2h 53m 49s. Rate: 9.5 symbols/min [2025-09-14T17:53:38.910908] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:53:38.933547] [DEBUG] [LOCAL ] ELV: Loaded 23102 existing records from primary storage. [2025-09-14T17:53:38.933758] [INFO ] [MAIN ] ELV: Loaded 23102 existing records. [2025-09-14T17:53:38.964028] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-09-14T17:53:39.114498] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:53:39.114895] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-09-14T17:53:39.114960] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-14T17:53:39.115743] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-09-14T17:53:39.115810] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-09-14T17:53:39.477171] [INFO ] [REMOTE ] ELV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:53:39.492584] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-14T17:53:39.758840] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-09-14T17:53:40.558842] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-09-14T17:53:40.698692] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T17:53:41.228906] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-14T17:53:41.358847] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-09-14T17:53:41.409060] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-14T17:53:41.411707] [INFO ] [REMOTE ] ELP: Full fetch complete (28272 records). [2025-09-14T17:53:41.411796] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-09-14T17:53:41.777051] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-09-14T17:53:41.777170] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-09-14T17:53:41.777741] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-09-14T17:53:41.777807] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-09-14T17:53:41.778532] [DEBUG] [LOCAL ] ELP: Trimmed 28272 records to 19609 (keeping 150 days of data) [2025-09-14T17:53:41.890265] [DEBUG] [LOCAL ] ELP: Primary data saved (19609 records). [2025-09-14T17:53:41.890443] [INFO ] [MAIN ] ELP: Full history saved. [2025-09-14T17:53:41.890559] [INFO ] [MAIN ] Update Progress: 725/2370 symbols completed. ELP took 22.8s. Estimated remaining: 2h 53m 35s. Rate: 9.5 symbols/min [2025-09-14T17:53:42.058725] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:53:42.066829] [DEBUG] [LOCAL ] EMA: Loaded 6458 existing records from primary storage. [2025-09-14T17:53:42.066956] [INFO ] [MAIN ] EMA: Loaded 6458 existing records. [2025-09-14T17:53:42.164523] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-09-14T17:53:42.244746] [WARN ] [MAIN ] EMA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:53:42.244995] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-09-14T17:53:42.245053] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-14T17:53:42.245398] [DEBUG] [LOCAL ] EMA: Deleted primary data file. [2025-09-14T17:53:42.245476] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-09-14T17:53:42.602809] [INFO ] [REMOTE ] EMA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:53:42.676906] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-14T17:53:42.958864] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-09-14T17:53:43.024701] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-14T17:53:43.758853] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-09-14T17:53:44.117190] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-14T17:53:44.558854] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-02. [2025-09-14T17:53:44.823412] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:53:44.823836] [WARN ] [REMOTE ] EMA: No data returned for month 2025-02 [2025-09-14T17:53:44.869625] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T17:53:45.358846] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-09-14T17:53:46.158869] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-09-14T17:53:46.526560] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-14T17:53:46.958866] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-03. [2025-09-14T17:53:47.191615] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:53:47.194769] [WARN ] [REMOTE ] EMA: No data returned for month 2025-03 [2025-09-14T17:53:47.196663] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T17:53:47.758824] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-09-14T17:53:48.558846] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-09-14T17:53:49.358865] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-09-14T17:53:49.439518] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-14T17:53:49.754828] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-14T17:53:50.158817] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-14T17:53:50.455030] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-14T17:53:50.508235] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-14T17:53:50.508936] [INFO ] [REMOTE ] ELPC: Full fetch complete (979 records). [2025-09-14T17:53:50.509017] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-09-14T17:53:50.690837] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 143 unique days, need 150 days [2025-09-14T17:53:50.691078] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:53:50.691134] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:53:50.691196] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-14T17:53:50.691274] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-14T17:53:50.691324] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-14T17:53:50.691391] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-09-14T17:53:50.691505] [INFO ] [MAIN ] Update Progress: 726/2370 symbols completed. ELPC took 21.5s. Estimated remaining: 2h 53m 34s. Rate: 9.5 symbols/min [2025-09-14T17:53:50.860874] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:53:50.871592] [DEBUG] [LOCAL ] EMD: Loaded 9281 existing records from primary storage. [2025-09-14T17:53:50.871769] [INFO ] [MAIN ] EMD: Loaded 9281 existing records. [2025-09-14T17:53:50.963975] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-04. [2025-09-14T17:53:51.053727] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:53:51.053982] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-09-14T17:53:51.054044] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-14T17:53:51.054430] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-09-14T17:53:51.054503] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-09-14T17:53:51.298201] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T17:53:51.328390] [WARN ] [REMOTE ] EMA: No data returned for month 2025-04 [2025-09-14T17:53:51.406331] [INFO ] [REMOTE ] EMD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:53:51.758854] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-09-14T17:53:52.558821] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-05. [2025-09-14T17:53:52.945993] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-14T17:53:52.947722] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-14T17:53:53.358884] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-09-14T17:53:54.158960] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-06. [2025-09-14T17:53:54.958915] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-09-14T17:53:55.199816] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-14T17:53:55.242854] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T17:53:55.758850] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-09-14T17:53:56.130021] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T17:53:56.558903] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-07. [2025-09-14T17:53:57.251708] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-14T17:53:57.358880] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-09-14T17:53:57.444095] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T17:53:58.159057] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-09-14T17:53:58.700250] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T17:53:58.709620] [INFO ] [REMOTE ] ELS: Full fetch complete (53269 records). [2025-09-14T17:53:58.709936] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-09-14T17:53:58.960455] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-09-14T17:53:59.298529] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-09-14T17:53:59.298722] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-09-14T17:53:59.299684] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-09-14T17:53:59.299754] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-09-14T17:53:59.301136] [DEBUG] [LOCAL ] ELS: Trimmed 53269 records to 37194 (keeping 150 days of data) [2025-09-14T17:53:59.423872] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-14T17:53:59.562830] [DEBUG] [LOCAL ] ELS: Primary data saved (37194 records). [2025-09-14T17:53:59.563007] [INFO ] [MAIN ] ELS: Full history saved. [2025-09-14T17:53:59.563112] [INFO ] [MAIN ] Update Progress: 727/2370 symbols completed. ELS took 28.9s. Estimated remaining: 2h 53m 34s. Rate: 9.5 symbols/min [2025-09-14T17:53:59.731296] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:53:59.744986] [DEBUG] [LOCAL ] EME: Loaded 12676 existing records from primary storage. [2025-09-14T17:53:59.745142] [INFO ] [MAIN ] EME: Loaded 12676 existing records. [2025-09-14T17:53:59.765375] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-09-14T17:53:59.927159] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:53:59.927415] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-09-14T17:53:59.927491] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-09-14T17:53:59.927972] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-09-14T17:53:59.928034] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-09-14T17:54:00.295990] [INFO ] [REMOTE ] EME: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:54:00.311923] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-14T17:54:00.558869] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-08. [2025-09-14T17:54:01.365672] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-09-14T17:54:01.367717] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-14T17:54:02.158793] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-09. [2025-09-14T17:54:02.233796] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-14T17:54:02.958894] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-09-14T17:54:03.758954] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-09-14T17:54:04.548057] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (3.18 seconds). [2025-09-14T17:54:04.558768] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-09-14T17:54:04.854345] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-09 (2.70 seconds). [2025-09-14T17:54:04.857382] [INFO ] [REMOTE ] EMA: Full fetch complete (7118 records). [2025-09-14T17:54:04.857517] [DEBUG] [VALIDATOR ] EMA: Validating primary data. [2025-09-14T17:54:05.053042] [WARN ] [VALIDATOR ] EMA: Validation failed - insufficient historical data. Have 75 unique days, need 150 days [2025-09-14T17:54:05.053346] [FATAL] [MAIN ] EMA: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:54:05.053427] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:54:05.053557] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-14T17:54:05.053676] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-14T17:54:05.053762] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-09-14T17:54:05.053857] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-09-14T17:54:05.053990] [INFO ] [MAIN ] Update Progress: 728/2370 symbols completed. EMA took 23.2s. Estimated remaining: 2h 53m 25s. Rate: 9.5 symbols/min [2025-09-14T17:54:05.226969] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:54:05.239792] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-14T17:54:05.247268] [DEBUG] [LOCAL ] EMF: Loaded 1442 existing records from primary storage. [2025-09-14T17:54:05.247418] [INFO ] [MAIN ] EMF: Loaded 1442 existing records. [2025-09-14T17:54:05.363913] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-09-14T17:54:05.428201] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:54:05.428485] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-09-14T17:54:05.428547] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-09-14T17:54:05.428767] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-09-14T17:54:05.428826] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-09-14T17:54:05.789286] [INFO ] [REMOTE ] EMF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:54:06.052058] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-14T17:54:06.085541] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-14T17:54:06.158816] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-09-14T17:54:06.215269] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-14T17:54:06.727332] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T17:54:06.735561] [INFO ] [REMOTE ] ELV: Full fetch complete (54814 records). [2025-09-14T17:54:06.735777] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-09-14T17:54:06.966747] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-09-14T17:54:07.137311] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-09-14T17:54:07.137430] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-09-14T17:54:07.138260] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-09-14T17:54:07.138334] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-09-14T17:54:07.139631] [DEBUG] [LOCAL ] ELV: Trimmed 54814 records to 38179 (keeping 150 days of data) [2025-09-14T17:54:07.392215] [DEBUG] [LOCAL ] ELV: Primary data saved (38179 records). [2025-09-14T17:54:07.392412] [INFO ] [MAIN ] ELV: Full history saved. [2025-09-14T17:54:07.392551] [INFO ] [MAIN ] Update Progress: 729/2370 symbols completed. ELV took 28.6s. Estimated remaining: 2h 53m 10s. Rate: 9.5 symbols/min [2025-09-14T17:54:07.561115] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:54:07.583473] [DEBUG] [LOCAL ] EMN: Loaded 22703 existing records from primary storage. [2025-09-14T17:54:07.583684] [INFO ] [MAIN ] EMN: Loaded 22703 existing records. [2025-09-14T17:54:07.691669] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-14T17:54:07.771803] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-09-14T17:54:07.776481] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:54:07.777670] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-09-14T17:54:07.777739] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-09-14T17:54:07.778291] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-09-14T17:54:07.778487] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-09-14T17:54:08.135041] [INFO ] [REMOTE ] EMN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:54:08.558827] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-09-14T17:54:08.991383] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-14T17:54:09.358835] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-09-14T17:54:10.158838] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-09-14T17:54:10.314321] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T17:54:10.467066] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-14T17:54:10.958835] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-09-14T17:54:11.701694] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-14T17:54:11.758822] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-09-14T17:54:11.887011] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T17:54:12.386246] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-14T17:54:12.558848] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-09-14T17:54:13.358836] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-09-14T17:54:14.158783] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-09-14T17:54:14.375619] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-14T17:54:14.378039] [INFO ] [REMOTE ] EMD: Full fetch complete (23871 records). [2025-09-14T17:54:14.378141] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-09-14T17:54:14.814021] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-14T17:54:14.814633] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-09-14T17:54:14.824107] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-09-14T17:54:14.825151] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-09-14T17:54:14.825532] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-09-14T17:54:14.826261] [DEBUG] [LOCAL ] EMD: Trimmed 23871 records to 15058 (keeping 150 days of data) [2025-09-14T17:54:14.915882] [DEBUG] [LOCAL ] EMD: Primary data saved (15058 records). [2025-09-14T17:54:14.916055] [INFO ] [MAIN ] EMD: Full history saved. [2025-09-14T17:54:14.916178] [INFO ] [MAIN ] Update Progress: 730/2370 symbols completed. EMD took 24.2s. Estimated remaining: 2h 53m 6s. Rate: 9.5 symbols/min [2025-09-14T17:54:14.969722] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-09-14T17:54:15.094442] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:54:15.103966] [DEBUG] [LOCAL ] EMO: Loaded 6508 existing records from primary storage. [2025-09-14T17:54:15.104114] [INFO ] [MAIN ] EMO: Loaded 6508 existing records. [2025-09-14T17:54:15.279940] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:54:15.280207] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-09-14T17:54:15.280269] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-14T17:54:15.280584] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-09-14T17:54:15.280684] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-09-14T17:54:15.642714] [INFO ] [REMOTE ] EMO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:54:15.758809] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-09-14T17:54:15.967365] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-14T17:54:16.554546] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-14T17:54:16.558763] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-09-14T17:54:16.741209] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-14T17:54:17.358826] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-09-14T17:54:17.395054] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-14T17:54:17.876300] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-14T17:54:18.158779] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-09-14T17:54:18.958886] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-09-14T17:54:19.051412] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-14T17:54:19.672335] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-14T17:54:19.758830] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-09-14T17:54:20.284758] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-14T17:54:20.558853] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-09-14T17:54:21.358856] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-09-14T17:54:21.405528] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-14T17:54:21.763508] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-14T17:54:21.764492] [INFO ] [REMOTE ] EMF: Full fetch complete (4349 records). [2025-09-14T17:54:21.764591] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-09-14T17:54:22.137391] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-09-14T17:54:22.137552] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-09-14T17:54:22.137779] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-09-14T17:54:22.137916] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-09-14T17:54:22.138335] [DEBUG] [LOCAL ] EMF: Trimmed 4349 records to 2183 (keeping 150 days of data) [2025-09-14T17:54:22.152937] [DEBUG] [LOCAL ] EMF: Primary data saved (2183 records). [2025-09-14T17:54:22.153009] [INFO ] [MAIN ] EMF: Full history saved. [2025-09-14T17:54:22.153176] [INFO ] [MAIN ] Update Progress: 731/2370 symbols completed. EMF took 17.1s. Estimated remaining: 2h 53m 2s. Rate: 9.5 symbols/min [2025-09-14T17:54:22.164144] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-09-14T17:54:22.338968] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:54:22.343133] [DEBUG] [LOCAL ] EMP: Loaded 1289 existing records from primary storage. [2025-09-14T17:54:22.343250] [INFO ] [MAIN ] EMP: Loaded 1289 existing records. [2025-09-14T17:54:22.521376] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:54:22.521720] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-09-14T17:54:22.521800] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-14T17:54:22.522078] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-09-14T17:54:22.522161] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-09-14T17:54:22.876567] [INFO ] [REMOTE ] EMP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:54:22.958795] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-09-14T17:54:23.474270] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-14T17:54:23.758793] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-09-14T17:54:23.854223] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T17:54:24.558828] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-09-14T17:54:25.231361] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-14T17:54:25.358809] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-09-14T17:54:26.158851] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-09-14T17:54:26.906910] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-14T17:54:26.958836] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-09-14T17:54:27.161953] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-14T17:54:27.545172] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-14T17:54:27.758849] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-09-14T17:54:28.419628] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-14T17:54:28.558900] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-09-14T17:54:28.699171] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T17:54:29.358869] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-09-14T17:54:29.379556] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T17:54:30.158912] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-09-14T17:54:30.781962] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-14T17:54:30.958853] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-09-14T17:54:31.169875] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-14T17:54:31.758857] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-09-14T17:54:32.020164] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-14T17:54:32.558841] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-09-14T17:54:33.062809] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-14T17:54:33.358845] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-09-14T17:54:33.380575] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T17:54:33.915844] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T17:54:33.919400] [INFO ] [REMOTE ] EME: Full fetch complete (35241 records). [2025-09-14T17:54:33.919511] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-09-14T17:54:34.168437] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-09-14T17:54:34.300102] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-09-14T17:54:34.300234] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-09-14T17:54:34.301008] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-09-14T17:54:34.301082] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-09-14T17:54:34.302279] [DEBUG] [LOCAL ] EME: Trimmed 35241 records to 22709 (keeping 150 days of data) [2025-09-14T17:54:34.456925] [DEBUG] [LOCAL ] EME: Primary data saved (22709 records). [2025-09-14T17:54:34.457086] [INFO ] [MAIN ] EME: Full history saved. [2025-09-14T17:54:34.457222] [INFO ] [MAIN ] Update Progress: 732/2370 symbols completed. EME took 34.9s. Estimated remaining: 2h 53m 9s. Rate: 9.5 symbols/min [2025-09-14T17:54:34.642546] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:54:34.666655] [DEBUG] [LOCAL ] EMR: Loaded 23809 existing records from primary storage. [2025-09-14T17:54:34.666819] [INFO ] [MAIN ] EMR: Loaded 23809 existing records. [2025-09-14T17:54:34.849255] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:54:34.849532] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-09-14T17:54:34.849596] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-09-14T17:54:34.850306] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-09-14T17:54:34.850376] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-09-14T17:54:34.963960] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-09-14T17:54:35.204772] [INFO ] [REMOTE ] EMR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:54:35.660820] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T17:54:35.758858] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-09-14T17:54:35.893762] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-14T17:54:35.896381] [INFO ] [REMOTE ] EMO: Full fetch complete (12900 records). [2025-09-14T17:54:35.896474] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-09-14T17:54:36.270111] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-09-14T17:54:36.270318] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-09-14T17:54:36.270788] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-09-14T17:54:36.270873] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-09-14T17:54:36.271746] [DEBUG] [LOCAL ] EMO: Trimmed 12900 records to 9565 (keeping 150 days of data) [2025-09-14T17:54:36.340827] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T17:54:36.350412] [INFO ] [REMOTE ] EMN: Full fetch complete (54264 records). [2025-09-14T17:54:36.351741] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-09-14T17:54:36.492393] [DEBUG] [LOCAL ] EMO: Primary data saved (9565 records). [2025-09-14T17:54:36.522769] [INFO ] [MAIN ] EMO: Full history saved. [2025-09-14T17:54:36.531957] [INFO ] [MAIN ] Update Progress: 733/2370 symbols completed. EMO took 21.6s. Estimated remaining: 2h 52m 53s. Rate: 9.5 symbols/min [2025-09-14T17:54:36.559778] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-09-14T17:54:36.934603] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:54:36.953205] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-09-14T17:54:36.953784] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-09-14T17:54:36.954955] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-09-14T17:54:36.955112] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-09-14T17:54:36.956672] [DEBUG] [LOCAL ] EMN: Trimmed 54264 records to 38189 (keeping 150 days of data) [2025-09-14T17:54:37.075088] [DEBUG] [LOCAL ] ENB: Loaded 23951 existing records from primary storage. [2025-09-14T17:54:37.076563] [INFO ] [MAIN ] ENB: Loaded 23951 existing records. [2025-09-14T17:54:37.265398] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:54:37.267687] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-09-14T17:54:37.268619] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-09-14T17:54:37.271282] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-09-14T17:54:37.272127] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-09-14T17:54:37.361378] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-09-14T17:54:37.755410] [INFO ] [REMOTE ] ENB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:54:37.797678] [DEBUG] [LOCAL ] EMN: Primary data saved (38189 records). [2025-09-14T17:54:37.797897] [INFO ] [MAIN ] EMN: Full history saved. [2025-09-14T17:54:37.798032] [INFO ] [MAIN ] Update Progress: 734/2370 symbols completed. EMN took 30.4s. Estimated remaining: 2h 52m 36s. Rate: 9.5 symbols/min [2025-09-14T17:54:37.979964] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:54:37.976981] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T17:54:37.985667] [DEBUG] [LOCAL ] ENFY: Loaded 1890 existing records from primary storage. [2025-09-14T17:54:37.985841] [INFO ] [MAIN ] ENFY: Loaded 1890 existing records. [2025-09-14T17:54:38.161331] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-09-14T17:54:38.173331] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:54:38.174367] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-09-14T17:54:38.174429] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-09-14T17:54:38.174697] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-09-14T17:54:38.174764] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-09-14T17:54:38.540153] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:54:38.572465] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-14T17:54:38.721797] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-14T17:54:38.958851] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-09-14T17:54:39.758835] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-09-14T17:54:40.292024] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-14T17:54:40.558874] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-09-14T17:54:40.962291] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-14T17:54:41.079877] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-14T17:54:41.358840] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-09-14T17:54:41.750878] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-14T17:54:42.158842] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-09-14T17:54:42.687400] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-14T17:54:42.958830] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-09-14T17:54:43.638343] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:54:43.639478] [INFO ] [REMOTE ] EMP: Full fetch complete (3192 records). [2025-09-14T17:54:43.639564] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-09-14T17:54:43.764034] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-09-14T17:54:44.025334] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-09-14T17:54:44.025489] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-09-14T17:54:44.025671] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-09-14T17:54:44.025730] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-09-14T17:54:44.026241] [DEBUG] [LOCAL ] EMP: Trimmed 3192 records to 2192 (keeping 150 days of data) [2025-09-14T17:54:44.040802] [DEBUG] [LOCAL ] EMP: Primary data saved (2192 records). [2025-09-14T17:54:44.040903] [INFO ] [MAIN ] EMP: Full history saved. [2025-09-14T17:54:44.041010] [INFO ] [MAIN ] Update Progress: 735/2370 symbols completed. EMP took 21.9s. Estimated remaining: 2h 52m 29s. Rate: 9.5 symbols/min [2025-09-14T17:54:44.222046] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:54:44.245304] [DEBUG] [LOCAL ] ENIC: Loaded 16018 existing records from primary storage. [2025-09-14T17:54:44.245555] [INFO ] [MAIN ] ENIC: Loaded 16018 existing records. [2025-09-14T17:54:44.438132] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:54:44.438516] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-09-14T17:54:44.438582] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-14T17:54:44.439142] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-09-14T17:54:44.439208] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-09-14T17:54:44.552973] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-14T17:54:44.563907] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-09-14T17:54:44.833517] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:54:45.358840] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-09-14T17:54:46.158841] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-09-14T17:54:46.641369] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-14T17:54:46.668389] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-14T17:54:46.775332] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T17:54:46.958831] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-09-14T17:54:47.758863] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-09-14T17:54:48.558833] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-09-14T17:54:48.956934] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-14T17:54:49.358829] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-09-14T17:54:49.625596] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-14T17:54:50.020132] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-14T17:54:50.158830] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-09-14T17:54:50.886195] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-14T17:54:50.958909] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-09-14T17:54:51.746679] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T17:54:51.758774] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-09-14T17:54:51.777559] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-14T17:54:52.558839] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-09-14T17:54:53.268492] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T17:54:53.358836] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-09-14T17:54:53.863975] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-14T17:54:54.158893] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-09-14T17:54:54.474826] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T17:54:54.958889] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-09-14T17:54:55.432073] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-14T17:54:55.758857] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-09-14T17:54:56.558817] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-09-14T17:54:57.031543] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-14T17:54:57.295777] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T17:54:57.358832] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-09-14T17:54:58.158852] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-09-14T17:54:58.226337] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-14T17:54:58.958864] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-09-14T17:54:59.398997] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-14T17:54:59.404710] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-14T17:54:59.758894] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-09-14T17:55:00.558891] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-09-14T17:55:01.043905] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-14T17:55:01.048755] [INFO ] [REMOTE ] ENIC: Full fetch complete (39365 records). [2025-09-14T17:55:01.049065] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-09-14T17:55:01.145402] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-14T17:55:01.364035] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-09-14T17:55:01.484395] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-09-14T17:55:01.484515] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-09-14T17:55:01.485237] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-09-14T17:55:01.485298] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-09-14T17:55:01.486792] [DEBUG] [LOCAL ] ENIC: Trimmed 39365 records to 28052 (keeping 150 days of data) [2025-09-14T17:55:01.661747] [DEBUG] [LOCAL ] ENIC: Primary data saved (28052 records). [2025-09-14T17:55:01.661936] [INFO ] [MAIN ] ENIC: Full history saved. [2025-09-14T17:55:01.662040] [INFO ] [MAIN ] Update Progress: 736/2370 symbols completed. ENIC took 17.6s. Estimated remaining: 2h 52m 48s. Rate: 9.5 symbols/min [2025-09-14T17:55:01.835672] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:55:01.838173] [DEBUG] [LOCAL ] ENO: Loaded 738 existing records from primary storage. [2025-09-14T17:55:01.838308] [INFO ] [MAIN ] ENO: Loaded 738 existing records. [2025-09-14T17:55:02.042949] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:55:02.042702] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:55:02.045245] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-09-14T17:55:02.045357] [INFO ] [REMOTE ] ENFY: Full fetch complete (3614 records). [2025-09-14T17:55:02.045567] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-09-14T17:55:02.045757] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-09-14T17:55:02.051546] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-09-14T17:55:02.146688] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-09-14T17:55:02.168404] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-09-14T17:55:02.729969] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-09-14T17:55:02.773973] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-09-14T17:55:02.815043] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-09-14T17:55:02.814459] [INFO ] [REMOTE ] ENO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:55:02.815276] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-09-14T17:55:02.816398] [DEBUG] [LOCAL ] ENFY: Trimmed 3614 records to 2700 (keeping 150 days of data) [2025-09-14T17:55:02.874753] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-14T17:55:02.877059] [DEBUG] [LOCAL ] ENFY: Primary data saved (2700 records). [2025-09-14T17:55:02.888596] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T17:55:02.888790] [INFO ] [MAIN ] ENFY: Full history saved. [2025-09-14T17:55:02.889285] [INFO ] [MAIN ] Update Progress: 737/2370 symbols completed. ENFY took 25.1s. Estimated remaining: 2h 52m 30s. Rate: 9.5 symbols/min [2025-09-14T17:55:02.928104] [INFO ] [REMOTE ] EMR: Full fetch complete (57894 records). [2025-09-14T17:55:02.963890] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-09-14T17:55:02.976945] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-09-14T17:55:03.165617] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:55:03.404927] [DEBUG] [LOCAL ] ENOV: Loaded 21110 existing records from primary storage. [2025-09-14T17:55:03.407832] [INFO ] [MAIN ] ENOV: Loaded 21110 existing records. [2025-09-14T17:55:03.641292] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-09-14T17:55:03.687685] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-09-14T17:55:03.704027] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:55:03.704913] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-09-14T17:55:03.705056] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-09-14T17:55:03.705188] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-09-14T17:55:03.705370] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-09-14T17:55:03.706019] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-09-14T17:55:03.706156] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-09-14T17:55:03.740818] [DEBUG] [LOCAL ] EMR: Trimmed 57894 records to 40060 (keeping 150 days of data) [2025-09-14T17:55:03.764270] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-09-14T17:55:04.181557] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:55:04.364792] [DEBUG] [LOCAL ] EMR: Primary data saved (40060 records). [2025-09-14T17:55:04.364947] [INFO ] [MAIN ] EMR: Full history saved. [2025-09-14T17:55:04.365044] [INFO ] [MAIN ] Update Progress: 738/2370 symbols completed. EMR took 29.9s. Estimated remaining: 2h 52m 13s. Rate: 9.5 symbols/min [2025-09-14T17:55:04.468232] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-14T17:55:04.540496] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:55:04.560185] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-09-14T17:55:04.560576] [DEBUG] [LOCAL ] ENR: Loaded 20210 existing records from primary storage. [2025-09-14T17:55:04.561715] [INFO ] [MAIN ] ENR: Loaded 20210 existing records. [2025-09-14T17:55:04.739475] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:55:04.739747] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-09-14T17:55:04.739808] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-14T17:55:04.740417] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-09-14T17:55:04.740477] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-09-14T17:55:05.097140] [INFO ] [REMOTE ] ENR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:55:05.132502] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-14T17:55:05.358853] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-09-14T17:55:06.063224] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-14T17:55:06.158797] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-09-14T17:55:06.958817] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-09-14T17:55:07.177259] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-14T17:55:07.389540] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-14T17:55:07.753551] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T17:55:07.762348] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-09-14T17:55:08.437215] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-14T17:55:08.558889] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-09-14T17:55:09.100204] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-14T17:55:09.358887] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-09-14T17:55:10.158837] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-09-14T17:55:10.958849] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-09-14T17:55:11.074354] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-14T17:55:11.080952] [INFO ] [REMOTE ] ENB: Full fetch complete (58211 records). [2025-09-14T17:55:11.081161] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-09-14T17:55:11.460487] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-09-14T17:55:11.460608] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-09-14T17:55:11.461392] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-09-14T17:55:11.461454] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-09-14T17:55:11.462816] [DEBUG] [LOCAL ] ENB: Trimmed 58211 records to 40294 (keeping 150 days of data) [2025-09-14T17:55:11.709468] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T17:55:11.745852] [DEBUG] [LOCAL ] ENB: Primary data saved (40294 records). [2025-09-14T17:55:11.746029] [INFO ] [MAIN ] ENB: Full history saved. [2025-09-14T17:55:11.746156] [INFO ] [MAIN ] Update Progress: 739/2370 symbols completed. ENB took 35.2s. Estimated remaining: 2h 52m 9s. Rate: 9.5 symbols/min [2025-09-14T17:55:11.766739] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-09-14T17:55:11.929444] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:55:11.943258] [DEBUG] [LOCAL ] ENS: Loaded 12946 existing records from primary storage. [2025-09-14T17:55:11.943418] [INFO ] [MAIN ] ENS: Loaded 12946 existing records. [2025-09-14T17:55:12.117207] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:55:12.117443] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-09-14T17:55:12.117505] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-09-14T17:55:12.117940] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-09-14T17:55:12.118005] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-09-14T17:55:12.400094] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-14T17:55:12.476409] [INFO ] [REMOTE ] ENS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:55:12.558819] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-09-14T17:55:12.584511] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T17:55:13.023289] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-14T17:55:13.358836] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-09-14T17:55:13.852058] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-14T17:55:14.158837] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-09-14T17:55:14.958840] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-09-14T17:55:15.653425] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-14T17:55:15.758831] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-09-14T17:55:16.399554] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T17:55:16.558824] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-09-14T17:55:17.277131] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-14T17:55:17.358843] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-09-14T17:55:17.920411] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-14T17:55:18.158839] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-09-14T17:55:18.497450] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-14T17:55:18.498336] [INFO ] [REMOTE ] ENO: Full fetch complete (2253 records). [2025-09-14T17:55:18.498421] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-09-14T17:55:18.891887] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-09-14T17:55:18.892056] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-09-14T17:55:18.892250] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-09-14T17:55:18.892309] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-09-14T17:55:18.892817] [DEBUG] [LOCAL ] ENO: Trimmed 2253 records to 1267 (keeping 150 days of data) [2025-09-14T17:55:18.900999] [DEBUG] [LOCAL ] ENO: Primary data saved (1267 records). [2025-09-14T17:55:18.901079] [INFO ] [MAIN ] ENO: Full history saved. [2025-09-14T17:55:18.901164] [INFO ] [MAIN ] Update Progress: 740/2370 symbols completed. ENO took 17.2s. Estimated remaining: 2h 52m 5s. Rate: 9.5 symbols/min [2025-09-14T17:55:18.963899] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-09-14T17:55:19.083989] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-14T17:55:19.117950] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:55:19.132766] [DEBUG] [LOCAL ] ENVA: Loaded 11316 existing records from primary storage. [2025-09-14T17:55:19.132943] [INFO ] [MAIN ] ENVA: Loaded 11316 existing records. [2025-09-14T17:55:19.306487] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:55:19.306795] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-09-14T17:55:19.306856] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-09-14T17:55:19.307342] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-09-14T17:55:19.307403] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-09-14T17:55:19.666471] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:55:19.758895] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-09-14T17:55:20.385778] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-14T17:55:20.558847] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-09-14T17:55:21.034224] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-14T17:55:21.358872] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-09-14T17:55:22.099027] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T17:55:22.158818] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-09-14T17:55:22.958839] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-09-14T17:55:23.117385] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T17:55:23.758874] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-09-14T17:55:23.831931] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T17:55:24.010322] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T17:55:24.558868] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-09-14T17:55:25.366668] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-09-14T17:55:25.391709] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T17:55:26.158860] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-09-14T17:55:26.197144] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T17:55:26.751126] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T17:55:26.958842] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-09-14T17:55:27.714715] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-14T17:55:27.758806] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-09-14T17:55:28.139310] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-14T17:55:28.558881] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-09-14T17:55:29.166619] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-14T17:55:29.358836] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-09-14T17:55:29.593362] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-14T17:55:30.158839] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-09-14T17:55:30.797439] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T17:55:30.958857] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-09-14T17:55:31.562121] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-14T17:55:31.758850] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-09-14T17:55:32.329294] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T17:55:32.347264] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T17:55:32.351982] [INFO ] [REMOTE ] ENOV: Full fetch complete (48612 records). [2025-09-14T17:55:32.352087] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-09-14T17:55:32.563947] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-09-14T17:55:32.736759] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-09-14T17:55:32.736880] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-09-14T17:55:32.737638] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-09-14T17:55:32.737712] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-09-14T17:55:32.738935] [DEBUG] [LOCAL ] ENOV: Trimmed 48612 records to 34517 (keeping 150 days of data) [2025-09-14T17:55:32.952773] [DEBUG] [LOCAL ] ENOV: Primary data saved (34517 records). [2025-09-14T17:55:32.952962] [INFO ] [MAIN ] ENOV: Full history saved. [2025-09-14T17:55:32.953068] [INFO ] [MAIN ] Update Progress: 741/2370 symbols completed. ENOV took 30.1s. Estimated remaining: 2h 52m 15s. Rate: 9.5 symbols/min [2025-09-14T17:55:33.127517] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:55:33.136679] [DEBUG] [LOCAL ] EOD: Loaded 7840 existing records from primary storage. [2025-09-14T17:55:33.136842] [INFO ] [MAIN ] EOD: Loaded 7840 existing records. [2025-09-14T17:55:33.315763] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:55:33.326008] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-09-14T17:55:33.326717] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T17:55:33.326774] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-09-14T17:55:33.330716] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-09-14T17:55:33.331057] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-09-14T17:55:33.362235] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-09-14T17:55:33.373407] [INFO ] [REMOTE ] ENR: Full fetch complete (45512 records). [2025-09-14T17:55:33.406179] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-09-14T17:55:33.985798] [INFO ] [REMOTE ] EOD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:55:34.072814] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-09-14T17:55:34.072935] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-09-14T17:55:34.073623] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-09-14T17:55:34.073698] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-09-14T17:55:34.074912] [DEBUG] [LOCAL ] ENR: Trimmed 45512 records to 33339 (keeping 150 days of data) [2025-09-14T17:55:34.166832] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-09-14T17:55:34.294692] [DEBUG] [LOCAL ] ENR: Primary data saved (33339 records). [2025-09-14T17:55:34.294895] [INFO ] [MAIN ] ENR: Full history saved. [2025-09-14T17:55:34.295000] [INFO ] [MAIN ] Update Progress: 742/2370 symbols completed. ENR took 29.9s. Estimated remaining: 2h 51m 58s. Rate: 9.5 symbols/min [2025-09-14T17:55:34.470020] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:55:34.496579] [DEBUG] [LOCAL ] EOG: Loaded 23881 existing records from primary storage. [2025-09-14T17:55:34.496778] [INFO ] [MAIN ] EOG: Loaded 23881 existing records. [2025-09-14T17:55:34.670674] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:55:34.671004] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-09-14T17:55:34.671069] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-09-14T17:55:34.671869] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-09-14T17:55:34.671936] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-09-14T17:55:34.960351] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-09-14T17:55:34.960813] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-14T17:55:35.000480] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T17:55:35.068102] [INFO ] [REMOTE ] EOG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:55:35.758843] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-09-14T17:55:36.401140] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T17:55:36.558822] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-09-14T17:55:37.130197] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T17:55:37.133204] [INFO ] [REMOTE ] ENVA: Full fetch complete (28041 records). [2025-09-14T17:55:37.133310] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-09-14T17:55:37.364276] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-09-14T17:55:37.513062] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-09-14T17:55:37.513287] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-09-14T17:55:37.513977] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-09-14T17:55:37.514053] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-09-14T17:55:37.515118] [DEBUG] [LOCAL ] ENVA: Trimmed 28041 records to 18954 (keeping 150 days of data) [2025-09-14T17:55:37.650121] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-14T17:55:37.672790] [DEBUG] [LOCAL ] ENVA: Primary data saved (18954 records). [2025-09-14T17:55:37.673054] [INFO ] [MAIN ] ENVA: Full history saved. [2025-09-14T17:55:37.673189] [INFO ] [MAIN ] Update Progress: 743/2370 symbols completed. ENVA took 18.8s. Estimated remaining: 2h 51m 45s. Rate: 9.5 symbols/min [2025-09-14T17:55:37.860731] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:55:37.867362] [DEBUG] [LOCAL ] EOI: Loaded 4037 existing records from primary storage. [2025-09-14T17:55:37.867523] [INFO ] [MAIN ] EOI: Loaded 4037 existing records. [2025-09-14T17:55:38.049415] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:55:38.058684] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-14T17:55:38.058346] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-09-14T17:55:38.061834] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-09-14T17:55:38.062900] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-09-14T17:55:38.062995] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-09-14T17:55:38.163997] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-09-14T17:55:38.422821] [INFO ] [REMOTE ] EOI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:55:38.958812] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-09-14T17:55:39.091171] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-14T17:55:39.758836] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-09-14T17:55:40.083133] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T17:55:40.558836] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-09-14T17:55:40.570083] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-14T17:55:41.358855] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-09-14T17:55:41.443223] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T17:55:42.158832] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-09-14T17:55:42.958821] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-09-14T17:55:43.044421] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T17:55:43.299710] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-14T17:55:43.763113] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-09-14T17:55:43.764948] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-14T17:55:44.404524] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:55:44.408231] [INFO ] [REMOTE ] ENS: Full fetch complete (32091 records). [2025-09-14T17:55:44.408376] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-09-14T17:55:44.566936] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-09-14T17:55:44.809751] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-09-14T17:55:44.809878] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-09-14T17:55:44.810710] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-09-14T17:55:44.810804] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-09-14T17:55:44.811852] [DEBUG] [LOCAL ] ENS: Trimmed 32091 records to 21770 (keeping 150 days of data) [2025-09-14T17:55:44.955848] [DEBUG] [LOCAL ] ENS: Primary data saved (21770 records). [2025-09-14T17:55:44.956014] [INFO ] [MAIN ] ENS: Full history saved. [2025-09-14T17:55:44.956116] [INFO ] [MAIN ] Update Progress: 744/2370 symbols completed. ENS took 33.2s. Estimated remaining: 2h 51m 41s. Rate: 9.5 symbols/min [2025-09-14T17:55:45.125576] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:55:45.134130] [DEBUG] [LOCAL ] EOS: Loaded 6391 existing records from primary storage. [2025-09-14T17:55:45.134305] [INFO ] [MAIN ] EOS: Loaded 6391 existing records. [2025-09-14T17:55:45.310382] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:55:45.310667] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-09-14T17:55:45.310732] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-09-14T17:55:45.311051] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-09-14T17:55:45.311110] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-09-14T17:55:45.364678] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-09-14T17:55:45.673157] [INFO ] [REMOTE ] EOS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:55:46.158844] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-09-14T17:55:46.454372] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T17:55:46.706186] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-14T17:55:46.958808] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-09-14T17:55:47.250608] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T17:55:47.471060] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-14T17:55:47.758833] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-09-14T17:55:48.558783] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-09-14T17:55:48.941963] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-14T17:55:49.358880] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-09-14T17:55:49.781523] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-14T17:55:50.158919] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-09-14T17:55:50.957518] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-14T17:55:50.959880] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-09-14T17:55:51.227886] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T17:55:51.556958] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-14T17:55:51.758902] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-09-14T17:55:52.480478] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-14T17:55:52.558863] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-09-14T17:55:53.263858] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-14T17:55:53.358798] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-09-14T17:55:54.066253] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:55:54.067983] [INFO ] [REMOTE ] EOI: Full fetch complete (11662 records). [2025-09-14T17:55:54.068089] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-09-14T17:55:54.164108] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-09-14T17:55:54.454207] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-09-14T17:55:54.454357] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-09-14T17:55:54.454930] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-09-14T17:55:54.455005] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-09-14T17:55:54.455622] [DEBUG] [LOCAL ] EOI: Trimmed 11662 records to 7034 (keeping 150 days of data) [2025-09-14T17:55:54.506988] [DEBUG] [LOCAL ] EOI: Primary data saved (7034 records). [2025-09-14T17:55:54.507294] [INFO ] [MAIN ] EOI: Full history saved. [2025-09-14T17:55:54.507475] [INFO ] [MAIN ] Update Progress: 745/2370 symbols completed. EOI took 16.8s. Estimated remaining: 2h 51m 41s. Rate: 9.5 symbols/min [2025-09-14T17:55:54.696461] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:55:54.701986] [DEBUG] [LOCAL ] EOT: Loaded 2952 existing records from primary storage. [2025-09-14T17:55:54.702131] [INFO ] [MAIN ] EOT: Loaded 2952 existing records. [2025-09-14T17:55:54.882106] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:55:54.882389] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-09-14T17:55:54.882471] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-09-14T17:55:54.882732] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-09-14T17:55:54.882794] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-09-14T17:55:54.963902] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-09-14T17:55:55.240201] [INFO ] [REMOTE ] EOT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:55:55.758809] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-09-14T17:55:55.840558] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T17:55:55.842426] [INFO ] [REMOTE ] EOD: Full fetch complete (15389 records). [2025-09-14T17:55:55.842514] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-09-14T17:55:56.210795] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-09-14T17:55:56.210986] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-09-14T17:55:56.211439] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-09-14T17:55:56.211539] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-09-14T17:55:56.212311] [DEBUG] [LOCAL ] EOD: Trimmed 15389 records to 11000 (keeping 150 days of data) [2025-09-14T17:55:56.308517] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-14T17:55:56.338020] [DEBUG] [LOCAL ] EOD: Primary data saved (11000 records). [2025-09-14T17:55:56.338266] [INFO ] [MAIN ] EOD: Full history saved. [2025-09-14T17:55:56.338424] [INFO ] [MAIN ] Update Progress: 746/2370 symbols completed. EOD took 23.4s. Estimated remaining: 2h 51m 25s. Rate: 9.5 symbols/min [2025-09-14T17:55:56.511012] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:55:56.528590] [DEBUG] [LOCAL ] EPAC: Loaded 12596 existing records from primary storage. [2025-09-14T17:55:56.528830] [INFO ] [MAIN ] EPAC: Loaded 12596 existing records. [2025-09-14T17:55:56.564073] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-09-14T17:55:56.715512] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:55:56.711918] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-14T17:55:56.718253] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-09-14T17:55:56.718322] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-09-14T17:55:56.718794] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-09-14T17:55:56.718857] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-09-14T17:55:57.071209] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:55:57.358859] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-09-14T17:55:57.739721] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-14T17:55:58.158891] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-09-14T17:55:58.243549] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T17:55:58.920469] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-14T17:55:58.958858] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-09-14T17:55:59.758899] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-09-14T17:56:00.558918] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-09-14T17:56:00.748605] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T17:56:01.226556] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T17:56:01.344631] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-14T17:56:01.358801] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-09-14T17:56:01.818656] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-14T17:56:02.158848] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-09-14T17:56:02.902578] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-14T17:56:02.958889] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-09-14T17:56:03.711191] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-14T17:56:03.758794] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-09-14T17:56:04.535152] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-14T17:56:04.558817] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-09-14T17:56:05.188530] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T17:56:05.190991] [INFO ] [REMOTE ] EOT: Full fetch complete (7507 records). [2025-09-14T17:56:05.191140] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-09-14T17:56:05.363105] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-09-14T17:56:05.801498] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-09-14T17:56:05.801687] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-09-14T17:56:05.802122] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-09-14T17:56:05.802196] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-09-14T17:56:05.803104] [DEBUG] [LOCAL ] EOT: Trimmed 7507 records to 5036 (keeping 150 days of data) [2025-09-14T17:56:05.845716] [DEBUG] [LOCAL ] EOT: Primary data saved (5036 records). [2025-09-14T17:56:05.846002] [INFO ] [MAIN ] EOT: Full history saved. [2025-09-14T17:56:05.846154] [INFO ] [MAIN ] Update Progress: 747/2370 symbols completed. EOT took 11.3s. Estimated remaining: 2h 51m 26s. Rate: 9.5 symbols/min [2025-09-14T17:56:06.042369] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:56:06.062140] [DEBUG] [LOCAL ] EPAM: Loaded 16662 existing records from primary storage. [2025-09-14T17:56:06.062334] [INFO ] [MAIN ] EPAM: Loaded 16662 existing records. [2025-09-14T17:56:06.167975] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-09-14T17:56:06.250936] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:56:06.251204] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-09-14T17:56:06.251267] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-09-14T17:56:06.251860] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-09-14T17:56:06.251923] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-09-14T17:56:06.488907] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-14T17:56:06.634477] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:56:06.958830] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-09-14T17:56:07.758873] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-09-14T17:56:08.026464] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T17:56:08.581104] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-09-14T17:56:08.597747] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-14T17:56:08.875587] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-14T17:56:09.358861] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-09-14T17:56:09.483374] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-14T17:56:10.158840] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-09-14T17:56:10.402278] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-14T17:56:10.958894] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-09-14T17:56:11.301441] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-14T17:56:11.758778] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-09-14T17:56:12.072075] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T17:56:12.558839] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-09-14T17:56:12.642902] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-14T17:56:13.358846] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-09-14T17:56:13.937842] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-14T17:56:13.948275] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T17:56:13.950512] [INFO ] [REMOTE ] EOS: Full fetch complete (16992 records). [2025-09-14T17:56:13.950601] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-09-14T17:56:14.164010] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-09-14T17:56:14.313041] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-09-14T17:56:14.313140] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-09-14T17:56:14.313617] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-09-14T17:56:14.313691] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-09-14T17:56:14.314252] [DEBUG] [LOCAL ] EOS: Trimmed 16992 records to 10469 (keeping 150 days of data) [2025-09-14T17:56:14.381626] [DEBUG] [LOCAL ] EOS: Primary data saved (10469 records). [2025-09-14T17:56:14.381819] [INFO ] [MAIN ] EOS: Full history saved. [2025-09-14T17:56:14.381933] [INFO ] [MAIN ] Update Progress: 748/2370 symbols completed. EOS took 29.4s. Estimated remaining: 2h 51m 24s. Rate: 9.5 symbols/min [2025-09-14T17:56:14.554279] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:56:14.574531] [DEBUG] [LOCAL ] EPC: Loaded 17949 existing records from primary storage. [2025-09-14T17:56:14.574707] [INFO ] [MAIN ] EPC: Loaded 17949 existing records. [2025-09-14T17:56:14.746808] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:56:14.747023] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-09-14T17:56:14.747081] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-09-14T17:56:14.747614] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-09-14T17:56:14.747698] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-09-14T17:56:14.964058] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-09-14T17:56:15.111893] [INFO ] [REMOTE ] EPC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:56:15.701840] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T17:56:15.707723] [INFO ] [REMOTE ] EOG: Full fetch complete (58003 records). [2025-09-14T17:56:15.707893] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-09-14T17:56:15.770400] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-09-14T17:56:16.131058] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-09-14T17:56:16.131346] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-09-14T17:56:16.133995] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-09-14T17:56:16.135226] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-14T17:56:16.135389] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-09-14T17:56:16.147669] [DEBUG] [LOCAL ] EOG: Trimmed 58003 records to 40135 (keeping 150 days of data) [2025-09-14T17:56:16.431236] [DEBUG] [LOCAL ] EOG: Primary data saved (40135 records). [2025-09-14T17:56:16.431396] [INFO ] [MAIN ] EOG: Full history saved. [2025-09-14T17:56:16.431506] [INFO ] [MAIN ] Update Progress: 749/2370 symbols completed. EOG took 42.1s. Estimated remaining: 2h 51m 9s. Rate: 9.5 symbols/min [2025-09-14T17:56:16.571308] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-09-14T17:56:16.604066] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:56:16.629549] [DEBUG] [LOCAL ] EPD: Loaded 23998 existing records from primary storage. [2025-09-14T17:56:16.629750] [INFO ] [MAIN ] EPD: Loaded 23998 existing records. [2025-09-14T17:56:16.813367] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:56:16.813631] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-09-14T17:56:16.813709] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-09-14T17:56:16.814814] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-09-14T17:56:16.815161] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-09-14T17:56:17.200718] [INFO ] [REMOTE ] EPD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:56:17.226344] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T17:56:17.358805] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-09-14T17:56:17.833503] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T17:56:18.158838] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-09-14T17:56:18.569584] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-14T17:56:18.958844] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-09-14T17:56:19.520703] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T17:56:19.523997] [INFO ] [REMOTE ] EPAC: Full fetch complete (29028 records). [2025-09-14T17:56:19.524175] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-09-14T17:56:19.765037] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-09-14T17:56:19.898931] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-09-14T17:56:19.899112] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-09-14T17:56:19.899770] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-09-14T17:56:19.899832] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-09-14T17:56:19.900971] [DEBUG] [LOCAL ] EPAC: Trimmed 29028 records to 19349 (keeping 150 days of data) [2025-09-14T17:56:20.011255] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T17:56:20.058250] [DEBUG] [LOCAL ] EPAC: Primary data saved (19349 records). [2025-09-14T17:56:20.058404] [INFO ] [MAIN ] EPAC: Full history saved. [2025-09-14T17:56:20.058508] [INFO ] [MAIN ] Update Progress: 750/2370 symbols completed. EPAC took 23.7s. Estimated remaining: 2h 50m 56s. Rate: 9.5 symbols/min [2025-09-14T17:56:20.229574] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:56:20.249442] [DEBUG] [LOCAL ] EPR: Loaded 20401 existing records from primary storage. [2025-09-14T17:56:20.249611] [INFO ] [MAIN ] EPR: Loaded 20401 existing records. [2025-09-14T17:56:20.423248] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:56:20.423504] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-09-14T17:56:20.423570] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-09-14T17:56:20.424248] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-09-14T17:56:20.424312] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-09-14T17:56:20.564010] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-09-14T17:56:20.775402] [INFO ] [REMOTE ] EPR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:56:21.277629] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T17:56:21.358772] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-09-14T17:56:22.049234] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-14T17:56:22.158776] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-09-14T17:56:22.961750] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-09-14T17:56:22.967005] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T17:56:23.247570] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T17:56:23.758854] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-09-14T17:56:24.238975] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T17:56:24.558899] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-09-14T17:56:25.358850] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-09-14T17:56:25.568235] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T17:56:26.148376] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T17:56:26.158774] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-09-14T17:56:26.674181] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-14T17:56:26.958863] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-09-14T17:56:27.727530] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-14T17:56:27.758776] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-09-14T17:56:28.558842] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-09-14T17:56:28.873781] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-14T17:56:29.358811] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-09-14T17:56:29.422389] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T17:56:29.858308] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-14T17:56:30.158818] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-09-14T17:56:30.891242] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T17:56:30.958814] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-09-14T17:56:31.758789] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-09-14T17:56:31.858298] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T17:56:32.432030] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T17:56:32.558825] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-09-14T17:56:33.358823] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-09-14T17:56:33.447919] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T17:56:34.158821] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-09-14T17:56:34.358307] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T17:56:34.520701] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T17:56:34.958837] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-09-14T17:56:35.227706] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-14T17:56:35.232138] [INFO ] [REMOTE ] EPC: Full fetch complete (43765 records). [2025-09-14T17:56:35.232295] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-09-14T17:56:35.617495] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-09-14T17:56:35.617600] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-09-14T17:56:35.618262] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-09-14T17:56:35.618330] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-09-14T17:56:35.619514] [DEBUG] [LOCAL ] EPC: Trimmed 43765 records to 30114 (keeping 150 days of data) [2025-09-14T17:56:35.776835] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-09-14T17:56:35.815010] [DEBUG] [LOCAL ] EPC: Primary data saved (30114 records). [2025-09-14T17:56:35.815241] [INFO ] [MAIN ] EPC: Full history saved. [2025-09-14T17:56:35.815468] [INFO ] [MAIN ] Update Progress: 751/2370 symbols completed. EPC took 21.4s. Estimated remaining: 2h 51m 10s. Rate: 9.5 symbols/min [2025-09-14T17:56:35.943780] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T17:56:36.024484] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:56:36.047927] [DEBUG] [LOCAL ] EPRT: Loaded 21359 existing records from primary storage. [2025-09-14T17:56:36.048104] [INFO ] [MAIN ] EPRT: Loaded 21359 existing records. [2025-09-14T17:56:36.229927] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:56:36.230294] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-09-14T17:56:36.230534] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-09-14T17:56:36.236394] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-09-14T17:56:36.242374] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-09-14T17:56:36.243398] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T17:56:36.349690] [INFO ] [REMOTE ] EPAM: Full fetch complete (43159 records). [2025-09-14T17:56:36.350247] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-09-14T17:56:36.565896] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-09-14T17:56:36.920468] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:56:37.011756] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-09-14T17:56:37.011869] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-09-14T17:56:37.012626] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-09-14T17:56:37.012702] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-09-14T17:56:37.013814] [DEBUG] [LOCAL ] EPAM: Trimmed 43159 records to 29270 (keeping 150 days of data) [2025-09-14T17:56:37.213792] [DEBUG] [LOCAL ] EPAM: Primary data saved (29270 records). [2025-09-14T17:56:37.213984] [INFO ] [MAIN ] EPAM: Full history saved. [2025-09-14T17:56:37.214118] [INFO ] [MAIN ] Update Progress: 752/2370 symbols completed. EPAM took 31.4s. Estimated remaining: 2h 50m 53s. Rate: 9.5 symbols/min [2025-09-14T17:56:37.363448] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-09-14T17:56:37.393559] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:56:37.402753] [DEBUG] [LOCAL ] EQBK: Loaded 5748 existing records from primary storage. [2025-09-14T17:56:37.402901] [INFO ] [MAIN ] EQBK: Loaded 5748 existing records. [2025-09-14T17:56:37.584612] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:56:37.584910] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-09-14T17:56:37.584986] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-09-14T17:56:37.585305] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-09-14T17:56:37.585382] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-09-14T17:56:37.938175] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:56:38.158772] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-09-14T17:56:38.722821] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-14T17:56:38.723619] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-14T17:56:38.958802] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-09-14T17:56:39.245012] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T17:56:39.758831] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-09-14T17:56:40.558832] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-09-14T17:56:41.051870] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-14T17:56:41.358785] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-09-14T17:56:41.383855] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T17:56:42.158811] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-09-14T17:56:42.530602] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-14T17:56:42.958838] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-09-14T17:56:43.065074] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-14T17:56:43.070544] [INFO ] [REMOTE ] EPD: Full fetch complete (58292 records). [2025-09-14T17:56:43.070703] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-09-14T17:56:43.454472] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-09-14T17:56:43.454585] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-09-14T17:56:43.455414] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-09-14T17:56:43.455502] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-09-14T17:56:43.457196] [DEBUG] [LOCAL ] EPD: Trimmed 58292 records to 40362 (keeping 150 days of data) [2025-09-14T17:56:43.723867] [DEBUG] [LOCAL ] EPD: Primary data saved (40362 records). [2025-09-14T17:56:43.724021] [INFO ] [MAIN ] EPD: Full history saved. [2025-09-14T17:56:43.724132] [INFO ] [MAIN ] Update Progress: 753/2370 symbols completed. EPD took 27.3s. Estimated remaining: 2h 50m 48s. Rate: 9.5 symbols/min [2025-09-14T17:56:43.766783] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-09-14T17:56:43.835700] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T17:56:43.909454] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:56:43.941440] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-14T17:56:43.967847] [DEBUG] [LOCAL ] EQH: Loaded 23652 existing records from primary storage. [2025-09-14T17:56:43.968007] [INFO ] [MAIN ] EQH: Loaded 23652 existing records. [2025-09-14T17:56:44.151778] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:56:44.152120] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-09-14T17:56:44.152191] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-09-14T17:56:44.152847] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-09-14T17:56:44.152909] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-09-14T17:56:44.514027] [INFO ] [REMOTE ] EQH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:56:44.526460] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T17:56:44.531272] [INFO ] [REMOTE ] EPR: Full fetch complete (48197 records). [2025-09-14T17:56:44.531374] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-09-14T17:56:44.563872] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-09-14T17:56:44.917279] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-09-14T17:56:44.917412] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-09-14T17:56:44.918186] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-09-14T17:56:44.918244] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-09-14T17:56:44.919543] [DEBUG] [LOCAL ] EPR: Trimmed 48197 records to 33117 (keeping 150 days of data) [2025-09-14T17:56:45.142109] [DEBUG] [LOCAL ] EPR: Primary data saved (33117 records). [2025-09-14T17:56:45.142294] [INFO ] [MAIN ] EPR: Full history saved. [2025-09-14T17:56:45.142411] [INFO ] [MAIN ] Update Progress: 754/2370 symbols completed. EPR took 25.1s. Estimated remaining: 2h 50m 31s. Rate: 9.5 symbols/min [2025-09-14T17:56:45.312292] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:56:45.335627] [DEBUG] [LOCAL ] EQNR: Loaded 23736 existing records from primary storage. [2025-09-14T17:56:45.335820] [INFO ] [MAIN ] EQNR: Loaded 23736 existing records. [2025-09-14T17:56:45.365995] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-09-14T17:56:45.514321] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:56:45.514566] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-09-14T17:56:45.514630] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-09-14T17:56:45.515318] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-09-14T17:56:45.515379] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-09-14T17:56:45.864255] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:56:46.158878] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-09-14T17:56:46.268244] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-14T17:56:46.398670] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-14T17:56:46.958879] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-09-14T17:56:47.758836] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-09-14T17:56:48.114936] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-14T17:56:48.268265] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-14T17:56:48.558862] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-09-14T17:56:49.358850] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-09-14T17:56:49.505145] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T17:56:49.887121] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-14T17:56:50.158829] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-09-14T17:56:50.235296] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-14T17:56:50.958838] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-09-14T17:56:51.758893] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-09-14T17:56:52.039395] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T17:56:52.450085] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-14T17:56:52.558815] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-09-14T17:56:52.639715] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-14T17:56:53.358875] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-09-14T17:56:54.158807] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-09-14T17:56:54.219889] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T17:56:54.958896] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-09-14T17:56:55.303676] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-14T17:56:55.520558] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-14T17:56:55.706762] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-14T17:56:55.758801] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-09-14T17:56:56.558838] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-09-14T17:56:57.358894] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-09-14T17:56:57.458125] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T17:56:57.781216] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-14T17:56:58.158917] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-09-14T17:56:58.933246] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T17:56:58.958779] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-09-14T17:56:59.758888] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-09-14T17:56:59.978716] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T17:57:00.558893] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-09-14T17:57:00.591036] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T17:57:00.607835] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-14T17:57:00.609703] [INFO ] [REMOTE ] EQBK: Full fetch complete (11453 records). [2025-09-14T17:57:00.609793] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-09-14T17:57:01.010761] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-09-14T17:57:01.010876] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-09-14T17:57:01.011299] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-09-14T17:57:01.011372] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-09-14T17:57:01.012013] [DEBUG] [LOCAL ] EQBK: Trimmed 11453 records to 8151 (keeping 150 days of data) [2025-09-14T17:57:01.063754] [DEBUG] [LOCAL ] EQBK: Primary data saved (8151 records). [2025-09-14T17:57:01.063959] [INFO ] [MAIN ] EQBK: Full history saved. [2025-09-14T17:57:01.064101] [INFO ] [MAIN ] Update Progress: 755/2370 symbols completed. EQBK took 23.8s. Estimated remaining: 2h 50m 45s. Rate: 9.5 symbols/min [2025-09-14T17:57:01.241918] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:57:01.264775] [DEBUG] [LOCAL ] EQR: Loaded 22987 existing records from primary storage. [2025-09-14T17:57:01.264943] [INFO ] [MAIN ] EQR: Loaded 22987 existing records. [2025-09-14T17:57:01.364700] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-09-14T17:57:01.442303] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:57:01.442554] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-09-14T17:57:01.442615] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-09-14T17:57:01.443334] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-09-14T17:57:01.443400] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-09-14T17:57:01.795723] [INFO ] [REMOTE ] EQR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:57:02.158837] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-09-14T17:57:02.653939] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-14T17:57:02.958829] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-09-14T17:57:03.758863] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-09-14T17:57:04.465865] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-14T17:57:04.470870] [INFO ] [REMOTE ] EPRT: Full fetch complete (52804 records). [2025-09-14T17:57:04.471008] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-09-14T17:57:04.854720] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-09-14T17:57:04.854997] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-09-14T17:57:04.855896] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-09-14T17:57:04.855975] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-09-14T17:57:04.857468] [DEBUG] [LOCAL ] EPRT: Trimmed 52804 records to 36216 (keeping 150 days of data) [2025-09-14T17:57:04.890364] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (3.53 seconds). [2025-09-14T17:57:04.996171] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-09-14T17:57:05.125600] [DEBUG] [LOCAL ] EPRT: Primary data saved (36216 records). [2025-09-14T17:57:05.125795] [INFO ] [MAIN ] EPRT: Full history saved. [2025-09-14T17:57:05.125902] [INFO ] [MAIN ] Update Progress: 756/2370 symbols completed. EPRT took 29.3s. Estimated remaining: 2h 50m 34s. Rate: 9.5 symbols/min [2025-09-14T17:57:05.295420] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:57:05.298678] [DEBUG] [LOCAL ] EQS: Loaded 1409 existing records from primary storage. [2025-09-14T17:57:05.298777] [INFO ] [MAIN ] EQS: Loaded 1409 existing records. [2025-09-14T17:57:05.482168] [WARN ] [MAIN ] EQS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:57:05.483251] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-09-14T17:57:05.483592] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-14T17:57:05.484391] [DEBUG] [LOCAL ] EQS: Deleted primary data file. [2025-09-14T17:57:05.484534] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-09-14T17:57:05.866478] [INFO ] [REMOTE ] EQS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:57:05.877285] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-09-14T17:57:05.891003] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-14T17:57:05.921284] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (2.96 seconds). [2025-09-14T17:57:06.158829] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-09-14T17:57:06.349750] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-14T17:57:06.827437] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T17:57:06.958800] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-09-14T17:57:07.758840] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-09-14T17:57:08.103883] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-14T17:57:08.145351] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-14T17:57:08.395586] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-14T17:57:08.558857] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-09-14T17:57:08.846846] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-09-14T17:57:09.358851] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-09-14T17:57:10.158828] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-09-14T17:57:10.570468] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-14T17:57:10.958849] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-09-14T17:57:11.029938] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-14T17:57:11.035419] [INFO ] [REMOTE ] EQNR: Full fetch complete (57725 records). [2025-09-14T17:57:11.035547] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-09-14T17:57:11.413330] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-09-14T17:57:11.413437] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-09-14T17:57:11.414257] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-09-14T17:57:11.414316] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-09-14T17:57:11.415478] [DEBUG] [LOCAL ] EQNR: Trimmed 57725 records to 39924 (keeping 150 days of data) [2025-09-14T17:57:11.515362] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-14T17:57:11.673136] [DEBUG] [LOCAL ] EQNR: Primary data saved (39924 records). [2025-09-14T17:57:11.673301] [INFO ] [MAIN ] EQNR: Full history saved. [2025-09-14T17:57:11.673397] [INFO ] [MAIN ] Update Progress: 757/2370 symbols completed. EQNR took 26.5s. Estimated remaining: 2h 50m 28s. Rate: 9.5 symbols/min [2025-09-14T17:57:11.758799] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-09-14T17:57:12.479063] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T17:57:12.484563] [INFO ] [REMOTE ] EQH: Full fetch complete (57291 records). [2025-09-14T17:57:12.484737] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-09-14T17:57:12.563893] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-09-14T17:57:12.878613] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-09-14T17:57:12.878741] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-09-14T17:57:12.879572] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-09-14T17:57:12.879657] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-09-14T17:57:12.880956] [DEBUG] [LOCAL ] EQH: Trimmed 57291 records to 39546 (keeping 150 days of data) [2025-09-14T17:57:13.128979] [DEBUG] [LOCAL ] EQH: Primary data saved (39546 records). [2025-09-14T17:57:13.129174] [INFO ] [MAIN ] EQH: Full history saved. [2025-09-14T17:57:13.129285] [INFO ] [MAIN ] Update Progress: 758/2370 symbols completed. EQH took 29.4s. Estimated remaining: 2h 50m 11s. Rate: 9.5 symbols/min [2025-09-14T17:57:13.358823] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-09-14T17:57:14.669370] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T17:57:14.670830] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-09-14T17:57:14.967068] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-14T17:57:14.978504] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-09-14T17:57:15.421276] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-14T17:57:15.758874] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-14T17:57:16.401189] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T17:57:16.402399] [INFO ] [REMOTE ] EQS: Full fetch complete (1835 records). [2025-09-14T17:57:16.402487] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-09-14T17:57:16.587178] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 139 unique days, need 150 days [2025-09-14T17:57:16.587403] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-09-14T17:57:16.587470] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-09-14T17:57:16.587541] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-14T17:57:16.587632] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-14T17:57:16.587725] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-09-14T17:57:16.587819] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-09-14T17:57:16.587929] [INFO ] [MAIN ] Update Progress: 759/2370 symbols completed. EQS took 11.5s. Estimated remaining: 2h 49m 59s. Rate: 9.5 symbols/min [2025-09-14T17:57:17.155514] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-14T17:57:17.167701] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-09-14T17:57:18.891083] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T17:57:18.901950] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-09-14T17:57:20.658024] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T17:57:20.669573] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-09-14T17:57:22.192697] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-14T17:57:22.203993] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-09-14T17:57:22.851512] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T17:57:22.856902] [INFO ] [REMOTE ] EQR: Full fetch complete (55569 records). [2025-09-14T17:57:22.857025] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-09-14T17:57:23.237338] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-09-14T17:57:23.237510] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-09-14T17:57:23.238291] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-09-14T17:57:23.238352] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-09-14T17:57:23.239660] [DEBUG] [LOCAL ] EQR: Trimmed 55569 records to 38710 (keeping 150 days of data) [2025-09-14T17:57:23.485340] [DEBUG] [LOCAL ] EQR: Primary data saved (38710 records). [2025-09-14T17:57:23.485579] [INFO ] [MAIN ] EQR: Full history saved. [2025-09-14T17:57:23.485711] [INFO ] [MAIN ] Update Progress: 760/2370 symbols completed. EQR took 22.4s. Estimated remaining: 2h 49m 53s. Rate: 9.5 symbols/min [2025-09-14T17:57:24.020956] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:57:24.164423] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:57:24.173349] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:57:24.176183] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:57:24.182293] [DEBUG] [LOCAL ] EQV: Loaded 1338 existing records from primary storage. [2025-09-14T17:57:24.182470] [INFO ] [MAIN ] EQV: Loaded 1338 existing records. [2025-09-14T17:57:24.310793] [DEBUG] [LOCAL ] ERO: Loaded 18618 existing records from primary storage. [2025-09-14T17:57:24.372441] [INFO ] [MAIN ] ERO: Loaded 18618 existing records. [2025-09-14T17:57:24.409207] [DEBUG] [LOCAL ] ERJ: Loaded 22996 existing records from primary storage. [2025-09-14T17:57:24.393044] [DEBUG] [LOCAL ] EQT: Loaded 24053 existing records from primary storage. [2025-09-14T17:57:24.409702] [INFO ] [MAIN ] ERJ: Loaded 22996 existing records. [2025-09-14T17:57:24.414867] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:57:24.435341] [INFO ] [MAIN ] EQT: Loaded 24053 existing records. [2025-09-14T17:57:24.511402] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-09-14T17:57:24.597407] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-09-14T17:57:24.755565] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-09-14T17:57:24.847830] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-09-14T17:57:24.949978] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:57:24.950892] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:57:25.056073] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-09-14T17:57:25.062719] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-09-14T17:57:25.090716] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-09-14T17:57:25.098501] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-09-14T17:57:25.090942] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:57:25.136579] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-09-14T17:57:25.125914] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-09-14T17:57:25.137009] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-09-14T17:57:25.157885] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-09-14T17:57:25.183454] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-09-14T17:57:25.220108] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-09-14T17:57:25.403267] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-09-14T17:57:25.502310] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-09-14T17:57:26.344265] [INFO ] [REMOTE ] EQV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:57:26.408900] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-09-14T17:57:26.440021] [INFO ] [REMOTE ] ERO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:57:26.459553] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:57:26.480150] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-09-14T17:57:26.506813] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-09-14T17:57:26.642578] [INFO ] [REMOTE ] EQT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:57:26.643012] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-09-14T17:57:27.216556] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-14T17:57:27.218460] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-09-14T17:57:27.795255] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-14T17:57:27.797007] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-09-14T17:57:28.160747] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T17:57:28.169132] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-09-14T17:57:28.246869] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-14T17:57:28.248606] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-09-14T17:57:28.289215] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-14T17:57:28.300383] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-09-14T17:57:28.372717] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-14T17:57:28.383081] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-09-14T17:57:28.793126] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-14T17:57:28.794820] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-09-14T17:57:29.478314] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-14T17:57:29.481179] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-14T17:57:29.491816] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-09-14T17:57:29.493831] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-09-14T17:57:30.015279] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-14T17:57:30.158794] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-09-14T17:57:30.195538] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T17:57:30.237813] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-14T17:57:30.627822] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-14T17:57:30.958895] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-09-14T17:57:31.153363] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T17:57:31.758890] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-09-14T17:57:32.558849] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-09-14T17:57:32.812340] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T17:57:32.864258] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-14T17:57:33.358837] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-09-14T17:57:34.158917] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-09-14T17:57:34.464508] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-14T17:57:34.549290] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T17:57:34.550223] [INFO ] [REMOTE ] EQV: Full fetch complete (3390 records). [2025-09-14T17:57:34.550316] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-09-14T17:57:34.899937] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-09-14T17:57:34.900046] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-09-14T17:57:34.900170] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-09-14T17:57:34.900222] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-09-14T17:57:34.900586] [DEBUG] [LOCAL ] EQV: Trimmed 3390 records to 2163 (keeping 150 days of data) [2025-09-14T17:57:34.914533] [DEBUG] [LOCAL ] EQV: Primary data saved (2163 records). [2025-09-14T17:57:34.914619] [INFO ] [MAIN ] EQV: Full history saved. [2025-09-14T17:57:34.914752] [INFO ] [MAIN ] Update Progress: 761/2370 symbols completed. EQV took 11.4s. Estimated remaining: 2h 49m 58s. Rate: 9.5 symbols/min [2025-09-14T17:57:34.967965] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-09-14T17:57:35.101758] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:57:35.160364] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-14T17:57:35.181957] [DEBUG] [LOCAL ] ES: Loaded 23517 existing records from primary storage. [2025-09-14T17:57:35.182159] [INFO ] [MAIN ] ES: Loaded 23517 existing records. [2025-09-14T17:57:35.361031] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:57:35.361301] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-09-14T17:57:35.361368] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-09-14T17:57:35.362171] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-09-14T17:57:35.362239] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-09-14T17:57:35.713412] [INFO ] [REMOTE ] ES: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:57:35.758833] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-09-14T17:57:36.186873] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T17:57:36.558885] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-09-14T17:57:37.363948] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-09-14T17:57:37.380691] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-14T17:57:38.158908] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-09-14T17:57:38.311985] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-14T17:57:38.958861] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-09-14T17:57:39.281828] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T17:57:39.758828] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-09-14T17:57:39.854875] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T17:57:40.328947] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T17:57:40.558894] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-09-14T17:57:41.358922] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-09-14T17:57:41.965764] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-14T17:57:42.158787] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-09-14T17:57:42.286429] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T17:57:42.963603] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-09-14T17:57:42.972034] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T17:57:43.758904] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-09-14T17:57:44.246821] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-14T17:57:44.558840] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-09-14T17:57:44.695579] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T17:57:45.240127] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:57:45.245713] [INFO ] [REMOTE ] EQT: Full fetch complete (58361 records). [2025-09-14T17:57:45.245867] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-09-14T17:57:45.360169] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-09-14T17:57:45.644459] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-09-14T17:57:45.644683] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-09-14T17:57:45.645768] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-09-14T17:57:45.645969] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-09-14T17:57:45.671863] [DEBUG] [LOCAL ] EQT: Trimmed 58361 records to 40425 (keeping 150 days of data) [2025-09-14T17:57:45.673062] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-14T17:57:45.932210] [DEBUG] [LOCAL ] EQT: Primary data saved (40425 records). [2025-09-14T17:57:45.932373] [INFO ] [MAIN ] EQT: Full history saved. [2025-09-14T17:57:45.932470] [INFO ] [MAIN ] Update Progress: 762/2370 symbols completed. EQT took 22.4s. Estimated remaining: 2h 50m 1s. Rate: 9.5 symbols/min [2025-09-14T17:57:46.098899] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:57:46.111733] [DEBUG] [LOCAL ] ESAB: Loaded 11656 existing records from primary storage. [2025-09-14T17:57:46.111889] [INFO ] [MAIN ] ESAB: Loaded 11656 existing records. [2025-09-14T17:57:46.166285] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-09-14T17:57:46.292734] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:57:46.292993] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-09-14T17:57:46.293053] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-09-14T17:57:46.293533] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-09-14T17:57:46.293595] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-09-14T17:57:46.655068] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:57:46.717730] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T17:57:46.722733] [INFO ] [REMOTE ] ERO: Full fetch complete (44956 records). [2025-09-14T17:57:46.722850] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-09-14T17:57:46.963946] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-09-14T17:57:47.140957] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-09-14T17:57:47.141076] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-09-14T17:57:47.141799] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-09-14T17:57:47.141859] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-09-14T17:57:47.143051] [DEBUG] [LOCAL ] ERO: Trimmed 44956 records to 30409 (keeping 150 days of data) [2025-09-14T17:57:47.323107] [DEBUG] [LOCAL ] ERO: Primary data saved (30409 records). [2025-09-14T17:57:47.323282] [INFO ] [MAIN ] ERO: Full history saved. [2025-09-14T17:57:47.323401] [INFO ] [MAIN ] Update Progress: 763/2370 symbols completed. ERO took 23.8s. Estimated remaining: 2h 49m 45s. Rate: 9.5 symbols/min [2025-09-14T17:57:47.490903] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:57:47.500386] [DEBUG] [LOCAL ] ESE: Loaded 7782 existing records from primary storage. [2025-09-14T17:57:47.500518] [INFO ] [MAIN ] ESE: Loaded 7782 existing records. [2025-09-14T17:57:47.684750] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:57:47.684980] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-09-14T17:57:47.685048] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-09-14T17:57:47.685400] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-09-14T17:57:47.685485] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-09-14T17:57:47.766012] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-09-14T17:57:48.069154] [INFO ] [REMOTE ] ESE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:57:48.156390] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-14T17:57:48.558787] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-09-14T17:57:48.832157] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-14T17:57:48.943935] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T17:57:49.287761] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-14T17:57:49.358838] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-09-14T17:57:50.158912] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-09-14T17:57:50.590381] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-14T17:57:50.958917] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-09-14T17:57:51.165940] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-14T17:57:51.758857] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-09-14T17:57:52.558919] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-09-14T17:57:52.770382] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-14T17:57:52.865828] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-14T17:57:53.358874] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-09-14T17:57:54.120447] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T17:57:54.158783] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-09-14T17:57:54.903797] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-14T17:57:54.958794] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-09-14T17:57:55.758839] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-09-14T17:57:55.780781] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-14T17:57:55.789212] [INFO ] [REMOTE ] ERJ: Full fetch complete (55440 records). [2025-09-14T17:57:55.789367] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-09-14T17:57:56.182886] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-09-14T17:57:56.183062] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-09-14T17:57:56.183948] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-09-14T17:57:56.184018] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-09-14T17:57:56.185587] [DEBUG] [LOCAL ] ERJ: Trimmed 55440 records to 38090 (keeping 150 days of data) [2025-09-14T17:57:56.422115] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T17:57:56.467927] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:57:56.475667] [INFO ] [REMOTE ] ES: Full fetch complete (57157 records). [2025-09-14T17:57:56.476146] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-09-14T17:57:56.559580] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-09-14T17:57:56.591552] [DEBUG] [LOCAL ] ERJ: Primary data saved (38090 records). [2025-09-14T17:57:56.612797] [INFO ] [MAIN ] ERJ: Full history saved. [2025-09-14T17:57:56.685445] [INFO ] [MAIN ] Update Progress: 764/2370 symbols completed. ERJ took 33.2s. Estimated remaining: 2h 49m 45s. Rate: 9.5 symbols/min [2025-09-14T17:57:57.063707] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:57:57.063993] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-09-14T17:57:57.064622] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-09-14T17:57:57.065883] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-09-14T17:57:57.066067] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-09-14T17:57:57.067944] [DEBUG] [LOCAL ] ES: Trimmed 57157 records to 39539 (keeping 150 days of data) [2025-09-14T17:57:57.181785] [DEBUG] [LOCAL ] ESI: Loaded 22420 existing records from primary storage. [2025-09-14T17:57:57.185876] [INFO ] [MAIN ] ESI: Loaded 22420 existing records. [2025-09-14T17:57:57.376133] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-09-14T17:57:57.381986] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:57:57.386176] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-09-14T17:57:57.388803] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-09-14T17:57:57.393716] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-09-14T17:57:57.394054] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-09-14T17:57:57.887516] [INFO ] [REMOTE ] ESI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:57:57.888103] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-14T17:57:57.916546] [DEBUG] [LOCAL ] ES: Primary data saved (39539 records). [2025-09-14T17:57:57.916762] [INFO ] [MAIN ] ES: Full history saved. [2025-09-14T17:57:57.916951] [INFO ] [MAIN ] Update Progress: 765/2370 symbols completed. ES took 23.0s. Estimated remaining: 2h 49m 28s. Rate: 9.5 symbols/min [2025-09-14T17:57:58.091196] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:57:58.108803] [DEBUG] [LOCAL ] ESNT: Loaded 17075 existing records from primary storage. [2025-09-14T17:57:58.108977] [INFO ] [MAIN ] ESNT: Loaded 17075 existing records. [2025-09-14T17:57:58.171596] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-09-14T17:57:58.289545] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:57:58.289866] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-09-14T17:57:58.289942] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-14T17:57:58.290547] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-09-14T17:57:58.290611] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-09-14T17:57:58.651239] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:57:58.666031] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-14T17:57:58.958828] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-09-14T17:57:59.758805] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-09-14T17:57:59.829006] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T17:57:59.900986] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-14T17:58:00.558807] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-09-14T17:58:00.607388] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-14T17:58:01.358872] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-09-14T17:58:01.818239] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T17:58:02.158845] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-09-14T17:58:02.958851] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-09-14T17:58:02.984705] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-14T17:58:03.308033] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T17:58:03.758842] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-09-14T17:58:04.321109] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-14T17:58:04.558896] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-09-14T17:58:04.984168] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-14T17:58:05.358836] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-09-14T17:58:06.109535] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T17:58:06.158780] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-09-14T17:58:06.904902] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T17:58:06.958783] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-09-14T17:58:07.758831] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-09-14T17:58:07.884280] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-14T17:58:08.098376] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-14T17:58:08.101556] [INFO ] [REMOTE ] ESAB: Full fetch complete (27403 records). [2025-09-14T17:58:08.101687] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-09-14T17:58:08.480776] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-09-14T17:58:08.480919] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-09-14T17:58:08.482161] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-09-14T17:58:08.482226] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-09-14T17:58:08.483521] [DEBUG] [LOCAL ] ESAB: Trimmed 27403 records to 18378 (keeping 150 days of data) [2025-09-14T17:58:08.573531] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-09-14T17:58:08.610585] [DEBUG] [LOCAL ] ESAB: Primary data saved (18378 records). [2025-09-14T17:58:08.610805] [INFO ] [MAIN ] ESAB: Full history saved. [2025-09-14T17:58:08.610946] [INFO ] [MAIN ] Update Progress: 766/2370 symbols completed. ESAB took 22.7s. Estimated remaining: 2h 49m 30s. Rate: 9.5 symbols/min [2025-09-14T17:58:08.786881] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:58:08.819974] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T17:58:08.844723] [DEBUG] [LOCAL ] ESRT: Loaded 20999 existing records from primary storage. [2025-09-14T17:58:08.844916] [INFO ] [MAIN ] ESRT: Loaded 20999 existing records. [2025-09-14T17:58:09.026415] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:58:09.026817] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-09-14T17:58:09.026889] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-09-14T17:58:09.027494] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-09-14T17:58:09.027564] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-09-14T17:58:09.363932] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-09-14T17:58:09.392465] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:58:10.158877] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-09-14T17:58:10.269724] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-14T17:58:10.703168] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T17:58:10.705511] [INFO ] [REMOTE ] ESE: Full fetch complete (17923 records). [2025-09-14T17:58:10.705607] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-09-14T17:58:10.963968] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-09-14T17:58:11.074713] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-09-14T17:58:11.074854] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-09-14T17:58:11.075677] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-09-14T17:58:11.075744] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-09-14T17:58:11.076453] [DEBUG] [LOCAL ] ESE: Trimmed 17923 records to 12305 (keeping 150 days of data) [2025-09-14T17:58:11.162628] [DEBUG] [LOCAL ] ESE: Primary data saved (12305 records). [2025-09-14T17:58:11.162943] [INFO ] [MAIN ] ESE: Full history saved. [2025-09-14T17:58:11.163340] [INFO ] [MAIN ] Update Progress: 767/2370 symbols completed. ESE took 23.8s. Estimated remaining: 2h 49m 16s. Rate: 9.5 symbols/min [2025-09-14T17:58:11.342631] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:58:11.377849] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-14T17:58:11.395158] [DEBUG] [LOCAL ] ESS: Loaded 13431 existing records from primary storage. [2025-09-14T17:58:11.395384] [INFO ] [MAIN ] ESS: Loaded 13431 existing records. [2025-09-14T17:58:11.581983] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:58:11.582299] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-09-14T17:58:11.582365] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-09-14T17:58:11.582901] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-09-14T17:58:11.582966] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-09-14T17:58:11.766759] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-09-14T17:58:11.935533] [INFO ] [REMOTE ] ESS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:58:12.542506] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T17:58:12.558777] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-09-14T17:58:13.363598] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-09-14T17:58:13.368741] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-14T17:58:13.757974] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-14T17:58:14.158819] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-09-14T17:58:14.958801] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-09-14T17:58:15.021536] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-14T17:58:15.758818] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-09-14T17:58:15.897252] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-14T17:58:16.393618] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T17:58:16.558799] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-09-14T17:58:17.358829] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-09-14T17:58:17.476314] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T17:58:17.752431] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T17:58:18.158816] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-09-14T17:58:18.843079] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T17:58:18.849899] [INFO ] [REMOTE ] ESI: Full fetch complete (55149 records). [2025-09-14T17:58:18.850173] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-09-14T17:58:18.962668] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-09-14T17:58:19.272244] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-09-14T17:58:19.272581] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-09-14T17:58:19.273849] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-09-14T17:58:19.274228] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-09-14T17:58:19.306795] [DEBUG] [LOCAL ] ESI: Trimmed 55149 records to 37839 (keeping 150 days of data) [2025-09-14T17:58:19.309053] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T17:58:19.601552] [DEBUG] [LOCAL ] ESI: Primary data saved (37839 records). [2025-09-14T17:58:19.601809] [INFO ] [MAIN ] ESI: Full history saved. [2025-09-14T17:58:19.601979] [INFO ] [MAIN ] Update Progress: 768/2370 symbols completed. ESI took 22.9s. Estimated remaining: 2h 49m 14s. Rate: 9.5 symbols/min [2025-09-14T17:58:19.765274] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-09-14T17:58:19.776817] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:58:19.803526] [DEBUG] [LOCAL ] ESTC: Loaded 22442 existing records from primary storage. [2025-09-14T17:58:19.803816] [INFO ] [MAIN ] ESTC: Loaded 22442 existing records. [2025-09-14T17:58:19.994117] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:58:19.994485] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-09-14T17:58:19.994552] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-09-14T17:58:19.995250] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-09-14T17:58:19.995329] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-09-14T17:58:20.367114] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:58:20.392402] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-14T17:58:20.558869] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-09-14T17:58:21.363914] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-09-14T17:58:21.367603] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-14T17:58:22.166366] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-09-14T17:58:22.193072] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-14T17:58:22.939309] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T17:58:22.958789] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-09-14T17:58:23.438773] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-14T17:58:23.758864] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-09-14T17:58:24.558860] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-09-14T17:58:24.826851] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T17:58:25.149430] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T17:58:25.358889] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-09-14T17:58:25.933856] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-14T17:58:26.158842] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-09-14T17:58:26.958890] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-09-14T17:58:27.208385] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T17:58:27.758858] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-09-14T17:58:27.823936] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T17:58:28.385209] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-14T17:58:28.558822] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-09-14T17:58:29.301160] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T17:58:29.358809] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-09-14T17:58:29.950368] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-14T17:58:29.955083] [INFO ] [REMOTE ] ESRT: Full fetch complete (50067 records). [2025-09-14T17:58:29.955213] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-09-14T17:58:30.167564] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-09-14T17:58:30.348185] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-09-14T17:58:30.348296] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-09-14T17:58:30.349062] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-09-14T17:58:30.349139] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-09-14T17:58:30.350503] [DEBUG] [LOCAL ] ESRT: Trimmed 50067 records to 34810 (keeping 150 days of data) [2025-09-14T17:58:30.560418] [DEBUG] [LOCAL ] ESRT: Primary data saved (34810 records). [2025-09-14T17:58:30.560591] [INFO ] [MAIN ] ESRT: Full history saved. [2025-09-14T17:58:30.560714] [INFO ] [MAIN ] Update Progress: 769/2370 symbols completed. ESRT took 21.9s. Estimated remaining: 2h 49m 17s. Rate: 9.5 symbols/min [2025-09-14T17:58:30.731156] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:58:30.755149] [DEBUG] [LOCAL ] ET: Loaded 24152 existing records from primary storage. [2025-09-14T17:58:30.755325] [INFO ] [MAIN ] ET: Loaded 24152 existing records. [2025-09-14T17:58:30.928380] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:58:30.928620] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-09-14T17:58:30.928703] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-09-14T17:58:30.929471] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-09-14T17:58:30.929542] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-09-14T17:58:30.971665] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-09-14T17:58:31.322113] [INFO ] [REMOTE ] ET: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:58:31.358634] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-14T17:58:31.540003] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T17:58:31.758833] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-09-14T17:58:32.079215] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-14T17:58:32.083386] [INFO ] [REMOTE ] ESNT: Full fetch complete (42814 records). [2025-09-14T17:58:32.083526] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-09-14T17:58:32.484697] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-09-14T17:58:32.484848] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-09-14T17:58:32.485931] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-09-14T17:58:32.486104] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-09-14T17:58:32.496364] [DEBUG] [LOCAL ] ESNT: Trimmed 42814 records to 28299 (keeping 150 days of data) [2025-09-14T17:58:32.509070] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T17:58:32.570233] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-09-14T17:58:32.696428] [DEBUG] [LOCAL ] ESNT: Primary data saved (28299 records). [2025-09-14T17:58:32.696599] [INFO ] [MAIN ] ESNT: Full history saved. [2025-09-14T17:58:32.696764] [INFO ] [MAIN ] Update Progress: 770/2370 symbols completed. ESNT took 34.8s. Estimated remaining: 2h 49m 2s. Rate: 9.5 symbols/min [2025-09-14T17:58:32.862374] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:58:32.869501] [DEBUG] [LOCAL ] ETB: Loaded 4590 existing records from primary storage. [2025-09-14T17:58:32.869660] [INFO ] [MAIN ] ETB: Loaded 4590 existing records. [2025-09-14T17:58:33.042995] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:58:33.043239] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-09-14T17:58:33.043313] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-09-14T17:58:33.043690] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-09-14T17:58:33.043764] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-09-14T17:58:33.363887] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-09-14T17:58:33.389999] [INFO ] [REMOTE ] ETB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:58:34.158830] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-09-14T17:58:34.791471] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-14T17:58:34.827901] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-14T17:58:34.958835] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-09-14T17:58:35.758839] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-09-14T17:58:35.925448] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T17:58:36.436282] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-14T17:58:36.558807] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-09-14T17:58:37.284671] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-14T17:58:37.358785] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-09-14T17:58:37.533576] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-14T17:58:38.158890] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-09-14T17:58:38.707515] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T17:58:38.710889] [INFO ] [REMOTE ] ESS: Full fetch complete (32692 records). [2025-09-14T17:58:38.711069] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-09-14T17:58:38.963942] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-09-14T17:58:39.086755] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-09-14T17:58:39.086881] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-09-14T17:58:39.087512] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-09-14T17:58:39.087579] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-09-14T17:58:39.088609] [DEBUG] [LOCAL ] ESS: Trimmed 32692 records to 22486 (keeping 150 days of data) [2025-09-14T17:58:39.240484] [DEBUG] [LOCAL ] ESS: Primary data saved (22486 records). [2025-09-14T17:58:39.240673] [INFO ] [MAIN ] ESS: Full history saved. [2025-09-14T17:58:39.240815] [INFO ] [MAIN ] Update Progress: 771/2370 symbols completed. ESS took 28.1s. Estimated remaining: 2h 48m 56s. Rate: 9.5 symbols/min [2025-09-14T17:58:39.410854] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:58:39.423394] [DEBUG] [LOCAL ] ETD: Loaded 11853 existing records from primary storage. [2025-09-14T17:58:39.423541] [INFO ] [MAIN ] ETD: Loaded 11853 existing records. [2025-09-14T17:58:39.609673] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:58:39.626849] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-09-14T17:58:39.626934] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-09-14T17:58:39.627527] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-09-14T17:58:39.628770] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-14T17:58:39.628863] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-09-14T17:58:39.763872] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-09-14T17:58:39.993206] [INFO ] [REMOTE ] ETD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:58:40.566352] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-09-14T17:58:40.585248] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-14T17:58:40.873270] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-14T17:58:41.358824] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-09-14T17:58:42.119476] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-14T17:58:42.158790] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-09-14T17:58:42.854174] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-14T17:58:42.938910] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-14T17:58:42.958828] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-09-14T17:58:43.758948] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-09-14T17:58:43.802888] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-14T17:58:44.558864] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-09-14T17:58:45.358866] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-09-14T17:58:45.931695] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-14T17:58:45.944179] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-14T17:58:46.158832] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-09-14T17:58:46.184605] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-14T17:58:46.190187] [INFO ] [REMOTE ] ESTC: Full fetch complete (54502 records). [2025-09-14T17:58:46.190308] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-09-14T17:58:46.566793] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-09-14T17:58:46.566920] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-09-14T17:58:46.567720] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-09-14T17:58:46.567784] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-09-14T17:58:46.569112] [DEBUG] [LOCAL ] ESTC: Trimmed 54502 records to 37899 (keeping 150 days of data) [2025-09-14T17:58:46.806059] [DEBUG] [LOCAL ] ESTC: Primary data saved (37899 records). [2025-09-14T17:58:46.806236] [INFO ] [MAIN ] ESTC: Full history saved. [2025-09-14T17:58:46.806346] [INFO ] [MAIN ] Update Progress: 772/2370 symbols completed. ESTC took 27.2s. Estimated remaining: 2h 48m 53s. Rate: 9.5 symbols/min [2025-09-14T17:58:46.964107] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-09-14T17:58:46.996867] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:58:47.009235] [DEBUG] [LOCAL ] ETG: Loaded 6855 existing records from primary storage. [2025-09-14T17:58:47.009874] [INFO ] [MAIN ] ETG: Loaded 6855 existing records. [2025-09-14T17:58:47.199195] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:58:47.199552] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-09-14T17:58:47.199661] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-09-14T17:58:47.200104] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-09-14T17:58:47.200190] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-09-14T17:58:47.555925] [INFO ] [REMOTE ] ETG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:58:47.683331] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T17:58:47.684767] [INFO ] [REMOTE ] ETB: Full fetch complete (13958 records). [2025-09-14T17:58:47.684852] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-09-14T17:58:47.764041] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-09-14T17:58:48.055282] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-09-14T17:58:48.055417] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-09-14T17:58:48.055847] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-09-14T17:58:48.055910] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-09-14T17:58:48.056504] [DEBUG] [LOCAL ] ETB: Trimmed 13958 records to 8298 (keeping 150 days of data) [2025-09-14T17:58:48.108785] [DEBUG] [LOCAL ] ETB: Primary data saved (8298 records). [2025-09-14T17:58:48.108933] [INFO ] [MAIN ] ETB: Full history saved. [2025-09-14T17:58:48.109034] [INFO ] [MAIN ] Update Progress: 773/2370 symbols completed. ETB took 15.4s. Estimated remaining: 2h 48m 36s. Rate: 9.5 symbols/min [2025-09-14T17:58:48.279085] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:58:48.289358] [DEBUG] [LOCAL ] ETJ: Loaded 7043 existing records from primary storage. [2025-09-14T17:58:48.289511] [INFO ] [MAIN ] ETJ: Loaded 7043 existing records. [2025-09-14T17:58:48.468397] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:58:48.469183] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-09-14T17:58:48.469304] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-09-14T17:58:48.469727] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-09-14T17:58:48.469884] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-09-14T17:58:48.560410] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-09-14T17:58:48.872568] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:58:48.869171] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-09-14T17:58:48.895057] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-14T17:58:49.358825] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-09-14T17:58:49.650566] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T17:58:50.158866] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-09-14T17:58:50.958828] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-09-14T17:58:51.276703] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T17:58:51.635578] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-14T17:58:51.758830] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-09-14T17:58:51.844601] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T17:58:52.558909] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-09-14T17:58:52.881964] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-14T17:58:53.358835] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-09-14T17:58:53.803623] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-14T17:58:54.158887] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-09-14T17:58:54.958900] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-09-14T17:58:55.281328] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T17:58:55.370220] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-14T17:58:55.376194] [INFO ] [REMOTE ] ET: Full fetch complete (58470 records). [2025-09-14T17:58:55.376405] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-09-14T17:58:55.766311] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-09-14T17:58:55.768552] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-09-14T17:58:55.768746] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-09-14T17:58:55.770122] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-09-14T17:58:55.770298] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-09-14T17:58:55.772239] [DEBUG] [LOCAL ] ET: Trimmed 58470 records to 40530 (keeping 150 days of data) [2025-09-14T17:58:56.040278] [DEBUG] [LOCAL ] ET: Primary data saved (40530 records). [2025-09-14T17:58:56.040438] [INFO ] [MAIN ] ET: Full history saved. [2025-09-14T17:58:56.040543] [INFO ] [MAIN ] Update Progress: 774/2370 symbols completed. ET took 25.5s. Estimated remaining: 2h 48m 33s. Rate: 9.5 symbols/min [2025-09-14T17:58:56.217290] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:58:56.241268] [DEBUG] [LOCAL ] ETN: Loaded 23515 existing records from primary storage. [2025-09-14T17:58:56.241455] [INFO ] [MAIN ] ETN: Loaded 23515 existing records. [2025-09-14T17:58:56.420130] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:58:56.420509] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-09-14T17:58:56.420737] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-09-14T17:58:56.437693] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-09-14T17:58:56.437845] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-09-14T17:58:56.471366] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T17:58:56.563898] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-09-14T17:58:56.800929] [INFO ] [REMOTE ] ETN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:58:57.002593] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-14T17:58:57.358865] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-09-14T17:58:57.424978] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T17:58:58.158849] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-09-14T17:58:58.744521] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T17:58:58.958839] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-09-14T17:58:59.295744] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-14T17:58:59.758844] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-09-14T17:58:59.892194] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T17:59:00.558851] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-09-14T17:59:00.718184] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-14T17:59:01.358788] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-09-14T17:59:01.748303] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-14T17:59:02.158902] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-09-14T17:59:02.376815] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-14T17:59:02.879270] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-14T17:59:02.958842] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-09-14T17:59:03.758806] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-09-14T17:59:03.872274] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T17:59:04.558835] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-09-14T17:59:05.078401] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-14T17:59:05.327880] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T17:59:05.329858] [INFO ] [REMOTE ] ETG: Full fetch complete (18440 records). [2025-09-14T17:59:05.329970] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-09-14T17:59:05.363892] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-09-14T17:59:05.702254] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-09-14T17:59:05.702361] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-09-14T17:59:05.702787] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-09-14T17:59:05.702847] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-09-14T17:59:05.703413] [DEBUG] [LOCAL ] ETG: Trimmed 18440 records to 12352 (keeping 150 days of data) [2025-09-14T17:59:05.780732] [DEBUG] [LOCAL ] ETG: Primary data saved (12352 records). [2025-09-14T17:59:05.780903] [INFO ] [MAIN ] ETG: Full history saved. [2025-09-14T17:59:05.781003] [INFO ] [MAIN ] Update Progress: 775/2370 symbols completed. ETG took 19.0s. Estimated remaining: 2h 48m 34s. Rate: 9.5 symbols/min [2025-09-14T17:59:05.956481] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:59:05.961051] [DEBUG] [LOCAL ] ETO: Loaded 2778 existing records from primary storage. [2025-09-14T17:59:05.961195] [INFO ] [MAIN ] ETO: Loaded 2778 existing records. [2025-09-14T17:59:06.137133] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:59:06.137409] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-09-14T17:59:06.137471] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-09-14T17:59:06.137779] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-09-14T17:59:06.137852] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-09-14T17:59:06.168465] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-09-14T17:59:06.495073] [INFO ] [REMOTE ] ETO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:59:06.637423] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T17:59:06.640722] [INFO ] [REMOTE ] ETD: Full fetch complete (29547 records). [2025-09-14T17:59:06.640839] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-09-14T17:59:06.971127] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-09-14T17:59:07.021142] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-09-14T17:59:07.021258] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-09-14T17:59:07.022208] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-09-14T17:59:07.022475] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-09-14T17:59:07.023687] [DEBUG] [LOCAL ] ETD: Trimmed 29547 records to 20670 (keeping 150 days of data) [2025-09-14T17:59:07.164404] [DEBUG] [LOCAL ] ETD: Primary data saved (20670 records). [2025-09-14T17:59:07.164572] [INFO ] [MAIN ] ETD: Full history saved. [2025-09-14T17:59:07.164689] [INFO ] [MAIN ] Update Progress: 776/2370 symbols completed. ETD took 27.9s. Estimated remaining: 2h 48m 17s. Rate: 9.5 symbols/min [2025-09-14T17:59:07.334687] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:59:07.358071] [DEBUG] [LOCAL ] ETR: Loaded 23843 existing records from primary storage. [2025-09-14T17:59:07.358272] [INFO ] [MAIN ] ETR: Loaded 23843 existing records. [2025-09-14T17:59:07.545220] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:59:07.545564] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-09-14T17:59:07.545633] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-09-14T17:59:07.546439] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-09-14T17:59:07.546544] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-09-14T17:59:07.765679] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-09-14T17:59:07.756595] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-14T17:59:07.953171] [INFO ] [REMOTE ] ETR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:59:08.129373] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T17:59:08.501034] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-14T17:59:08.558845] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-09-14T17:59:09.260885] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-14T17:59:09.358901] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-09-14T17:59:10.158835] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-09-14T17:59:10.344667] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T17:59:10.958839] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-09-14T17:59:10.982125] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-14T17:59:11.758843] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-09-14T17:59:12.558820] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-09-14T17:59:13.075385] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-14T17:59:13.358843] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-09-14T17:59:13.384475] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T17:59:13.487805] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T17:59:14.158827] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-09-14T17:59:14.865910] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:59:14.867962] [INFO ] [REMOTE ] ETJ: Full fetch complete (18594 records). [2025-09-14T17:59:14.868047] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-09-14T17:59:14.964997] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-09-14T17:59:15.236837] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-09-14T17:59:15.236945] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-09-14T17:59:15.237468] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-09-14T17:59:15.237538] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-09-14T17:59:15.238177] [DEBUG] [LOCAL ] ETJ: Trimmed 18594 records to 11407 (keeping 150 days of data) [2025-09-14T17:59:15.306233] [DEBUG] [LOCAL ] ETJ: Primary data saved (11407 records). [2025-09-14T17:59:15.306406] [INFO ] [MAIN ] ETJ: Full history saved. [2025-09-14T17:59:15.306510] [INFO ] [MAIN ] Update Progress: 777/2370 symbols completed. ETJ took 27.2s. Estimated remaining: 2h 48m 14s. Rate: 9.5 symbols/min [2025-09-14T17:59:15.480195] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:59:15.490962] [DEBUG] [LOCAL ] ETV: Loaded 8956 existing records from primary storage. [2025-09-14T17:59:15.491111] [INFO ] [MAIN ] ETV: Loaded 8956 existing records. [2025-09-14T17:59:15.684048] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:59:15.684536] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-09-14T17:59:15.684609] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-09-14T17:59:15.685337] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-09-14T17:59:15.685735] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-09-14T17:59:15.759357] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-09-14T17:59:15.992523] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-14T17:59:16.108589] [INFO ] [REMOTE ] ETV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:59:16.539694] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-14T17:59:16.558765] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-09-14T17:59:16.824234] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T17:59:17.091256] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-14T17:59:17.358857] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-09-14T17:59:18.158833] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-09-14T17:59:18.958801] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-09-14T17:59:19.335365] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T17:59:19.375386] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-14T17:59:19.639770] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-14T17:59:19.758857] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-09-14T17:59:20.558840] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-09-14T17:59:21.154882] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T17:59:21.156092] [INFO ] [REMOTE ] ETO: Full fetch complete (7168 records). [2025-09-14T17:59:21.156177] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-09-14T17:59:21.363893] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-09-14T17:59:21.512751] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-09-14T17:59:21.512934] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-09-14T17:59:21.513228] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-09-14T17:59:21.513347] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-09-14T17:59:21.514029] [DEBUG] [LOCAL ] ETO: Trimmed 7168 records to 4919 (keeping 150 days of data) [2025-09-14T17:59:21.545570] [DEBUG] [LOCAL ] ETO: Primary data saved (4919 records). [2025-09-14T17:59:21.545721] [INFO ] [MAIN ] ETO: Full history saved. [2025-09-14T17:59:21.545818] [INFO ] [MAIN ] Update Progress: 778/2370 symbols completed. ETO took 15.8s. Estimated remaining: 2h 48m 8s. Rate: 9.5 symbols/min [2025-09-14T17:59:21.723622] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:59:21.763345] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-14T17:59:21.779789] [DEBUG] [LOCAL ] ETW: Loaded 10589 existing records from primary storage. [2025-09-14T17:59:21.780275] [INFO ] [MAIN ] ETW: Loaded 10589 existing records. [2025-09-14T17:59:21.954419] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:59:21.954716] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-09-14T17:59:21.954775] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-09-14T17:59:21.955248] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-09-14T17:59:21.955308] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-09-14T17:59:22.164114] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-09-14T17:59:22.313873] [INFO ] [REMOTE ] ETW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:59:22.958776] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-09-14T17:59:23.510759] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-14T17:59:23.758882] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-09-14T17:59:24.112458] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-14T17:59:24.205171] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-14T17:59:24.558870] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-09-14T17:59:25.358804] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-09-14T17:59:25.481047] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-14T17:59:25.610876] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-14T17:59:26.158864] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-09-14T17:59:26.958838] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-09-14T17:59:27.153711] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-14T17:59:27.221691] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-14T17:59:27.758832] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-09-14T17:59:28.558843] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-09-14T17:59:29.197858] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-14T17:59:29.358794] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-09-14T17:59:29.627180] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-14T17:59:29.662162] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-14T17:59:29.667599] [INFO ] [REMOTE ] ETN: Full fetch complete (57560 records). [2025-09-14T17:59:29.667762] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-09-14T17:59:30.028293] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T17:59:30.080719] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-09-14T17:59:30.080813] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-09-14T17:59:30.081748] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-09-14T17:59:30.081830] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-09-14T17:59:30.083033] [DEBUG] [LOCAL ] ETN: Trimmed 57560 records to 39663 (keeping 150 days of data) [2025-09-14T17:59:30.177167] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-09-14T17:59:30.345914] [DEBUG] [LOCAL ] ETN: Primary data saved (39663 records). [2025-09-14T17:59:30.346096] [INFO ] [MAIN ] ETN: Full history saved. [2025-09-14T17:59:30.346204] [INFO ] [MAIN ] Update Progress: 779/2370 symbols completed. ETN took 34.3s. Estimated remaining: 2h 48m 7s. Rate: 9.5 symbols/min [2025-09-14T17:59:30.520556] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:59:30.525120] [DEBUG] [LOCAL ] ETX: Loaded 2927 existing records from primary storage. [2025-09-14T17:59:30.525217] [INFO ] [MAIN ] ETX: Loaded 2927 existing records. [2025-09-14T17:59:30.705320] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:59:30.705627] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-09-14T17:59:30.705712] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-09-14T17:59:30.706089] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-09-14T17:59:30.706152] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-09-14T17:59:30.965082] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-09-14T17:59:31.072409] [INFO ] [REMOTE ] ETX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:59:31.096024] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-14T17:59:31.758894] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-09-14T17:59:32.558873] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-09-14T17:59:32.666226] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T17:59:32.905158] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-14T17:59:32.948072] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-14T17:59:33.358881] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-09-14T17:59:34.158863] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-09-14T17:59:34.609735] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-14T17:59:34.652598] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-14T17:59:34.958864] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-09-14T17:59:35.502094] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-14T17:59:35.758841] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-09-14T17:59:36.387675] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-14T17:59:36.558856] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-09-14T17:59:37.172278] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-14T17:59:37.358834] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-09-14T17:59:38.158873] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-09-14T17:59:38.442743] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-14T17:59:38.777871] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-14T17:59:38.958852] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-09-14T17:59:39.758871] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-09-14T17:59:40.255272] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-14T17:59:40.469167] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T17:59:40.474605] [INFO ] [REMOTE ] ETR: Full fetch complete (57931 records). [2025-09-14T17:59:40.474762] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-09-14T17:59:40.564110] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-09-14T17:59:40.867389] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-09-14T17:59:40.867508] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-09-14T17:59:40.868327] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-09-14T17:59:40.868388] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-09-14T17:59:40.869782] [DEBUG] [LOCAL ] ETR: Trimmed 57931 records to 40047 (keeping 150 days of data) [2025-09-14T17:59:41.142411] [DEBUG] [LOCAL ] ETR: Primary data saved (40047 records). [2025-09-14T17:59:41.142568] [INFO ] [MAIN ] ETR: Full history saved. [2025-09-14T17:59:41.142711] [INFO ] [MAIN ] Update Progress: 780/2370 symbols completed. ETR took 34.0s. Estimated remaining: 2h 48m 9s. Rate: 9.5 symbols/min [2025-09-14T17:59:41.313096] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:59:41.324221] [DEBUG] [LOCAL ] ETY: Loaded 9571 existing records from primary storage. [2025-09-14T17:59:41.324362] [INFO ] [MAIN ] ETY: Loaded 9571 existing records. [2025-09-14T17:59:41.366780] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-09-14T17:59:41.536902] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:59:41.537250] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-09-14T17:59:41.537341] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-09-14T17:59:41.542673] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-09-14T17:59:41.542874] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T17:59:41.543010] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-09-14T17:59:41.560723] [INFO ] [REMOTE ] ETV: Full fetch complete (23272 records). [2025-09-14T17:59:41.601135] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-09-14T17:59:42.197940] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-09-14T17:59:42.203228] [INFO ] [REMOTE ] ETY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:59:42.287521] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-09-14T17:59:42.288340] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-14T17:59:42.288400] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-09-14T17:59:42.291368] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-09-14T17:59:42.291768] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-09-14T17:59:42.292418] [DEBUG] [LOCAL ] ETV: Trimmed 23272 records to 15357 (keeping 150 days of data) [2025-09-14T17:59:42.385122] [DEBUG] [LOCAL ] ETV: Primary data saved (15357 records). [2025-09-14T17:59:42.385274] [INFO ] [MAIN ] ETV: Full history saved. [2025-09-14T17:59:42.385383] [INFO ] [MAIN ] Update Progress: 781/2370 symbols completed. ETV took 27.1s. Estimated remaining: 2h 47m 53s. Rate: 9.5 symbols/min [2025-09-14T17:59:42.557075] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:59:42.566312] [DEBUG] [LOCAL ] EVC: Loaded 8122 existing records from primary storage. [2025-09-14T17:59:42.566451] [INFO ] [MAIN ] EVC: Loaded 8122 existing records. [2025-09-14T17:59:42.744986] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:59:42.745247] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-09-14T17:59:42.745308] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-09-14T17:59:42.745618] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-09-14T17:59:42.745717] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-09-14T17:59:42.964048] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-09-14T17:59:43.106655] [INFO ] [REMOTE ] EVC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:59:43.527623] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-14T17:59:43.758865] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-09-14T17:59:44.232157] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-14T17:59:44.558802] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-09-14T17:59:44.871371] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-14T17:59:45.358837] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-09-14T17:59:45.486193] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T17:59:45.955520] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T17:59:45.956849] [INFO ] [REMOTE ] ETX: Full fetch complete (5264 records). [2025-09-14T17:59:45.956939] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-09-14T17:59:46.166493] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-09-14T17:59:46.318460] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-09-14T17:59:46.318578] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-09-14T17:59:46.318768] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-09-14T17:59:46.318824] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-09-14T17:59:46.319242] [DEBUG] [LOCAL ] ETX: Trimmed 5264 records to 4115 (keeping 150 days of data) [2025-09-14T17:59:46.350813] [DEBUG] [LOCAL ] ETX: Primary data saved (4115 records). [2025-09-14T17:59:46.351079] [INFO ] [MAIN ] ETX: Full history saved. [2025-09-14T17:59:46.351230] [INFO ] [MAIN ] Update Progress: 782/2370 symbols completed. ETX took 16.0s. Estimated remaining: 2h 47m 41s. Rate: 9.5 symbols/min [2025-09-14T17:59:46.521962] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:59:46.542794] [DEBUG] [LOCAL ] EVEX: Loaded 17036 existing records from primary storage. [2025-09-14T17:59:46.542975] [INFO ] [MAIN ] EVEX: Loaded 17036 existing records. [2025-09-14T17:59:46.719682] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:59:46.719974] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-09-14T17:59:46.720045] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-09-14T17:59:46.720551] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-09-14T17:59:46.720633] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-09-14T17:59:46.964108] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-09-14T17:59:47.077483] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:59:47.576062] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-14T17:59:47.758827] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-09-14T17:59:48.309709] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T17:59:48.558833] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-09-14T17:59:48.985268] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-14T17:59:49.358838] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-09-14T17:59:49.683568] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T17:59:50.158852] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-09-14T17:59:50.277504] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-14T17:59:50.958837] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-09-14T17:59:51.303567] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-14T17:59:51.758856] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-09-14T17:59:52.091535] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-14T17:59:52.558846] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-09-14T17:59:52.849003] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-14T17:59:52.852029] [INFO ] [REMOTE ] ETW: Full fetch complete (27290 records). [2025-09-14T17:59:52.852126] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-09-14T17:59:53.218863] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-09-14T17:59:53.218993] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-09-14T17:59:53.219548] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-09-14T17:59:53.219602] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-09-14T17:59:53.220447] [DEBUG] [LOCAL ] ETW: Trimmed 27290 records to 18395 (keeping 150 days of data) [2025-09-14T17:59:53.334584] [DEBUG] [LOCAL ] ETW: Primary data saved (18395 records). [2025-09-14T17:59:53.334762] [INFO ] [MAIN ] ETW: Full history saved. [2025-09-14T17:59:53.334863] [INFO ] [MAIN ] Update Progress: 783/2370 symbols completed. ETW took 31.8s. Estimated remaining: 2h 47m 36s. Rate: 9.5 symbols/min [2025-09-14T17:59:53.365306] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-09-14T17:59:53.520851] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T17:59:53.528039] [DEBUG] [LOCAL ] EVF: Loaded 4415 existing records from primary storage. [2025-09-14T17:59:53.528192] [INFO ] [MAIN ] EVF: Loaded 4415 existing records. [2025-09-14T17:59:53.715092] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T17:59:53.726902] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-09-14T17:59:53.727444] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-14T17:59:53.727669] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-09-14T17:59:53.732443] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-09-14T17:59:53.732517] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-09-14T17:59:54.123500] [INFO ] [REMOTE ] EVF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T17:59:54.158899] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-09-14T17:59:54.429529] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-14T17:59:54.804820] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-14T17:59:54.958900] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-09-14T17:59:55.758830] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-09-14T17:59:55.782115] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T17:59:56.558844] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-09-14T17:59:57.096465] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-14T17:59:57.268276] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-14T17:59:57.358787] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-09-14T17:59:58.158884] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-09-14T17:59:58.759895] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-14T17:59:58.958797] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-09-14T17:59:59.011040] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-14T17:59:59.758811] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-09-14T17:59:59.822447] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-14T18:00:00.558895] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-09-14T18:00:00.997869] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-14T18:00:01.358929] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-09-14T18:00:01.462130] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T18:00:02.158890] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-09-14T18:00:02.958855] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-09-14T18:00:03.758830] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-09-14T18:00:03.847329] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-14T18:00:04.558831] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-09-14T18:00:05.137786] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (2.98 seconds). [2025-09-14T18:00:05.358867] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-09-14T18:00:05.621951] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-14T18:00:05.626930] [INFO ] [REMOTE ] EVC: Full fetch complete (22107 records). [2025-09-14T18:00:05.627227] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-09-14T18:00:06.003937] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-14T18:00:06.052972] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-09-14T18:00:06.053172] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-09-14T18:00:06.053832] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-09-14T18:00:06.054055] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-09-14T18:00:06.055029] [DEBUG] [LOCAL ] EVC: Trimmed 22107 records to 14021 (keeping 150 days of data) [2025-09-14T18:00:06.143350] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (3.18 seconds). [2025-09-14T18:00:06.159093] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-09-14T18:00:06.180954] [DEBUG] [LOCAL ] EVC: Primary data saved (14021 records). [2025-09-14T18:00:06.181206] [INFO ] [MAIN ] EVC: Full history saved. [2025-09-14T18:00:06.181431] [INFO ] [MAIN ] Update Progress: 784/2370 symbols completed. EVC took 23.8s. Estimated remaining: 2h 47m 43s. Rate: 9.5 symbols/min [2025-09-14T18:00:06.355367] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:00:06.360976] [DEBUG] [LOCAL ] EVG: Loaded 2611 existing records from primary storage. [2025-09-14T18:00:06.361121] [INFO ] [MAIN ] EVG: Loaded 2611 existing records. [2025-09-14T18:00:06.552436] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:00:06.552812] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-09-14T18:00:06.552890] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-09-14T18:00:06.553176] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-09-14T18:00:06.553237] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-09-14T18:00:06.863281] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T18:00:06.952946] [INFO ] [REMOTE ] EVG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:00:06.958794] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-09-14T18:00:07.758843] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-09-14T18:00:07.963706] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-14T18:00:08.078795] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-14T18:00:08.558853] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-09-14T18:00:09.090739] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-14T18:00:09.358844] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-09-14T18:00:09.863730] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-14T18:00:09.868727] [INFO ] [REMOTE ] EVEX: Full fetch complete (30488 records). [2025-09-14T18:00:09.868872] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-09-14T18:00:10.162471] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-09-14T18:00:10.252152] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-09-14T18:00:10.252261] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-09-14T18:00:10.252853] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-09-14T18:00:10.252911] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-09-14T18:00:10.253825] [DEBUG] [LOCAL ] EVEX: Trimmed 30488 records to 22451 (keeping 150 days of data) [2025-09-14T18:00:10.366257] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T18:00:10.402632] [DEBUG] [LOCAL ] EVEX: Primary data saved (22451 records). [2025-09-14T18:00:10.402836] [INFO ] [MAIN ] EVEX: Full history saved. [2025-09-14T18:00:10.402977] [INFO ] [MAIN ] Update Progress: 785/2370 symbols completed. EVEX took 24.1s. Estimated remaining: 2h 47m 33s. Rate: 9.5 symbols/min [2025-09-14T18:00:10.574064] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:00:10.594870] [DEBUG] [LOCAL ] EVH: Loaded 22177 existing records from primary storage. [2025-09-14T18:00:10.595026] [INFO ] [MAIN ] EVH: Loaded 22177 existing records. [2025-09-14T18:00:10.770500] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:00:10.770761] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-09-14T18:00:10.770825] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-09-14T18:00:10.771372] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-09-14T18:00:10.771442] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-09-14T18:00:10.965767] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-09-14T18:00:11.052445] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T18:00:11.134510] [INFO ] [REMOTE ] EVH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:00:11.758796] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-09-14T18:00:11.933871] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-14T18:00:12.558866] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-09-14T18:00:13.358814] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-09-14T18:00:13.698787] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-14T18:00:13.720012] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T18:00:14.158834] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-09-14T18:00:14.257594] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-14T18:00:14.259403] [INFO ] [REMOTE ] EVF: Full fetch complete (9427 records). [2025-09-14T18:00:14.259510] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-09-14T18:00:14.628506] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-09-14T18:00:14.628622] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-09-14T18:00:14.628933] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-09-14T18:00:14.628997] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-09-14T18:00:14.629451] [DEBUG] [LOCAL ] EVF: Trimmed 9427 records to 6509 (keeping 150 days of data) [2025-09-14T18:00:14.672013] [DEBUG] [LOCAL ] EVF: Primary data saved (6509 records). [2025-09-14T18:00:14.672153] [INFO ] [MAIN ] EVF: Full history saved. [2025-09-14T18:00:14.672266] [INFO ] [MAIN ] Update Progress: 786/2370 symbols completed. EVF took 21.3s. Estimated remaining: 2h 47m 22s. Rate: 9.5 symbols/min [2025-09-14T18:00:14.862945] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:00:14.870728] [DEBUG] [LOCAL ] EVN: Loaded 5269 existing records from primary storage. [2025-09-14T18:00:14.870870] [INFO ] [MAIN ] EVN: Loaded 5269 existing records. [2025-09-14T18:00:14.967595] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-09-14T18:00:15.067921] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:00:15.068252] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-09-14T18:00:15.068321] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-14T18:00:15.068693] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-09-14T18:00:15.068762] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-09-14T18:00:15.431924] [INFO ] [REMOTE ] EVN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:00:15.758836] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-09-14T18:00:16.142212] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-14T18:00:16.146239] [INFO ] [REMOTE ] ETY: Full fetch complete (25631 records). [2025-09-14T18:00:16.146494] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-09-14T18:00:16.522426] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-09-14T18:00:16.522560] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-09-14T18:00:16.523184] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-09-14T18:00:16.523264] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-09-14T18:00:16.524220] [DEBUG] [LOCAL ] ETY: Trimmed 25631 records to 16489 (keeping 150 days of data) [2025-09-14T18:00:16.574469] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-09-14T18:00:16.635422] [DEBUG] [LOCAL ] ETY: Primary data saved (16489 records). [2025-09-14T18:00:16.635634] [INFO ] [MAIN ] ETY: Full history saved. [2025-09-14T18:00:16.635810] [INFO ] [MAIN ] Update Progress: 787/2370 symbols completed. ETY took 35.5s. Estimated remaining: 2h 47m 7s. Rate: 9.5 symbols/min [2025-09-14T18:00:16.810094] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:00:16.825132] [DEBUG] [LOCAL ] EVR: Loaded 14361 existing records from primary storage. [2025-09-14T18:00:16.825291] [INFO ] [MAIN ] EVR: Loaded 14361 existing records. [2025-09-14T18:00:17.008253] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:00:17.008947] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-09-14T18:00:17.018005] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-09-14T18:00:17.018374] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-14T18:00:17.022329] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-09-14T18:00:17.022510] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-09-14T18:00:17.247461] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-14T18:00:17.363947] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-09-14T18:00:17.378340] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-14T18:00:17.460491] [INFO ] [REMOTE ] EVR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:00:18.158788] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-09-14T18:00:18.398635] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-14T18:00:18.958851] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-09-14T18:00:19.756760] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-14T18:00:19.764356] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-09-14T18:00:19.806610] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-14T18:00:20.558844] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-09-14T18:00:21.358841] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-09-14T18:00:21.424085] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T18:00:21.898378] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-14T18:00:22.144037] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-14T18:00:22.158826] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-09-14T18:00:22.926167] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-14T18:00:22.958841] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-09-14T18:00:23.758850] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-09-14T18:00:23.929796] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-14T18:00:24.529692] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-14T18:00:24.558810] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-09-14T18:00:25.203560] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-14T18:00:25.358820] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-09-14T18:00:26.158848] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-09-14T18:00:26.320944] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-14T18:00:26.958831] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-09-14T18:00:27.758837] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-09-14T18:00:28.325200] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-14T18:00:28.558865] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-09-14T18:00:28.570247] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-14T18:00:28.572078] [INFO ] [REMOTE ] EVN: Full fetch complete (12030 records). [2025-09-14T18:00:28.572166] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-09-14T18:00:28.930709] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-09-14T18:00:28.930844] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-09-14T18:00:28.931202] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-09-14T18:00:28.931259] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-09-14T18:00:28.932062] [DEBUG] [LOCAL ] EVN: Trimmed 12030 records to 7883 (keeping 150 days of data) [2025-09-14T18:00:28.987681] [DEBUG] [LOCAL ] EVN: Primary data saved (7883 records). [2025-09-14T18:00:28.987838] [INFO ] [MAIN ] EVN: Full history saved. [2025-09-14T18:00:28.987943] [INFO ] [MAIN ] Update Progress: 788/2370 symbols completed. EVN took 14.3s. Estimated remaining: 2h 47m 13s. Rate: 9.5 symbols/min [2025-09-14T18:00:29.164745] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:00:29.175351] [DEBUG] [LOCAL ] EVT: Loaded 7432 existing records from primary storage. [2025-09-14T18:00:29.175544] [INFO ] [MAIN ] EVT: Loaded 7432 existing records. [2025-09-14T18:00:29.351217] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:00:29.351536] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-09-14T18:00:29.351608] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-14T18:00:29.352021] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-09-14T18:00:29.352094] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-09-14T18:00:29.384904] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-09-14T18:00:29.757446] [INFO ] [REMOTE ] EVT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:00:29.784969] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-14T18:00:30.143725] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-14T18:00:30.161672] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-09-14T18:00:30.171571] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T18:00:30.935079] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-14T18:00:30.958786] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-09-14T18:00:31.758853] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-09-14T18:00:32.368081] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T18:00:32.558836] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-09-14T18:00:32.805687] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T18:00:33.358845] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-09-14T18:00:33.816954] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T18:00:34.158825] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-09-14T18:00:34.248320] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T18:00:34.958844] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-09-14T18:00:35.746751] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T18:00:35.761768] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-09-14T18:00:36.034670] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T18:00:36.558845] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-09-14T18:00:36.938884] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T18:00:37.358881] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-09-14T18:00:38.075318] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T18:00:38.076622] [INFO ] [REMOTE ] EVG: Full fetch complete (6165 records). [2025-09-14T18:00:38.076731] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-09-14T18:00:38.163938] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-09-14T18:00:38.448712] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-09-14T18:00:38.448860] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-09-14T18:00:38.449172] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-09-14T18:00:38.449251] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-09-14T18:00:38.449968] [DEBUG] [LOCAL ] EVG: Trimmed 6165 records to 4298 (keeping 150 days of data) [2025-09-14T18:00:38.502345] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-14T18:00:38.520789] [DEBUG] [LOCAL ] EVG: Primary data saved (4298 records). [2025-09-14T18:00:38.520934] [INFO ] [MAIN ] EVG: Full history saved. [2025-09-14T18:00:38.521070] [INFO ] [MAIN ] Update Progress: 789/2370 symbols completed. EVG took 32.3s. Estimated remaining: 2h 47m 13s. Rate: 9.5 symbols/min [2025-09-14T18:00:38.697149] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:00:38.715058] [DEBUG] [LOCAL ] EVTC: Loaded 11753 existing records from primary storage. [2025-09-14T18:00:38.715223] [INFO ] [MAIN ] EVTC: Loaded 11753 existing records. [2025-09-14T18:00:38.893339] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:00:38.893622] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-09-14T18:00:38.893706] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-14T18:00:38.894121] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-09-14T18:00:38.894180] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-09-14T18:00:38.967811] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-09-14T18:00:39.246184] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:00:39.310942] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-14T18:00:39.758844] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-09-14T18:00:40.558882] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-09-14T18:00:40.899971] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-14T18:00:40.944586] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T18:00:41.358792] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-09-14T18:00:41.412927] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-14T18:00:42.158869] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-09-14T18:00:42.178688] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-14T18:00:42.958870] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-09-14T18:00:43.326153] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T18:00:43.758907] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-09-14T18:00:44.453814] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-14T18:00:44.459316] [INFO ] [REMOTE ] EVH: Full fetch complete (53726 records). [2025-09-14T18:00:44.459466] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-09-14T18:00:44.559692] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-09-14T18:00:44.844285] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-09-14T18:00:44.844506] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-09-14T18:00:44.845282] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-09-14T18:00:44.845456] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-09-14T18:00:44.856452] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-14T18:00:44.860343] [DEBUG] [LOCAL ] EVH: Trimmed 53726 records to 37038 (keeping 150 days of data) [2025-09-14T18:00:45.105424] [DEBUG] [LOCAL ] EVH: Primary data saved (37038 records). [2025-09-14T18:00:45.105742] [INFO ] [MAIN ] EVH: Full history saved. [2025-09-14T18:00:45.105906] [INFO ] [MAIN ] Update Progress: 790/2370 symbols completed. EVH took 34.7s. Estimated remaining: 2h 47m 7s. Rate: 9.5 symbols/min [2025-09-14T18:00:45.279132] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:00:45.288194] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T18:00:45.291987] [INFO ] [REMOTE ] EVR: Full fetch complete (39454 records). [2025-09-14T18:00:45.292115] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-09-14T18:00:45.361296] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-09-14T18:00:45.570112] [DEBUG] [LOCAL ] EVTL: Loaded 20510 existing records from primary storage. [2025-09-14T18:00:45.596703] [INFO ] [MAIN ] EVTL: Loaded 20510 existing records. [2025-09-14T18:00:45.832917] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-09-14T18:00:45.868368] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-09-14T18:00:45.871755] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:00:45.872631] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-09-14T18:00:45.872756] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-09-14T18:00:45.872845] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-09-14T18:00:45.873035] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-14T18:00:45.873719] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-09-14T18:00:45.873794] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-09-14T18:00:45.873861] [DEBUG] [LOCAL ] EVR: Trimmed 39454 records to 25593 (keeping 150 days of data) [2025-09-14T18:00:46.163470] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-09-14T18:00:46.288449] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-14T18:00:46.340487] [INFO ] [REMOTE ] EVT: Full fetch complete (19275 records). [2025-09-14T18:00:46.357752] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-09-14T18:00:46.393896] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:00:46.796269] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-09-14T18:00:46.796717] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-09-14T18:00:46.797205] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-09-14T18:00:46.798097] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-09-14T18:00:46.799107] [DEBUG] [LOCAL ] EVT: Trimmed 19275 records to 12781 (keeping 150 days of data) [2025-09-14T18:00:46.877064] [DEBUG] [LOCAL ] EVR: Primary data saved (25593 records). [2025-09-14T18:00:46.880493] [INFO ] [MAIN ] EVR: Full history saved. [2025-09-14T18:00:46.882764] [INFO ] [MAIN ] Update Progress: 791/2370 symbols completed. EVR took 30.2s. Estimated remaining: 2h 46m 51s. Rate: 9.5 symbols/min [2025-09-14T18:00:46.970745] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-09-14T18:00:47.164372] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:00:47.157832] [DEBUG] [LOCAL ] EVT: Primary data saved (12781 records). [2025-09-14T18:00:47.164911] [INFO ] [MAIN ] EVT: Full history saved. [2025-09-14T18:00:47.165309] [INFO ] [MAIN ] Update Progress: 792/2370 symbols completed. EVT took 18.2s. Estimated remaining: 2h 46m 33s. Rate: 9.5 symbols/min [2025-09-14T18:00:47.295860] [DEBUG] [LOCAL ] EVTR: Loaded 11001 existing records from primary storage. [2025-09-14T18:00:47.296101] [INFO ] [MAIN ] EVTR: Loaded 11001 existing records. [2025-09-14T18:00:47.762927] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:00:47.783735] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-14T18:00:47.807941] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-09-14T18:00:47.832950] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:00:47.833268] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-09-14T18:00:47.833340] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-09-14T18:00:47.833916] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-09-14T18:00:47.833998] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-09-14T18:00:48.022966] [DEBUG] [LOCAL ] EW: Loaded 23877 existing records from primary storage. [2025-09-14T18:00:48.072622] [INFO ] [MAIN ] EW: Loaded 23877 existing records. [2025-09-14T18:00:48.512609] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:00:48.512807] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:00:48.513426] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-09-14T18:00:48.513504] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-09-14T18:00:48.514180] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-09-14T18:00:48.514248] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-09-14T18:00:48.569010] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-09-14T18:00:48.898217] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-14T18:00:48.902537] [INFO ] [REMOTE ] EW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:00:49.087023] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T18:00:49.358857] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-09-14T18:00:49.722334] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-14T18:00:50.158877] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-09-14T18:00:50.355371] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-14T18:00:50.958841] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-09-14T18:00:51.298067] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-14T18:00:51.758848] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-09-14T18:00:51.991679] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-14T18:00:52.558872] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-09-14T18:00:53.002218] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-14T18:00:53.358842] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-09-14T18:00:53.691362] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-14T18:00:54.158877] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-09-14T18:00:54.958838] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-09-14T18:00:55.076719] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-14T18:00:55.744396] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-14T18:00:55.758791] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-09-14T18:00:56.119502] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T18:00:56.558895] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-09-14T18:00:57.114491] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T18:00:57.117728] [INFO ] [REMOTE ] EVTC: Full fetch complete (28916 records). [2025-09-14T18:00:57.117821] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-09-14T18:00:57.363504] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-09-14T18:00:57.509935] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-09-14T18:00:57.510303] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-09-14T18:00:57.511585] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-09-14T18:00:57.511778] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-09-14T18:00:57.538116] [DEBUG] [LOCAL ] EVTC: Trimmed 28916 records to 19605 (keeping 150 days of data) [2025-09-14T18:00:57.542576] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T18:00:57.682144] [DEBUG] [LOCAL ] EVTC: Primary data saved (19605 records). [2025-09-14T18:00:57.682345] [INFO ] [MAIN ] EVTC: Full history saved. [2025-09-14T18:00:57.682472] [INFO ] [MAIN ] Update Progress: 793/2370 symbols completed. EVTC took 19.2s. Estimated remaining: 2h 46m 35s. Rate: 9.5 symbols/min [2025-09-14T18:00:57.854947] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:00:57.870272] [DEBUG] [LOCAL ] EXG: Loaded 14781 existing records from primary storage. [2025-09-14T18:00:57.870454] [INFO ] [MAIN ] EXG: Loaded 14781 existing records. [2025-09-14T18:00:58.074071] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:00:58.074875] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-09-14T18:00:58.075093] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-09-14T18:00:58.075692] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-09-14T18:00:58.075772] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-09-14T18:00:58.163920] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-09-14T18:00:58.441019] [INFO ] [REMOTE ] EXG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:00:58.556503] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T18:00:58.958872] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-09-14T18:00:59.758947] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-09-14T18:01:00.133224] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-14T18:01:00.558867] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-09-14T18:01:00.945958] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-14T18:01:01.340563] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T18:01:01.358775] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-09-14T18:01:02.158857] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-09-14T18:01:02.921964] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-14T18:01:02.958789] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-09-14T18:01:03.248432] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-14T18:01:03.390220] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-14T18:01:03.758831] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-09-14T18:01:04.558788] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-09-14T18:01:04.960421] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T18:01:05.067271] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-14T18:01:05.358843] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-09-14T18:01:06.158843] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-09-14T18:01:06.380742] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-14T18:01:06.867244] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T18:01:06.958802] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-09-14T18:01:07.236007] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-14T18:01:07.758834] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-09-14T18:01:08.509446] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-14T18:01:08.514003] [INFO ] [REMOTE ] EVTL: Full fetch complete (39210 records). [2025-09-14T18:01:08.514110] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-09-14T18:01:08.567931] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-09-14T18:01:08.903040] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-09-14T18:01:08.903164] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-09-14T18:01:08.903833] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-09-14T18:01:08.903893] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-09-14T18:01:08.904983] [DEBUG] [LOCAL ] EVTL: Trimmed 39210 records to 29725 (keeping 150 days of data) [2025-09-14T18:01:09.075307] [DEBUG] [LOCAL ] EVTL: Primary data saved (29725 records). [2025-09-14T18:01:09.075488] [INFO ] [MAIN ] EVTL: Full history saved. [2025-09-14T18:01:09.075592] [INFO ] [MAIN ] Update Progress: 794/2370 symbols completed. EVTL took 24.0s. Estimated remaining: 2h 46m 39s. Rate: 9.5 symbols/min [2025-09-14T18:01:09.244374] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:01:09.266199] [DEBUG] [LOCAL ] EXK: Loaded 23764 existing records from primary storage. [2025-09-14T18:01:09.266372] [INFO ] [MAIN ] EXK: Loaded 23764 existing records. [2025-09-14T18:01:09.365063] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-09-14T18:01:09.447245] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:01:09.447558] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-09-14T18:01:09.447657] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-09-14T18:01:09.448365] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-09-14T18:01:09.448437] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-09-14T18:01:09.799989] [INFO ] [REMOTE ] EXK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:01:09.853514] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-14T18:01:09.878064] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-14T18:01:10.158827] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-09-14T18:01:10.653065] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-14T18:01:10.958827] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-09-14T18:01:11.758886] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-09-14T18:01:12.047198] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-14T18:01:12.067008] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-14T18:01:12.070751] [INFO ] [REMOTE ] EVTR: Full fetch complete (24290 records). [2025-09-14T18:01:12.070874] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-09-14T18:01:12.443849] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-09-14T18:01:12.443964] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-09-14T18:01:12.444494] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-09-14T18:01:12.444547] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-09-14T18:01:12.445242] [DEBUG] [LOCAL ] EVTR: Trimmed 24290 records to 17332 (keeping 150 days of data) [2025-09-14T18:01:12.552586] [DEBUG] [LOCAL ] EVTR: Primary data saved (17332 records). [2025-09-14T18:01:12.552829] [INFO ] [MAIN ] EVTR: Full history saved. [2025-09-14T18:01:12.552936] [INFO ] [MAIN ] Update Progress: 795/2370 symbols completed. EVTR took 25.7s. Estimated remaining: 2h 46m 27s. Rate: 9.5 symbols/min [2025-09-14T18:01:12.564560] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-09-14T18:01:12.734460] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:01:12.749339] [DEBUG] [LOCAL ] EXP: Loaded 13332 existing records from primary storage. [2025-09-14T18:01:12.749539] [INFO ] [MAIN ] EXP: Loaded 13332 existing records. [2025-09-14T18:01:12.933225] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:01:12.933478] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-09-14T18:01:12.933541] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-09-14T18:01:12.934078] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-09-14T18:01:12.934144] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-09-14T18:01:13.347985] [INFO ] [REMOTE ] EXP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:01:13.358845] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-09-14T18:01:13.767848] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-14T18:01:14.084697] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-14T18:01:14.158902] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-09-14T18:01:14.518962] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-14T18:01:14.958841] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-09-14T18:01:15.758794] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-09-14T18:01:16.284301] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-14T18:01:16.336328] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-14T18:01:16.467508] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T18:01:16.473359] [INFO ] [REMOTE ] EW: Full fetch complete (58056 records). [2025-09-14T18:01:16.473528] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-09-14T18:01:16.564036] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-09-14T18:01:16.861154] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-09-14T18:01:16.861285] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-09-14T18:01:16.862106] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-09-14T18:01:16.862170] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-09-14T18:01:16.863440] [DEBUG] [LOCAL ] EW: Trimmed 58056 records to 40167 (keeping 150 days of data) [2025-09-14T18:01:17.116332] [DEBUG] [LOCAL ] EW: Primary data saved (40167 records). [2025-09-14T18:01:17.116489] [INFO ] [MAIN ] EW: Full history saved. [2025-09-14T18:01:17.116589] [INFO ] [MAIN ] Update Progress: 796/2370 symbols completed. EW took 30.0s. Estimated remaining: 2h 46m 17s. Rate: 9.5 symbols/min [2025-09-14T18:01:17.284360] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:01:17.305269] [DEBUG] [LOCAL ] EXPD: Loaded 21396 existing records from primary storage. [2025-09-14T18:01:17.305422] [INFO ] [MAIN ] EXPD: Loaded 21396 existing records. [2025-09-14T18:01:17.367558] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-09-14T18:01:17.482058] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:01:17.482328] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-09-14T18:01:17.482392] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-09-14T18:01:17.483044] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-09-14T18:01:17.483109] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-09-14T18:01:17.872096] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:01:17.898090] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-14T18:01:18.158895] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-09-14T18:01:18.631043] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-14T18:01:18.958950] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-09-14T18:01:19.758865] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-09-14T18:01:20.140241] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T18:01:20.398100] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-14T18:01:20.558913] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-09-14T18:01:21.118042] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-14T18:01:21.358945] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-09-14T18:01:21.921081] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-14T18:01:22.158860] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-09-14T18:01:22.958864] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-09-14T18:01:23.319440] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-14T18:01:23.758914] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-09-14T18:01:24.077776] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-14T18:01:24.180409] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T18:01:24.558924] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-09-14T18:01:25.358901] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-09-14T18:01:25.670281] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T18:01:26.158937] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-09-14T18:01:26.352343] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T18:01:26.451618] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-14T18:01:26.958925] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-09-14T18:01:27.758920] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-09-14T18:01:28.568036] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-09-14T18:01:28.605517] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-14T18:01:28.809167] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-14T18:01:28.813495] [INFO ] [REMOTE ] EXG: Full fetch complete (38092 records). [2025-09-14T18:01:28.813847] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-09-14T18:01:29.222972] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-09-14T18:01:29.223853] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-09-14T18:01:29.225277] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-09-14T18:01:29.225542] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-09-14T18:01:29.227425] [DEBUG] [LOCAL ] EXG: Trimmed 38092 records to 25562 (keeping 150 days of data) [2025-09-14T18:01:29.363172] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-14T18:01:29.363399] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-09-14T18:01:29.447733] [DEBUG] [LOCAL ] EXG: Primary data saved (25562 records). [2025-09-14T18:01:29.447929] [INFO ] [MAIN ] EXG: Full history saved. [2025-09-14T18:01:29.448047] [INFO ] [MAIN ] Update Progress: 797/2370 symbols completed. EXG took 31.8s. Estimated remaining: 2h 46m 22s. Rate: 9.5 symbols/min [2025-09-14T18:01:29.997709] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-14T18:01:30.158867] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-09-14T18:01:30.730847] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T18:01:30.734567] [INFO ] [REMOTE ] EXP: Full fetch complete (32927 records). [2025-09-14T18:01:30.734825] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-09-14T18:01:30.967814] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-09-14T18:01:31.141114] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-09-14T18:01:31.141332] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-09-14T18:01:31.142212] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-09-14T18:01:31.142403] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-09-14T18:01:31.143970] [DEBUG] [LOCAL ] EXP: Trimmed 32927 records to 22227 (keeping 150 days of data) [2025-09-14T18:01:31.267122] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-14T18:01:31.333814] [DEBUG] [LOCAL ] EXP: Primary data saved (22227 records). [2025-09-14T18:01:31.334055] [INFO ] [MAIN ] EXP: Full history saved. [2025-09-14T18:01:31.334189] [INFO ] [MAIN ] Update Progress: 798/2370 symbols completed. EXP took 18.8s. Estimated remaining: 2h 46m 7s. Rate: 9.5 symbols/min [2025-09-14T18:01:31.758850] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-09-14T18:01:32.800234] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T18:01:32.812538] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-09-14T18:01:33.410824] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T18:01:33.421395] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-09-14T18:01:34.489180] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-14T18:01:34.495823] [INFO ] [REMOTE ] EXK: Full fetch complete (57602 records). [2025-09-14T18:01:34.496102] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-09-14T18:01:34.900742] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-09-14T18:01:34.900922] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-09-14T18:01:34.902386] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-09-14T18:01:34.902511] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-09-14T18:01:34.904284] [DEBUG] [LOCAL ] EXK: Trimmed 57602 records to 39936 (keeping 150 days of data) [2025-09-14T18:01:35.170664] [DEBUG] [LOCAL ] EXK: Primary data saved (39936 records). [2025-09-14T18:01:35.170970] [INFO ] [MAIN ] EXK: Full history saved. [2025-09-14T18:01:35.171237] [INFO ] [MAIN ] Update Progress: 799/2370 symbols completed. EXK took 26.1s. Estimated remaining: 2h 45m 56s. Rate: 9.5 symbols/min [2025-09-14T18:01:35.205089] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-14T18:01:35.216859] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-09-14T18:01:36.954824] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-14T18:01:36.965610] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-09-14T18:01:37.607902] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T18:01:37.612846] [INFO ] [REMOTE ] EXPD: Full fetch complete (52518 records). [2025-09-14T18:01:37.612963] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-09-14T18:01:37.993987] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-09-14T18:01:37.994109] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-09-14T18:01:37.994877] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-09-14T18:01:37.994937] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-09-14T18:01:37.996085] [DEBUG] [LOCAL ] EXPD: Trimmed 52518 records to 36005 (keeping 150 days of data) [2025-09-14T18:01:38.241330] [DEBUG] [LOCAL ] EXPD: Primary data saved (36005 records). [2025-09-14T18:01:38.241515] [INFO ] [MAIN ] EXPD: Full history saved. [2025-09-14T18:01:38.241623] [INFO ] [MAIN ] Update Progress: 800/2370 symbols completed. EXPD took 21.1s. Estimated remaining: 2h 45m 43s. Rate: 9.5 symbols/min [2025-09-14T18:01:38.835788] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:01:38.869749] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:01:38.962290] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:01:38.997092] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:01:39.036927] [DEBUG] [LOCAL ] EXR: Loaded 20731 existing records from primary storage. [2025-09-14T18:01:39.037259] [DEBUG] [LOCAL ] FAF: Loaded 18506 existing records from primary storage. [2025-09-14T18:01:39.037566] [INFO ] [MAIN ] EXR: Loaded 20731 existing records. [2025-09-14T18:01:39.037633] [INFO ] [MAIN ] FAF: Loaded 18506 existing records. [2025-09-14T18:01:39.209687] [DEBUG] [LOCAL ] FBIN: Loaded 22518 existing records from primary storage. [2025-09-14T18:01:39.210329] [DEBUG] [LOCAL ] F: Loaded 24180 existing records from primary storage. [2025-09-14T18:01:39.277718] [INFO ] [MAIN ] FBIN: Loaded 22518 existing records. [2025-09-14T18:01:39.277814] [INFO ] [MAIN ] F: Loaded 24180 existing records. [2025-09-14T18:01:39.713530] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:01:39.713731] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:01:39.740475] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-09-14T18:01:39.785846] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-09-14T18:01:39.786065] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-09-14T18:01:39.775005] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-09-14T18:01:39.794769] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-09-14T18:01:39.820219] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-09-14T18:01:39.820330] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-09-14T18:01:39.907736] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-09-14T18:01:40.300357] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:01:40.387622] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-09-14T18:01:40.412515] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:01:40.461873] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-09-14T18:01:40.462021] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-09-14T18:01:40.478539] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-09-14T18:01:40.526272] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-09-14T18:01:40.554201] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-09-14T18:01:40.641199] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-09-14T18:01:40.720199] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-09-14T18:01:41.205535] [INFO ] [REMOTE ] FAF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:01:41.287421] [INFO ] [REMOTE ] EXR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:01:41.359981] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-09-14T18:01:41.380804] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-09-14T18:01:41.724009] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:01:41.727063] [INFO ] [REMOTE ] F: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:01:41.727426] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-09-14T18:01:41.727701] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-09-14T18:01:42.903774] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-14T18:01:42.910863] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-09-14T18:01:43.087020] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T18:01:43.096116] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-09-14T18:01:43.174767] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T18:01:43.185897] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-09-14T18:01:43.881934] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-14T18:01:43.893893] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-09-14T18:01:44.093908] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-14T18:01:44.102895] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-09-14T18:01:44.610734] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-14T18:01:44.621576] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-09-14T18:01:44.786889] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-14T18:01:44.796848] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-09-14T18:01:45.523514] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-14T18:01:45.533203] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-09-14T18:01:46.467912] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T18:01:46.478985] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-09-14T18:01:46.618994] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-09-14T18:01:46.631212] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-09-14T18:01:46.681004] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T18:01:46.958824] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-09-14T18:01:47.233472] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T18:01:47.758897] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-09-14T18:01:48.233627] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-14T18:01:48.384765] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-14T18:01:48.558840] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-09-14T18:01:49.014778] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T18:01:49.058688] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-14T18:01:49.358854] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-09-14T18:01:50.050977] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-14T18:01:50.158827] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-09-14T18:01:50.958836] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-09-14T18:01:51.758964] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-09-14T18:01:51.825502] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-14T18:01:51.866741] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-14T18:01:52.359183] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-14T18:01:52.558877] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-09-14T18:01:53.099469] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T18:01:53.358836] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-09-14T18:01:54.158835] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-09-14T18:01:54.393018] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T18:01:54.958884] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-09-14T18:01:55.713275] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-14T18:01:55.758844] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-09-14T18:01:55.942688] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-09-14T18:01:56.311537] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T18:01:56.384414] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T18:01:56.388581] [INFO ] [REMOTE ] FAF: Full fetch complete (45178 records). [2025-09-14T18:01:56.388715] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-09-14T18:01:56.563916] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-09-14T18:01:56.766418] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-09-14T18:01:56.766561] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-09-14T18:01:56.767487] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-09-14T18:01:56.767559] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-09-14T18:01:56.769034] [DEBUG] [LOCAL ] FAF: Trimmed 45178 records to 31749 (keeping 150 days of data) [2025-09-14T18:01:56.981115] [DEBUG] [LOCAL ] FAF: Primary data saved (31749 records). [2025-09-14T18:01:56.981305] [INFO ] [MAIN ] FAF: Full history saved. [2025-09-14T18:01:56.981447] [INFO ] [MAIN ] Update Progress: 801/2370 symbols completed. FAF took 18.7s. Estimated remaining: 2h 46m 1s. Rate: 9.5 symbols/min [2025-09-14T18:01:57.158660] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:01:57.173440] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T18:01:57.178807] [INFO ] [REMOTE ] FBIN: Full fetch complete (54919 records). [2025-09-14T18:01:57.178960] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-09-14T18:01:57.278518] [DEBUG] [LOCAL ] FBK: Loaded 12995 existing records from primary storage. [2025-09-14T18:01:57.288802] [INFO ] [MAIN ] FBK: Loaded 12995 existing records. [2025-09-14T18:01:57.378751] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-09-14T18:01:57.671029] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:01:57.699933] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-09-14T18:01:57.705752] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-09-14T18:01:57.726884] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-09-14T18:01:57.761079] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-09-14T18:01:57.913210] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-09-14T18:01:57.939840] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-09-14T18:01:57.940711] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-09-14T18:01:57.941078] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-09-14T18:01:58.053998] [DEBUG] [LOCAL ] FBIN: Trimmed 54919 records to 38076 (keeping 150 days of data) [2025-09-14T18:01:58.198013] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-09-14T18:01:58.299776] [INFO ] [REMOTE ] FBK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:01:58.463891] [DEBUG] [LOCAL ] FBIN: Primary data saved (38076 records). [2025-09-14T18:01:58.464101] [INFO ] [MAIN ] FBIN: Full history saved. [2025-09-14T18:01:58.464222] [INFO ] [MAIN ] Update Progress: 802/2370 symbols completed. FBIN took 20.2s. Estimated remaining: 2h 45m 45s. Rate: 9.5 symbols/min [2025-09-14T18:01:58.635333] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:01:58.655571] [DEBUG] [LOCAL ] FBP: Loaded 20604 existing records from primary storage. [2025-09-14T18:01:58.655772] [INFO ] [MAIN ] FBP: Loaded 20604 existing records. [2025-09-14T18:01:58.834197] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:01:58.834443] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-09-14T18:01:58.834502] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-09-14T18:01:58.835088] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-09-14T18:01:58.835157] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-09-14T18:01:58.974179] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-09-14T18:01:59.188025] [INFO ] [REMOTE ] FBP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:01:59.324228] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-14T18:01:59.753438] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-14T18:01:59.758777] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-09-14T18:02:00.558860] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-09-14T18:02:00.625049] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T18:02:01.057789] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-09-14T18:02:01.358898] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-09-14T18:02:02.158854] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-09-14T18:02:02.862144] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-14T18:02:02.958880] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-09-14T18:02:03.431973] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-14T18:02:03.437059] [INFO ] [REMOTE ] EXR: Full fetch complete (49498 records). [2025-09-14T18:02:03.437222] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-09-14T18:02:03.765120] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-09-14T18:02:03.814492] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-09-14T18:02:03.814596] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-09-14T18:02:03.815400] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-09-14T18:02:03.815459] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-09-14T18:02:03.816554] [DEBUG] [LOCAL ] EXR: Trimmed 49498 records to 34050 (keeping 150 days of data) [2025-09-14T18:02:04.035243] [DEBUG] [LOCAL ] EXR: Primary data saved (34050 records). [2025-09-14T18:02:04.035454] [INFO ] [MAIN ] EXR: Full history saved. [2025-09-14T18:02:04.035594] [INFO ] [MAIN ] Update Progress: 803/2370 symbols completed. EXR took 25.8s. Estimated remaining: 2h 45m 37s. Rate: 9.5 symbols/min [2025-09-14T18:02:04.210461] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:02:04.229015] [DEBUG] [LOCAL ] FBRT: Loaded 15172 existing records from primary storage. [2025-09-14T18:02:04.229186] [INFO ] [MAIN ] FBRT: Loaded 15172 existing records. [2025-09-14T18:02:04.415762] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:02:04.416054] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-09-14T18:02:04.416115] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-09-14T18:02:04.416598] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-09-14T18:02:04.416688] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-09-14T18:02:04.797584] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:02:04.797989] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-09-14T18:02:04.831210] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T18:02:04.898168] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-14T18:02:05.010311] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (3.65 seconds). [2025-09-14T18:02:05.358883] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-09-14T18:02:05.839499] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-14T18:02:06.158857] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-09-14T18:02:06.357004] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-14T18:02:06.958845] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-09-14T18:02:07.517966] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-14T18:02:07.758836] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-09-14T18:02:08.566963] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-09-14T18:02:08.586211] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T18:02:08.656254] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-14T18:02:08.663501] [INFO ] [REMOTE ] F: Full fetch complete (58500 records). [2025-09-14T18:02:08.663727] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-09-14T18:02:09.081703] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-09-14T18:02:09.081835] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-09-14T18:02:09.082756] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-09-14T18:02:09.082834] [DEBUG] [LOCAL ] F: Saving primary data. [2025-09-14T18:02:09.084283] [DEBUG] [LOCAL ] F: Trimmed 58500 records to 40560 (keeping 150 days of data) [2025-09-14T18:02:09.359075] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-09-14T18:02:09.373397] [DEBUG] [LOCAL ] F: Primary data saved (40560 records). [2025-09-14T18:02:09.373584] [INFO ] [MAIN ] F: Full history saved. [2025-09-14T18:02:09.373769] [INFO ] [MAIN ] Update Progress: 804/2370 symbols completed. F took 31.1s. Estimated remaining: 2h 45m 29s. Rate: 9.5 symbols/min [2025-09-14T18:02:09.552888] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:02:09.570688] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-14T18:02:09.582784] [DEBUG] [LOCAL ] FC: Loaded 7181 existing records from primary storage. [2025-09-14T18:02:09.582955] [INFO ] [MAIN ] FC: Loaded 7181 existing records. [2025-09-14T18:02:09.761901] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:02:09.762191] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-09-14T18:02:09.762255] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-09-14T18:02:09.762601] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-09-14T18:02:09.762707] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-09-14T18:02:10.116344] [INFO ] [REMOTE ] FC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:02:10.158797] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-09-14T18:02:10.870857] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T18:02:10.958836] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-09-14T18:02:11.202354] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-14T18:02:11.758852] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-09-14T18:02:12.325754] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T18:02:12.558833] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-09-14T18:02:12.963670] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-14T18:02:13.358817] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-09-14T18:02:14.158819] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-09-14T18:02:14.389245] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T18:02:14.838833] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T18:02:14.958838] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-09-14T18:02:15.618444] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T18:02:15.758799] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-09-14T18:02:16.074771] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-14T18:02:16.558902] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-09-14T18:02:17.091419] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-14T18:02:17.358856] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-09-14T18:02:17.497888] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-14T18:02:18.158869] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-09-14T18:02:18.905397] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-14T18:02:18.958919] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-09-14T18:02:19.094527] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-14T18:02:19.203427] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-09-14T18:02:19.206118] [INFO ] [REMOTE ] FBK: Full fetch complete (26373 records). [2025-09-14T18:02:19.206254] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-09-14T18:02:19.599794] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-09-14T18:02:19.599924] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-09-14T18:02:19.600575] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-09-14T18:02:19.600680] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-09-14T18:02:19.601559] [DEBUG] [LOCAL ] FBK: Trimmed 26373 records to 19646 (keeping 150 days of data) [2025-09-14T18:02:19.733268] [DEBUG] [LOCAL ] FBK: Primary data saved (19646 records). [2025-09-14T18:02:19.733473] [INFO ] [MAIN ] FBK: Full history saved. [2025-09-14T18:02:19.733636] [INFO ] [MAIN ] Update Progress: 805/2370 symbols completed. FBK took 22.8s. Estimated remaining: 2h 45m 31s. Rate: 9.5 symbols/min [2025-09-14T18:02:19.763985] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-09-14T18:02:19.913213] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:02:19.931159] [DEBUG] [LOCAL ] FCF: Loaded 16948 existing records from primary storage. [2025-09-14T18:02:19.931344] [INFO ] [MAIN ] FCF: Loaded 16948 existing records. [2025-09-14T18:02:20.112627] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:02:20.113069] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-09-14T18:02:20.113145] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-09-14T18:02:20.113736] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-09-14T18:02:20.113800] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-09-14T18:02:20.469623] [INFO ] [REMOTE ] FCF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:02:20.558789] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-09-14T18:02:21.009519] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-14T18:02:21.358857] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-09-14T18:02:22.025491] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-14T18:02:22.158815] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-09-14T18:02:22.497132] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T18:02:22.958893] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-09-14T18:02:23.508591] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-14T18:02:23.652058] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-14T18:02:23.758838] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-09-14T18:02:24.558780] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-09-14T18:02:24.566757] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T18:02:24.568964] [INFO ] [REMOTE ] FC: Full fetch complete (16824 records). [2025-09-14T18:02:24.569064] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-09-14T18:02:24.939158] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-09-14T18:02:24.939263] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-09-14T18:02:24.939761] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-09-14T18:02:24.939821] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-09-14T18:02:24.940347] [DEBUG] [LOCAL ] FC: Trimmed 16824 records to 10642 (keeping 150 days of data) [2025-09-14T18:02:25.006719] [DEBUG] [LOCAL ] FC: Primary data saved (10642 records). [2025-09-14T18:02:25.006895] [INFO ] [MAIN ] FC: Full history saved. [2025-09-14T18:02:25.007039] [INFO ] [MAIN ] Update Progress: 806/2370 symbols completed. FC took 15.6s. Estimated remaining: 2h 45m 22s. Rate: 9.5 symbols/min [2025-09-14T18:02:25.179140] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:02:25.191166] [DEBUG] [LOCAL ] FCN: Loaded 10725 existing records from primary storage. [2025-09-14T18:02:25.191338] [INFO ] [MAIN ] FCN: Loaded 10725 existing records. [2025-09-14T18:02:25.362516] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-09-14T18:02:25.367118] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:02:25.368156] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-09-14T18:02:25.368219] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-09-14T18:02:25.368685] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-09-14T18:02:25.368749] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-09-14T18:02:25.720741] [INFO ] [REMOTE ] FCN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:02:26.083208] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T18:02:26.088560] [INFO ] [REMOTE ] FBP: Full fetch complete (50202 records). [2025-09-14T18:02:26.088696] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-09-14T18:02:26.164797] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-09-14T18:02:26.477366] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-09-14T18:02:26.477685] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-09-14T18:02:26.478422] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-09-14T18:02:26.478575] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-09-14T18:02:26.505581] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T18:02:26.505728] [DEBUG] [LOCAL ] FBP: Trimmed 50202 records to 34097 (keeping 150 days of data) [2025-09-14T18:02:26.734625] [DEBUG] [LOCAL ] FBP: Primary data saved (34097 records). [2025-09-14T18:02:26.734805] [INFO ] [MAIN ] FBP: Full history saved. [2025-09-14T18:02:26.734939] [INFO ] [MAIN ] Update Progress: 807/2370 symbols completed. FBP took 28.3s. Estimated remaining: 2h 45m 7s. Rate: 9.5 symbols/min [2025-09-14T18:02:26.905669] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:02:26.923119] [DEBUG] [LOCAL ] FCPT: Loaded 16212 existing records from primary storage. [2025-09-14T18:02:26.923332] [INFO ] [MAIN ] FCPT: Loaded 16212 existing records. [2025-09-14T18:02:26.966798] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-09-14T18:02:27.108227] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:02:27.108504] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-09-14T18:02:27.108578] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-09-14T18:02:27.109235] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-09-14T18:02:27.109302] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-09-14T18:02:27.465120] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:02:27.477233] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-14T18:02:27.758831] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-09-14T18:02:28.558884] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-09-14T18:02:28.617501] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-14T18:02:29.172185] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T18:02:29.358888] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-09-14T18:02:30.079585] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T18:02:30.158784] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-09-14T18:02:30.697347] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-14T18:02:30.958860] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-09-14T18:02:31.541262] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T18:02:31.758864] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-09-14T18:02:32.329274] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T18:02:32.558962] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-09-14T18:02:32.753490] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T18:02:33.358898] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-09-14T18:02:34.149579] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T18:02:34.158798] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-09-14T18:02:34.958858] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-09-14T18:02:35.072141] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T18:02:35.573496] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-14T18:02:35.758896] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-09-14T18:02:36.558852] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-09-14T18:02:36.588766] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T18:02:37.024456] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-14T18:02:37.358827] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-09-14T18:02:37.913019] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T18:02:38.158868] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-09-14T18:02:38.479932] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T18:02:38.585969] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T18:02:38.589628] [INFO ] [REMOTE ] FBRT: Full fetch complete (37190 records). [2025-09-14T18:02:38.589776] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-09-14T18:02:38.965848] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-09-14T18:02:39.020050] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-09-14T18:02:39.020257] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-09-14T18:02:39.021204] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-09-14T18:02:39.021270] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-09-14T18:02:39.022711] [DEBUG] [LOCAL ] FBRT: Trimmed 37190 records to 25573 (keeping 150 days of data) [2025-09-14T18:02:39.192822] [DEBUG] [LOCAL ] FBRT: Primary data saved (25573 records). [2025-09-14T18:02:39.192997] [INFO ] [MAIN ] FBRT: Full history saved. [2025-09-14T18:02:39.193109] [INFO ] [MAIN ] Update Progress: 808/2370 symbols completed. FBRT took 35.2s. Estimated remaining: 2h 45m 12s. Rate: 9.5 symbols/min [2025-09-14T18:02:39.363079] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:02:39.365508] [DEBUG] [LOCAL ] FCRX: Loaded 481 existing records from primary storage. [2025-09-14T18:02:39.365597] [INFO ] [MAIN ] FCRX: Loaded 481 existing records. [2025-09-14T18:02:39.539724] [WARN ] [MAIN ] FCRX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:02:39.540002] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-09-14T18:02:39.540064] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-14T18:02:39.540252] [DEBUG] [LOCAL ] FCRX: Deleted primary data file. [2025-09-14T18:02:39.540311] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-09-14T18:02:39.764068] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-09-14T18:02:39.915237] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:02:40.272183] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T18:02:40.558855] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-09-14T18:02:41.324971] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T18:02:41.358797] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-09-14T18:02:41.676295] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T18:02:42.059539] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T18:02:42.063605] [INFO ] [REMOTE ] FCF: Full fetch complete (43359 records). [2025-09-14T18:02:42.063774] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-09-14T18:02:42.163996] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-09-14T18:02:42.445118] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-09-14T18:02:42.445229] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-09-14T18:02:42.445967] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-09-14T18:02:42.446029] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-09-14T18:02:42.446991] [DEBUG] [LOCAL ] FCF: Trimmed 43359 records to 28808 (keeping 150 days of data) [2025-09-14T18:02:42.645581] [DEBUG] [LOCAL ] FCF: Primary data saved (28808 records). [2025-09-14T18:02:42.645869] [INFO ] [MAIN ] FCF: Full history saved. [2025-09-14T18:02:42.646022] [INFO ] [MAIN ] Update Progress: 809/2370 symbols completed. FCF took 22.9s. Estimated remaining: 2h 45m 0s. Rate: 9.5 symbols/min [2025-09-14T18:02:42.743664] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-14T18:02:42.877518] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:02:42.888036] [DEBUG] [LOCAL ] FCT: Loaded 6765 existing records from primary storage. [2025-09-14T18:02:42.888240] [INFO ] [MAIN ] FCT: Loaded 6765 existing records. [2025-09-14T18:02:42.963986] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-09-14T18:02:43.070118] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:02:43.070398] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-09-14T18:02:43.070459] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-09-14T18:02:43.070882] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-09-14T18:02:43.070957] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-09-14T18:02:43.455983] [INFO ] [REMOTE ] FCT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:02:43.629685] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:02:43.632315] [INFO ] [REMOTE ] FCN: Full fetch complete (28528 records). [2025-09-14T18:02:43.632407] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-09-14T18:02:43.773512] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-09-14T18:02:43.998082] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-09-14T18:02:43.998191] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-09-14T18:02:43.998774] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-09-14T18:02:43.998829] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-09-14T18:02:43.999541] [DEBUG] [LOCAL ] FCN: Trimmed 28528 records to 19410 (keeping 150 days of data) [2025-09-14T18:02:44.121483] [DEBUG] [LOCAL ] FCN: Primary data saved (19410 records). [2025-09-14T18:02:44.121681] [INFO ] [MAIN ] FCN: Full history saved. [2025-09-14T18:02:44.121785] [INFO ] [MAIN ] Update Progress: 810/2370 symbols completed. FCN took 19.1s. Estimated remaining: 2h 44m 45s. Rate: 9.5 symbols/min [2025-09-14T18:02:44.294437] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:02:44.317073] [DEBUG] [LOCAL ] FCX: Loaded 24065 existing records from primary storage. [2025-09-14T18:02:44.317247] [INFO ] [MAIN ] FCX: Loaded 24065 existing records. [2025-09-14T18:02:44.496905] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:02:44.497217] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-09-14T18:02:44.497279] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-09-14T18:02:44.497985] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-09-14T18:02:44.498050] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-09-14T18:02:44.564124] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-09-14T18:02:44.780867] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-14T18:02:44.859086] [INFO ] [REMOTE ] FCX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:02:44.977463] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-14T18:02:45.358892] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-09-14T18:02:45.789711] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-14T18:02:46.158880] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-09-14T18:02:46.958895] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-09-14T18:02:47.413085] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-14T18:02:47.758793] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-09-14T18:02:48.309078] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-14T18:02:48.558856] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-09-14T18:02:49.175320] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T18:02:49.358832] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-09-14T18:02:49.776882] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-14T18:02:50.158878] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-09-14T18:02:50.624654] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-14T18:02:50.922401] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-14T18:02:50.958830] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-09-14T18:02:51.758841] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-09-14T18:02:52.558865] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-09-14T18:02:53.125140] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-14T18:02:53.227439] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-14T18:02:53.265145] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-14T18:02:53.358846] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-14T18:02:53.768236] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T18:02:53.769103] [INFO ] [REMOTE ] FCRX: Full fetch complete (1257 records). [2025-09-14T18:02:53.769192] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-09-14T18:02:53.946048] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 140 unique days, need 150 days [2025-09-14T18:02:53.946276] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:02:53.946330] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:02:53.946378] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-14T18:02:53.946450] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-14T18:02:53.946501] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-14T18:02:53.946554] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-09-14T18:02:53.946629] [INFO ] [MAIN ] Update Progress: 811/2370 symbols completed. FCRX took 14.8s. Estimated remaining: 2h 44m 45s. Rate: 9.5 symbols/min [2025-09-14T18:02:54.121631] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:02:54.136727] [DEBUG] [LOCAL ] FDP: Loaded 12859 existing records from primary storage. [2025-09-14T18:02:54.136916] [INFO ] [MAIN ] FDP: Loaded 12859 existing records. [2025-09-14T18:02:54.165929] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-09-14T18:02:54.319399] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:02:54.319668] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-09-14T18:02:54.319727] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-09-14T18:02:54.320224] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-09-14T18:02:54.320284] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-09-14T18:02:54.679202] [INFO ] [REMOTE ] FDP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:02:54.958870] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-09-14T18:02:55.477453] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-14T18:02:55.758863] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-09-14T18:02:55.891253] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-14T18:02:56.132964] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-14T18:02:56.137254] [INFO ] [REMOTE ] FCPT: Full fetch complete (40752 records). [2025-09-14T18:02:56.137405] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-09-14T18:02:56.538732] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-09-14T18:02:56.538848] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-09-14T18:02:56.539572] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-09-14T18:02:56.539626] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-09-14T18:02:56.540714] [DEBUG] [LOCAL ] FCPT: Trimmed 40752 records to 27113 (keeping 150 days of data) [2025-09-14T18:02:56.592375] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-09-14T18:02:56.703531] [DEBUG] [LOCAL ] FCPT: Primary data saved (27113 records). [2025-09-14T18:02:56.703718] [INFO ] [MAIN ] FCPT: Full history saved. [2025-09-14T18:02:56.703818] [INFO ] [MAIN ] Update Progress: 812/2370 symbols completed. FCPT took 30.0s. Estimated remaining: 2h 44m 32s. Rate: 9.5 symbols/min [2025-09-14T18:02:56.877760] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:02:56.891717] [DEBUG] [LOCAL ] FDS: Loaded 11556 existing records from primary storage. [2025-09-14T18:02:56.891910] [INFO ] [MAIN ] FDS: Loaded 11556 existing records. [2025-09-14T18:02:57.067810] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:02:57.068083] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-09-14T18:02:57.068145] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-09-14T18:02:57.068597] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-09-14T18:02:57.068690] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-09-14T18:02:57.363998] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-09-14T18:02:57.417686] [INFO ] [REMOTE ] FDS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:02:58.158864] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-09-14T18:02:58.704911] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T18:02:58.756507] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-14T18:02:58.958896] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-09-14T18:02:59.069296] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T18:02:59.758840] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-09-14T18:03:00.293203] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T18:03:00.558893] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-09-14T18:03:01.358836] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-09-14T18:03:02.117770] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-14T18:03:02.145590] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T18:03:02.158779] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-09-14T18:03:02.958897] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-09-14T18:03:03.527310] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-14T18:03:03.758887] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-09-14T18:03:03.993241] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-14T18:03:04.558855] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-09-14T18:03:04.687713] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-14T18:03:05.358906] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-09-14T18:03:05.714919] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T18:03:06.158839] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-09-14T18:03:06.549871] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (3.59 seconds). [2025-09-14T18:03:06.571124] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-14T18:03:06.958820] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-09-14T18:03:07.349813] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T18:03:07.758853] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-09-14T18:03:08.032917] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-14T18:03:08.558889] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-09-14T18:03:08.768435] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T18:03:09.358889] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-09-14T18:03:09.941622] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T18:03:10.158883] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-09-14T18:03:10.958848] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-09-14T18:03:11.561280] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-14T18:03:11.687236] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-14T18:03:11.758839] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-09-14T18:03:12.427273] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T18:03:12.446589] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:03:12.450829] [INFO ] [REMOTE ] FDS: Full fetch complete (26938 records). [2025-09-14T18:03:12.451042] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-09-14T18:03:12.564144] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-09-14T18:03:12.846963] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-09-14T18:03:12.847086] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-09-14T18:03:12.847789] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-09-14T18:03:12.847850] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-09-14T18:03:12.848665] [DEBUG] [LOCAL ] FDS: Trimmed 26938 records to 18399 (keeping 150 days of data) [2025-09-14T18:03:12.966272] [DEBUG] [LOCAL ] FDS: Primary data saved (18399 records). [2025-09-14T18:03:12.966468] [INFO ] [MAIN ] FDS: Full history saved. [2025-09-14T18:03:12.966572] [INFO ] [MAIN ] Update Progress: 813/2370 symbols completed. FDS took 16.3s. Estimated remaining: 2h 44m 45s. Rate: 9.5 symbols/min [2025-09-14T18:03:13.139925] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:03:13.163852] [DEBUG] [LOCAL ] FDX: Loaded 23067 existing records from primary storage. [2025-09-14T18:03:13.164050] [INFO ] [MAIN ] FDX: Loaded 23067 existing records. [2025-09-14T18:03:13.339032] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:03:13.339301] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-09-14T18:03:13.339361] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-09-14T18:03:13.340041] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-09-14T18:03:13.340104] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-09-14T18:03:13.368846] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-09-14T18:03:13.646498] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-14T18:03:13.715695] [INFO ] [REMOTE ] FDX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:03:14.158862] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-09-14T18:03:14.963932] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-09-14T18:03:14.972560] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-14T18:03:14.978528] [INFO ] [REMOTE ] FCX: Full fetch complete (58379 records). [2025-09-14T18:03:14.978686] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-09-14T18:03:15.376008] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-09-14T18:03:15.376698] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-14T18:03:15.376746] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-09-14T18:03:15.379538] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-09-14T18:03:15.379988] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-09-14T18:03:15.380055] [INFO ] [REMOTE ] FCT: Full fetch complete (15380 records). [2025-09-14T18:03:15.380320] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-09-14T18:03:15.482588] [DEBUG] [LOCAL ] FCX: Trimmed 58379 records to 40442 (keeping 150 days of data) [2025-09-14T18:03:15.769442] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-09-14T18:03:15.869850] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-09-14T18:03:15.873960] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-09-14T18:03:15.877958] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-09-14T18:03:15.881503] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-09-14T18:03:15.882551] [DEBUG] [LOCAL ] FCT: Trimmed 15380 records to 10451 (keeping 150 days of data) [2025-09-14T18:03:16.068050] [DEBUG] [LOCAL ] FCX: Primary data saved (40442 records). [2025-09-14T18:03:16.071393] [INFO ] [MAIN ] FCX: Full history saved. [2025-09-14T18:03:16.073249] [DEBUG] [LOCAL ] FCT: Primary data saved (10451 records). [2025-09-14T18:03:16.073359] [INFO ] [MAIN ] Update Progress: 814/2370 symbols completed. FCX took 32.0s. Estimated remaining: 2h 44m 32s. Rate: 9.5 symbols/min [2025-09-14T18:03:16.073448] [INFO ] [MAIN ] FCT: Full history saved. [2025-09-14T18:03:16.120071] [INFO ] [MAIN ] Update Progress: 815/2370 symbols completed. FCT took 33.5s. Estimated remaining: 2h 44m 14s. Rate: 9.5 symbols/min [2025-09-14T18:03:16.408491] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:03:16.431100] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:03:16.436434] [DEBUG] [LOCAL ] FENG: Loaded 578 existing records from primary storage. [2025-09-14T18:03:16.436620] [INFO ] [MAIN ] FENG: Loaded 578 existing records. [2025-09-14T18:03:16.563758] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-14T18:03:16.655133] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-09-14T18:03:16.658351] [WARN ] [MAIN ] FENG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:03:16.660232] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-09-14T18:03:16.661194] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-14T18:03:16.670498] [DEBUG] [LOCAL ] FENG: Deleted primary data file. [2025-09-14T18:03:16.672348] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-09-14T18:03:16.696373] [DEBUG] [LOCAL ] FE: Loaded 23888 existing records from primary storage. [2025-09-14T18:03:16.756328] [INFO ] [MAIN ] FE: Loaded 23888 existing records. [2025-09-14T18:03:17.226332] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:03:17.262773] [INFO ] [REMOTE ] FENG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:03:17.263007] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-09-14T18:03:17.263538] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-09-14T18:03:17.264389] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-09-14T18:03:17.264463] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-09-14T18:03:17.366443] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-09-14T18:03:17.648386] [INFO ] [REMOTE ] FE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:03:17.814122] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-14T18:03:17.887738] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-14T18:03:18.107901] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-14T18:03:18.158780] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-09-14T18:03:18.958917] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-09-14T18:03:19.460438] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-14T18:03:19.506767] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T18:03:19.758914] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-09-14T18:03:20.558848] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-09-14T18:03:21.231336] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-14T18:03:21.358848] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-09-14T18:03:21.587014] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-14T18:03:22.158831] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-09-14T18:03:22.958841] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-09-14T18:03:23.426871] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-14T18:03:23.578198] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T18:03:23.581290] [INFO ] [REMOTE ] FDP: Full fetch complete (33147 records). [2025-09-14T18:03:23.581390] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-09-14T18:03:23.759695] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-09-14T18:03:23.970301] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-09-14T18:03:23.970441] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-09-14T18:03:23.971168] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-09-14T18:03:23.971236] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-09-14T18:03:23.972548] [DEBUG] [LOCAL ] FDP: Trimmed 33147 records to 22780 (keeping 150 days of data) [2025-09-14T18:03:24.112523] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T18:03:24.170724] [DEBUG] [LOCAL ] FDP: Primary data saved (22780 records). [2025-09-14T18:03:24.170909] [INFO ] [MAIN ] FDP: Full history saved. [2025-09-14T18:03:24.171035] [INFO ] [MAIN ] Update Progress: 816/2370 symbols completed. FDP took 30.2s. Estimated remaining: 2h 44m 11s. Rate: 9.5 symbols/min [2025-09-14T18:03:24.350066] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:03:24.370540] [DEBUG] [LOCAL ] FERG: Loaded 21137 existing records from primary storage. [2025-09-14T18:03:24.370726] [INFO ] [MAIN ] FERG: Loaded 21137 existing records. [2025-09-14T18:03:24.547320] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:03:24.547604] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-09-14T18:03:24.547693] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-09-14T18:03:24.548361] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-09-14T18:03:24.548427] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-09-14T18:03:24.568558] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-09-14T18:03:24.913335] [INFO ] [REMOTE ] FERG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:03:25.358887] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-09-14T18:03:26.158927] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-09-14T18:03:26.244521] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-14T18:03:26.967304] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-09-14T18:03:26.974246] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-14T18:03:27.319885] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T18:03:27.662791] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-14T18:03:27.758785] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-09-14T18:03:28.558956] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-09-14T18:03:28.951301] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-14T18:03:29.040669] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-14T18:03:29.358887] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-09-14T18:03:29.693373] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T18:03:29.711853] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-14T18:03:30.158863] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-09-14T18:03:30.958966] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-09-14T18:03:31.289019] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-14T18:03:31.758819] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-09-14T18:03:31.829234] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T18:03:32.558839] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-14T18:03:32.971435] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T18:03:32.972800] [INFO ] [REMOTE ] FENG: Full fetch complete (1673 records). [2025-09-14T18:03:32.972940] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-09-14T18:03:33.167422] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-14T18:03:33.167672] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:03:33.167728] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:03:33.167772] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-14T18:03:33.167866] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-14T18:03:33.167917] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-09-14T18:03:33.167970] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-09-14T18:03:33.168060] [INFO ] [MAIN ] Update Progress: 817/2370 symbols completed. FENG took 17.0s. Estimated remaining: 2h 44m 9s. Rate: 9.5 symbols/min [2025-09-14T18:03:33.356287] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:03:33.358858] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-09-14T18:03:33.367706] [DEBUG] [LOCAL ] FET: Loaded 6241 existing records from primary storage. [2025-09-14T18:03:33.367913] [INFO ] [MAIN ] FET: Loaded 6241 existing records. [2025-09-14T18:03:33.557195] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:03:33.557660] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-09-14T18:03:33.557758] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-09-14T18:03:33.558147] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-09-14T18:03:33.558215] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-09-14T18:03:33.995159] [INFO ] [REMOTE ] FET: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:03:34.038211] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-14T18:03:34.158868] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-09-14T18:03:34.958896] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-09-14T18:03:35.424807] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-14T18:03:35.597972] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-14T18:03:35.758843] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-09-14T18:03:35.822534] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T18:03:36.558923] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-09-14T18:03:37.358805] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-09-14T18:03:37.454040] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-14T18:03:38.158899] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-09-14T18:03:38.629704] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-14T18:03:38.958895] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-09-14T18:03:39.139824] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-14T18:03:39.184327] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-14T18:03:39.758851] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-09-14T18:03:40.558797] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-09-14T18:03:41.107634] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-14T18:03:41.358866] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-09-14T18:03:41.704839] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-14T18:03:42.051162] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:03:42.056750] [INFO ] [REMOTE ] FDX: Full fetch complete (55825 records). [2025-09-14T18:03:42.056934] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-09-14T18:03:42.159684] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-09-14T18:03:42.489741] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-09-14T18:03:42.490158] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-09-14T18:03:42.491315] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-09-14T18:03:42.506959] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-09-14T18:03:42.522961] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-14T18:03:42.536187] [DEBUG] [LOCAL ] FDX: Trimmed 55825 records to 38650 (keeping 150 days of data) [2025-09-14T18:03:42.833689] [DEBUG] [LOCAL ] FDX: Primary data saved (38650 records). [2025-09-14T18:03:42.833970] [INFO ] [MAIN ] FDX: Full history saved. [2025-09-14T18:03:42.834128] [INFO ] [MAIN ] Update Progress: 818/2370 symbols completed. FDX took 29.9s. Estimated remaining: 2h 44m 9s. Rate: 9.5 symbols/min [2025-09-14T18:03:42.964090] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-09-14T18:03:43.016974] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:03:43.030472] [DEBUG] [LOCAL ] FF: Loaded 10550 existing records from primary storage. [2025-09-14T18:03:43.031241] [INFO ] [MAIN ] FF: Loaded 10550 existing records. [2025-09-14T18:03:43.217842] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:03:43.218206] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-09-14T18:03:43.218348] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-09-14T18:03:43.218912] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-09-14T18:03:43.219012] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-09-14T18:03:43.597928] [INFO ] [REMOTE ] FF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:03:43.758898] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-09-14T18:03:44.080247] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-14T18:03:44.558926] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-09-14T18:03:44.733860] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-14T18:03:44.786441] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-14T18:03:45.239209] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:03:45.249045] [INFO ] [REMOTE ] FE: Full fetch complete (58095 records). [2025-09-14T18:03:45.249405] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-09-14T18:03:45.364463] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-09-14T18:03:45.728982] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-09-14T18:03:45.729123] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-09-14T18:03:45.730061] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-09-14T18:03:45.730123] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-09-14T18:03:45.731622] [DEBUG] [LOCAL ] FE: Trimmed 58095 records to 40224 (keeping 150 days of data) [2025-09-14T18:03:45.987744] [DEBUG] [LOCAL ] FE: Primary data saved (40224 records). [2025-09-14T18:03:45.987913] [INFO ] [MAIN ] FE: Full history saved. [2025-09-14T18:03:45.988007] [INFO ] [MAIN ] Update Progress: 819/2370 symbols completed. FE took 29.9s. Estimated remaining: 2h 43m 57s. Rate: 9.5 symbols/min [2025-09-14T18:03:46.163177] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:03:46.163308] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-09-14T18:03:46.169880] [DEBUG] [LOCAL ] FFA: Loaded 2112 existing records from primary storage. [2025-09-14T18:03:46.170333] [INFO ] [MAIN ] FFA: Loaded 2112 existing records. [2025-09-14T18:03:46.376838] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:03:46.378054] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-09-14T18:03:46.378120] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-09-14T18:03:46.378365] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-09-14T18:03:46.378434] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-09-14T18:03:46.725894] [INFO ] [REMOTE ] FFA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:03:46.849125] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-14T18:03:46.958901] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-09-14T18:03:47.105159] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-14T18:03:47.626048] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-14T18:03:47.758835] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-09-14T18:03:48.526338] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-14T18:03:48.558792] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-09-14T18:03:49.305150] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-14T18:03:49.358865] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-09-14T18:03:50.158883] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-09-14T18:03:50.713083] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-14T18:03:50.958875] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-09-14T18:03:51.623533] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-14T18:03:51.669071] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-14T18:03:51.674986] [INFO ] [REMOTE ] FERG: Full fetch complete (53134 records). [2025-09-14T18:03:51.675194] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-09-14T18:03:51.764401] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-09-14T18:03:52.079683] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-09-14T18:03:52.079831] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-09-14T18:03:52.080928] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-09-14T18:03:52.081001] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-09-14T18:03:52.082765] [DEBUG] [LOCAL ] FERG: Trimmed 53134 records to 36237 (keeping 150 days of data) [2025-09-14T18:03:52.341956] [DEBUG] [LOCAL ] FERG: Primary data saved (36237 records). [2025-09-14T18:03:52.342194] [INFO ] [MAIN ] FERG: Full history saved. [2025-09-14T18:03:52.342318] [INFO ] [MAIN ] Update Progress: 820/2370 symbols completed. FERG took 28.2s. Estimated remaining: 2h 43m 51s. Rate: 9.5 symbols/min [2025-09-14T18:03:52.470693] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-14T18:03:52.538519] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:03:52.549725] [DEBUG] [LOCAL ] FFC: Loaded 7478 existing records from primary storage. [2025-09-14T18:03:52.549965] [INFO ] [MAIN ] FFC: Loaded 7478 existing records. [2025-09-14T18:03:52.563999] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-09-14T18:03:52.762585] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:03:52.763068] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-09-14T18:03:52.763137] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-09-14T18:03:52.763469] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-09-14T18:03:52.763530] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-09-14T18:03:53.130251] [INFO ] [REMOTE ] FFC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:03:53.240725] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-14T18:03:53.358868] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-09-14T18:03:54.158875] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-09-14T18:03:54.359692] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-14T18:03:54.958903] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-09-14T18:03:54.985997] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T18:03:55.531708] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-14T18:03:55.758862] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-09-14T18:03:56.293209] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T18:03:56.295181] [INFO ] [REMOTE ] FFA: Full fetch complete (5978 records). [2025-09-14T18:03:56.295289] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-09-14T18:03:56.563999] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-09-14T18:03:56.702833] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-09-14T18:03:56.702983] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-09-14T18:03:56.703335] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-09-14T18:03:56.703398] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-09-14T18:03:56.704107] [DEBUG] [LOCAL ] FFA: Trimmed 5978 records to 3498 (keeping 150 days of data) [2025-09-14T18:03:56.729064] [DEBUG] [LOCAL ] FFA: Primary data saved (3498 records). [2025-09-14T18:03:56.729281] [INFO ] [MAIN ] FFA: Full history saved. [2025-09-14T18:03:56.729432] [INFO ] [MAIN ] Update Progress: 821/2370 symbols completed. FFA took 10.7s. Estimated remaining: 2h 43m 40s. Rate: 9.5 symbols/min [2025-09-14T18:03:56.909055] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:03:56.929548] [DEBUG] [LOCAL ] FFWM: Loaded 15821 existing records from primary storage. [2025-09-14T18:03:56.929799] [INFO ] [MAIN ] FFWM: Loaded 15821 existing records. [2025-09-14T18:03:57.129600] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:03:57.130011] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-09-14T18:03:57.130090] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-14T18:03:57.130538] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-09-14T18:03:57.130613] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-09-14T18:03:57.364045] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-09-14T18:03:57.517690] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:03:57.917221] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-14T18:03:58.161799] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-09-14T18:03:58.167635] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-14T18:03:58.958865] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-09-14T18:03:59.676735] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T18:03:59.758832] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-09-14T18:04:00.060930] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T18:04:00.558831] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-09-14T18:04:00.757163] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-14T18:04:01.358863] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-09-14T18:04:01.517152] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-14T18:04:02.158895] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-09-14T18:04:02.748517] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-14T18:04:02.958853] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-09-14T18:04:03.758915] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-09-14T18:04:03.983821] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T18:04:04.292433] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-14T18:04:04.558864] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-09-14T18:04:04.716474] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-14T18:04:05.358858] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-09-14T18:04:05.554565] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-14T18:04:06.158828] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-09-14T18:04:06.556565] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-14T18:04:06.958833] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-09-14T18:04:07.182431] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-14T18:04:07.758899] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-09-14T18:04:07.964663] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-14T18:04:07.967356] [INFO ] [REMOTE ] FF: Full fetch complete (28201 records). [2025-09-14T18:04:07.967457] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-09-14T18:04:08.344636] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-09-14T18:04:08.344773] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-09-14T18:04:08.345501] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-09-14T18:04:08.345587] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-09-14T18:04:08.346443] [DEBUG] [LOCAL ] FF: Trimmed 28201 records to 18158 (keeping 150 days of data) [2025-09-14T18:04:08.466691] [DEBUG] [LOCAL ] FF: Primary data saved (18158 records). [2025-09-14T18:04:08.466842] [INFO ] [MAIN ] FF: Full history saved. [2025-09-14T18:04:08.466983] [INFO ] [MAIN ] Update Progress: 822/2370 symbols completed. FF took 25.6s. Estimated remaining: 2h 43m 44s. Rate: 9.5 symbols/min [2025-09-14T18:04:08.564797] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-09-14T18:04:08.638748] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:04:08.647901] [DEBUG] [LOCAL ] FG: Loaded 8386 existing records from primary storage. [2025-09-14T18:04:08.648043] [INFO ] [MAIN ] FG: Loaded 8386 existing records. [2025-09-14T18:04:08.798888] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-14T18:04:08.832060] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:04:08.835190] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-09-14T18:04:08.835447] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-09-14T18:04:08.836010] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-09-14T18:04:08.835930] [INFO ] [REMOTE ] FFC: Full fetch complete (18013 records). [2025-09-14T18:04:08.836175] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-09-14T18:04:08.856475] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-09-14T18:04:09.365937] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-09-14T18:04:09.517683] [INFO ] [REMOTE ] FG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:04:09.604654] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-09-14T18:04:09.604781] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-09-14T18:04:09.605287] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-09-14T18:04:09.605343] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-09-14T18:04:09.606005] [DEBUG] [LOCAL ] FFC: Trimmed 18013 records to 12077 (keeping 150 days of data) [2025-09-14T18:04:09.696953] [DEBUG] [LOCAL ] FFC: Primary data saved (12077 records). [2025-09-14T18:04:09.697156] [INFO ] [MAIN ] FFC: Full history saved. [2025-09-14T18:04:09.697289] [INFO ] [MAIN ] Update Progress: 823/2370 symbols completed. FFC took 17.4s. Estimated remaining: 2h 43m 28s. Rate: 9.5 symbols/min [2025-09-14T18:04:09.873399] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:04:09.878673] [DEBUG] [LOCAL ] FGN: Loaded 1768 existing records from primary storage. [2025-09-14T18:04:09.878821] [INFO ] [MAIN ] FGN: Loaded 1768 existing records. [2025-09-14T18:04:10.070173] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:04:10.070900] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-09-14T18:04:10.071285] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-09-14T18:04:10.071633] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-09-14T18:04:10.071834] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-09-14T18:04:10.161519] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-09-14T18:04:10.298533] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T18:04:10.505021] [INFO ] [REMOTE ] FGN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:04:10.514143] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-14T18:04:10.902076] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-14T18:04:10.958873] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-09-14T18:04:11.571348] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-14T18:04:11.758877] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-09-14T18:04:12.505911] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-14T18:04:12.558875] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-09-14T18:04:13.358850] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-09-14T18:04:13.615967] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-14T18:04:13.983500] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-14T18:04:14.158820] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-09-14T18:04:14.958834] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-09-14T18:04:15.139552] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-14T18:04:15.533658] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-14T18:04:15.758878] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-09-14T18:04:16.558811] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-09-14T18:04:16.774036] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-14T18:04:16.776403] [INFO ] [REMOTE ] FET: Full fetch complete (13564 records). [2025-09-14T18:04:16.776517] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-09-14T18:04:17.146531] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-09-14T18:04:17.146690] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-09-14T18:04:17.147070] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-09-14T18:04:17.147138] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-09-14T18:04:17.147708] [DEBUG] [LOCAL ] FET: Trimmed 13564 records to 9010 (keeping 150 days of data) [2025-09-14T18:04:17.206665] [DEBUG] [LOCAL ] FET: Primary data saved (9010 records). [2025-09-14T18:04:17.206922] [INFO ] [MAIN ] FET: Full history saved. [2025-09-14T18:04:17.207061] [INFO ] [MAIN ] Update Progress: 824/2370 symbols completed. FET took 44.0s. Estimated remaining: 2h 43m 24s. Rate: 9.5 symbols/min [2025-09-14T18:04:17.376459] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-09-14T18:04:17.379075] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:04:17.383920] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T18:04:17.390799] [DEBUG] [LOCAL ] FGSN: Loaded 2493 existing records from primary storage. [2025-09-14T18:04:17.390900] [INFO ] [MAIN ] FGSN: Loaded 2493 existing records. [2025-09-14T18:04:17.575356] [WARN ] [MAIN ] FGSN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:04:17.575661] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-09-14T18:04:17.575756] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-14T18:04:17.576061] [DEBUG] [LOCAL ] FGSN: Deleted primary data file. [2025-09-14T18:04:17.576123] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-09-14T18:04:17.934353] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:04:18.158850] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-09-14T18:04:18.651674] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-14T18:04:18.813952] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-14T18:04:18.958853] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-09-14T18:04:19.758883] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-09-14T18:04:20.281897] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-14T18:04:20.525058] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-14T18:04:20.558802] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-09-14T18:04:21.358867] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-09-14T18:04:21.713597] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-14T18:04:21.960259] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-14T18:04:22.158836] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-09-14T18:04:22.958863] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-09-14T18:04:23.427523] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T18:04:23.579355] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-14T18:04:23.758892] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-09-14T18:04:24.216694] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-14T18:04:24.217921] [INFO ] [REMOTE ] FGN: Full fetch complete (4325 records). [2025-09-14T18:04:24.218029] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-09-14T18:04:24.562744] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-09-14T18:04:24.587109] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-09-14T18:04:24.587218] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-09-14T18:04:24.587381] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-09-14T18:04:24.587434] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-09-14T18:04:24.587884] [DEBUG] [LOCAL ] FGN: Trimmed 4325 records to 2766 (keeping 150 days of data) [2025-09-14T18:04:24.606837] [DEBUG] [LOCAL ] FGN: Primary data saved (2766 records). [2025-09-14T18:04:24.607008] [INFO ] [MAIN ] FGN: Full history saved. [2025-09-14T18:04:24.607145] [INFO ] [MAIN ] Update Progress: 825/2370 symbols completed. FGN took 14.9s. Estimated remaining: 2h 43m 20s. Rate: 9.5 symbols/min [2025-09-14T18:04:24.779590] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:04:24.798778] [DEBUG] [LOCAL ] FHI: Loaded 17471 existing records from primary storage. [2025-09-14T18:04:24.798959] [INFO ] [MAIN ] FHI: Loaded 17471 existing records. [2025-09-14T18:04:24.978262] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:04:24.978521] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-09-14T18:04:24.978584] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-09-14T18:04:24.979209] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-09-14T18:04:24.979279] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-09-14T18:04:25.340253] [INFO ] [REMOTE ] FHI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:04:25.358784] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-09-14T18:04:25.805516] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-14T18:04:25.809375] [INFO ] [REMOTE ] FFWM: Full fetch complete (39541 records). [2025-09-14T18:04:25.809488] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-09-14T18:04:26.163978] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-09-14T18:04:26.211262] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-09-14T18:04:26.211375] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-09-14T18:04:26.212075] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-09-14T18:04:26.212133] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-09-14T18:04:26.213151] [DEBUG] [LOCAL ] FFWM: Trimmed 39541 records to 26759 (keeping 150 days of data) [2025-09-14T18:04:26.379923] [DEBUG] [LOCAL ] FFWM: Primary data saved (26759 records). [2025-09-14T18:04:26.380090] [INFO ] [MAIN ] FFWM: Full history saved. [2025-09-14T18:04:26.380190] [INFO ] [MAIN ] Update Progress: 826/2370 symbols completed. FFWM took 29.7s. Estimated remaining: 2h 43m 5s. Rate: 9.5 symbols/min [2025-09-14T18:04:26.558520] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:04:26.582516] [DEBUG] [LOCAL ] FHN: Loaded 23930 existing records from primary storage. [2025-09-14T18:04:26.582707] [INFO ] [MAIN ] FHN: Loaded 23930 existing records. [2025-09-14T18:04:26.757658] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:04:26.757937] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-09-14T18:04:26.757996] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-09-14T18:04:26.758674] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-09-14T18:04:26.758736] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-09-14T18:04:26.970384] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-09-14T18:04:27.115189] [INFO ] [REMOTE ] FHN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:04:27.135088] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T18:04:27.523767] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-14T18:04:27.758882] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-09-14T18:04:27.822047] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-14T18:04:28.558855] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-09-14T18:04:29.358856] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-09-14T18:04:29.566882] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T18:04:29.921480] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-14T18:04:30.158867] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-09-14T18:04:30.193245] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T18:04:30.958852] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-09-14T18:04:31.758846] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-09-14T18:04:32.034319] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-14T18:04:32.558812] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-09-14T18:04:32.654721] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-14T18:04:33.055213] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-14T18:04:33.246323] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-14T18:04:33.358847] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-09-14T18:04:34.158836] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-09-14T18:04:34.958799] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-09-14T18:04:35.051429] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-14T18:04:35.491581] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-14T18:04:35.758837] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-09-14T18:04:36.051218] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T18:04:36.226860] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-14T18:04:36.558891] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-09-14T18:04:37.358904] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-09-14T18:04:37.428393] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T18:04:37.920829] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T18:04:37.922986] [INFO ] [REMOTE ] FGSN: Full fetch complete (5586 records). [2025-09-14T18:04:37.923159] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-09-14T18:04:38.160398] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-09-14T18:04:38.396249] [DEBUG] [VALIDATOR ] FGSN: All expected trading days are present. [2025-09-14T18:04:38.396405] [DEBUG] [VALIDATOR ] FGSN: Primary data validation passed. [2025-09-14T18:04:38.396671] [INFO ] [MAIN ] FGSN: Fetched primary data is valid. [2025-09-14T18:04:38.396733] [DEBUG] [LOCAL ] FGSN: Saving primary data. [2025-09-14T18:04:38.397207] [DEBUG] [LOCAL ] FGSN: Trimmed 5586 records to 3585 (keeping 150 days of data) [2025-09-14T18:04:38.422932] [DEBUG] [LOCAL ] FGSN: Primary data saved (3585 records). [2025-09-14T18:04:38.423215] [INFO ] [MAIN ] FGSN: Full history saved. [2025-09-14T18:04:38.423378] [INFO ] [MAIN ] Update Progress: 827/2370 symbols completed. FGSN took 21.2s. Estimated remaining: 2h 43m 9s. Rate: 9.5 symbols/min [2025-09-14T18:04:38.622527] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:04:38.654927] [DEBUG] [LOCAL ] FI: Loaded 24037 existing records from primary storage. [2025-09-14T18:04:38.655161] [INFO ] [MAIN ] FI: Loaded 24037 existing records. [2025-09-14T18:04:38.839587] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:04:38.839972] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-09-14T18:04:38.840051] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-09-14T18:04:38.840878] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-09-14T18:04:38.840944] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-09-14T18:04:38.964052] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-09-14T18:04:39.296176] [INFO ] [REMOTE ] FI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:04:39.758882] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-09-14T18:04:39.903924] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T18:04:40.558902] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-09-14T18:04:40.661633] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-14T18:04:41.358934] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-09-14T18:04:41.895349] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-14T18:04:42.153825] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T18:04:42.164051] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-09-14T18:04:42.891864] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T18:04:42.958797] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-09-14T18:04:43.286707] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T18:04:43.758853] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-09-14T18:04:44.558813] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-09-14T18:04:44.728576] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-14T18:04:44.869378] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-14T18:04:45.358837] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-09-14T18:04:46.158829] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-09-14T18:04:46.271419] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-14T18:04:46.273614] [INFO ] [REMOTE ] FG: Full fetch complete (23074 records). [2025-09-14T18:04:46.273719] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-09-14T18:04:46.649207] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-09-14T18:04:46.649316] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-09-14T18:04:46.649839] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-09-14T18:04:46.649965] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-09-14T18:04:46.650815] [DEBUG] [LOCAL ] FG: Trimmed 23074 records to 15506 (keeping 150 days of data) [2025-09-14T18:04:46.751413] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-14T18:04:46.784977] [DEBUG] [LOCAL ] FG: Primary data saved (15506 records). [2025-09-14T18:04:46.785136] [INFO ] [MAIN ] FG: Full history saved. [2025-09-14T18:04:46.785257] [INFO ] [MAIN ] Update Progress: 828/2370 symbols completed. FG took 38.3s. Estimated remaining: 2h 43m 7s. Rate: 9.5 symbols/min [2025-09-14T18:04:46.955847] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:04:46.958851] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-09-14T18:04:46.968261] [DEBUG] [LOCAL ] FICO: Loaded 10582 existing records from primary storage. [2025-09-14T18:04:46.968375] [INFO ] [MAIN ] FICO: Loaded 10582 existing records. [2025-09-14T18:04:47.148619] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:04:47.148898] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-09-14T18:04:47.148958] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-09-14T18:04:47.149328] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-09-14T18:04:47.149388] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-09-14T18:04:47.503636] [INFO ] [REMOTE ] FICO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:04:47.758835] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-09-14T18:04:47.983985] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T18:04:48.397425] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T18:04:48.531585] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-14T18:04:48.558786] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-09-14T18:04:49.358802] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-09-14T18:04:49.725493] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T18:04:50.158869] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-09-14T18:04:50.958834] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-09-14T18:04:51.249661] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T18:04:51.317869] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-14T18:04:51.351227] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T18:04:51.357152] [INFO ] [REMOTE ] FHN: Full fetch complete (58017 records). [2025-09-14T18:04:51.357278] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-09-14T18:04:51.736586] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-09-14T18:04:51.736746] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-09-14T18:04:51.737634] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-09-14T18:04:51.737723] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-09-14T18:04:51.739142] [DEBUG] [LOCAL ] FHN: Trimmed 58017 records to 40144 (keeping 150 days of data) [2025-09-14T18:04:51.800857] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-09-14T18:04:52.007273] [DEBUG] [LOCAL ] FHN: Primary data saved (40144 records). [2025-09-14T18:04:52.007438] [INFO ] [MAIN ] FHN: Full history saved. [2025-09-14T18:04:52.007535] [INFO ] [MAIN ] Update Progress: 829/2370 symbols completed. FHN took 25.6s. Estimated remaining: 2h 42m 58s. Rate: 9.5 symbols/min [2025-09-14T18:04:52.176579] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:04:52.189332] [DEBUG] [LOCAL ] FIG: Loaded 11805 existing records from primary storage. [2025-09-14T18:04:52.189485] [INFO ] [MAIN ] FIG: Loaded 11805 existing records. [2025-09-14T18:04:52.369854] [WARN ] [MAIN ] FIG: Insufficient historical data. Have data from 2025-07-31, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:04:52.370240] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-09-14T18:04:52.370327] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-14T18:04:52.376358] [DEBUG] [LOCAL ] FIG: Deleted primary data file. [2025-09-14T18:04:52.380703] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-09-14T18:04:52.387106] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T18:04:52.457322] [INFO ] [REMOTE ] FHI: Full fetch complete (43881 records). [2025-09-14T18:04:52.490911] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-09-14T18:04:52.563961] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-09-14T18:04:53.087159] [INFO ] [REMOTE ] FIG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:04:53.156672] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-09-14T18:04:53.156806] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-09-14T18:04:53.157632] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-09-14T18:04:53.157712] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-09-14T18:04:53.158969] [DEBUG] [LOCAL ] FHI: Trimmed 43881 records to 30397 (keeping 150 days of data) [2025-09-14T18:04:53.355126] [DEBUG] [LOCAL ] FHI: Primary data saved (30397 records). [2025-09-14T18:04:53.355331] [INFO ] [MAIN ] FHI: Full history saved. [2025-09-14T18:04:53.355461] [INFO ] [MAIN ] Update Progress: 830/2370 symbols completed. FHI took 28.7s. Estimated remaining: 2h 42m 43s. Rate: 9.5 symbols/min [2025-09-14T18:04:53.367981] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-09-14T18:04:53.534347] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:04:53.555768] [DEBUG] [LOCAL ] FIGS: Loaded 22026 existing records from primary storage. [2025-09-14T18:04:53.556079] [INFO ] [MAIN ] FIGS: Loaded 22026 existing records. [2025-09-14T18:04:53.742052] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:04:53.742342] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-09-14T18:04:53.742403] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-09-14T18:04:53.743075] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-09-14T18:04:53.743144] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-09-14T18:04:53.852142] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-14T18:04:54.126551] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:04:54.147050] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T18:04:54.158777] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-09-14T18:04:54.958924] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-09-14T18:04:55.113399] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-14T18:04:55.345348] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-14T18:04:55.758852] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-09-14T18:04:56.558875] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-09-14T18:04:57.088822] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-14T18:04:57.358838] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-09-14T18:04:58.061624] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-14T18:04:58.158852] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-09-14T18:04:58.379555] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-14T18:04:58.534683] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-14T18:04:58.958866] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-09-14T18:04:59.758841] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-09-14T18:05:00.152741] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T18:05:00.155167] [INFO ] [REMOTE ] FICO: Full fetch complete (21778 records). [2025-09-14T18:05:00.155259] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-09-14T18:05:00.518350] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-09-14T18:05:00.518461] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-09-14T18:05:00.519025] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-09-14T18:05:00.519090] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-09-14T18:05:00.519916] [DEBUG] [LOCAL ] FICO: Trimmed 21778 records to 16252 (keeping 150 days of data) [2025-09-14T18:05:00.563761] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-09-14T18:05:00.629857] [DEBUG] [LOCAL ] FICO: Primary data saved (16252 records). [2025-09-14T18:05:00.630188] [INFO ] [MAIN ] FICO: Full history saved. [2025-09-14T18:05:00.630368] [INFO ] [MAIN ] Update Progress: 831/2370 symbols completed. FICO took 13.8s. Estimated remaining: 2h 42m 38s. Rate: 9.5 symbols/min [2025-09-14T18:05:00.805146] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:05:00.841931] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-14T18:05:00.861116] [DEBUG] [LOCAL ] FIHL: Loaded 17662 existing records from primary storage. [2025-09-14T18:05:00.861288] [INFO ] [MAIN ] FIHL: Loaded 17662 existing records. [2025-09-14T18:05:01.041221] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:05:01.041667] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-09-14T18:05:01.041743] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-09-14T18:05:01.042402] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-09-14T18:05:01.042470] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-09-14T18:05:01.374952] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-09-14T18:05:01.424711] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:05:02.158833] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-09-14T18:05:02.550802] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-14T18:05:02.750461] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-14T18:05:02.958837] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-09-14T18:05:03.286321] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-14T18:05:03.758838] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-09-14T18:05:03.989255] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-14T18:05:04.558818] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-09-14T18:05:04.846811] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:05:04.847157] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-09-14T18:05:05.358817] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-07. [2025-09-14T18:05:05.719192] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-14T18:05:05.755730] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-14T18:05:06.158772] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-09-14T18:05:06.958853] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-08. [2025-09-14T18:05:07.758929] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-09-14T18:05:08.540770] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-14T18:05:08.558771] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-09-14T18:05:09.358855] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-09-14T18:05:09.517938] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T18:05:09.730824] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-09-14T18:05:10.158856] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-09. [2025-09-14T18:05:10.667423] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-14T18:05:10.780312] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-14T18:05:10.958853] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-09-14T18:05:11.758888] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-09-14T18:05:12.290364] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-14T18:05:12.296188] [INFO ] [REMOTE ] FIG: Full fetch complete (12176 records). [2025-09-14T18:05:12.296372] [DEBUG] [VALIDATOR ] FIG: Validating primary data. [2025-09-14T18:05:12.509402] [WARN ] [VALIDATOR ] FIG: Validation failed - insufficient historical data. Have 102 unique days, need 150 days [2025-09-14T18:05:12.512680] [FATAL] [MAIN ] FIG: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:05:12.514848] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-14T18:05:12.514948] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:05:12.524422] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-14T18:05:12.524964] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-14T18:05:12.525589] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-09-14T18:05:12.525715] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-09-14T18:05:12.526174] [INFO ] [MAIN ] Update Progress: 832/2370 symbols completed. FIG took 20.5s. Estimated remaining: 2h 42m 42s. Rate: 9.5 symbols/min [2025-09-14T18:05:12.564861] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-09-14T18:05:12.717867] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-14T18:05:12.719375] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:05:12.725961] [INFO ] [REMOTE ] FI: Full fetch complete (58126 records). [2025-09-14T18:05:12.726210] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-09-14T18:05:12.811354] [DEBUG] [LOCAL ] FINS: Loaded 3401 existing records from primary storage. [2025-09-14T18:05:12.832422] [INFO ] [MAIN ] FINS: Loaded 3401 existing records. [2025-09-14T18:05:13.217534] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:05:13.240049] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-09-14T18:05:13.270810] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-09-14T18:05:13.303170] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-09-14T18:05:13.322593] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-09-14T18:05:13.319562] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-09-14T18:05:13.322757] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-09-14T18:05:13.323691] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-09-14T18:05:13.356324] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-09-14T18:05:13.367854] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-09-14T18:05:13.434492] [DEBUG] [LOCAL ] FI: Trimmed 58126 records to 40371 (keeping 150 days of data) [2025-09-14T18:05:13.824962] [INFO ] [REMOTE ] FINS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:05:13.971332] [DEBUG] [LOCAL ] FI: Primary data saved (40371 records). [2025-09-14T18:05:13.971530] [INFO ] [MAIN ] FI: Full history saved. [2025-09-14T18:05:13.971654] [INFO ] [MAIN ] Update Progress: 833/2370 symbols completed. FI took 35.5s. Estimated remaining: 2h 42m 27s. Rate: 9.5 symbols/min [2025-09-14T18:05:14.140870] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:05:14.163253] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-09-14T18:05:14.163755] [DEBUG] [LOCAL ] FINV: Loaded 21701 existing records from primary storage. [2025-09-14T18:05:14.164679] [INFO ] [MAIN ] FINV: Loaded 21701 existing records. [2025-09-14T18:05:14.346259] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:05:14.346656] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-09-14T18:05:14.346764] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-09-14T18:05:14.347436] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-09-14T18:05:14.347501] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-09-14T18:05:14.488486] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T18:05:14.754604] [INFO ] [REMOTE ] FINV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:05:14.958850] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-09-14T18:05:15.020937] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T18:05:15.127149] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T18:05:15.758935] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-09-14T18:05:16.364108] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-14T18:05:16.505295] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T18:05:16.558829] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-09-14T18:05:17.358886] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-09-14T18:05:17.937524] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-14T18:05:18.158932] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-09-14T18:05:18.632428] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-14T18:05:18.958902] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-09-14T18:05:19.672777] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T18:05:19.758810] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-09-14T18:05:20.429707] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-14T18:05:20.435065] [INFO ] [REMOTE ] FIGS: Full fetch complete (53292 records). [2025-09-14T18:05:20.435263] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-09-14T18:05:20.563983] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-09-14T18:05:20.821209] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-09-14T18:05:20.821340] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-09-14T18:05:20.822203] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-09-14T18:05:20.822272] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-09-14T18:05:20.823673] [DEBUG] [LOCAL ] FIGS: Trimmed 53292 records to 36665 (keeping 150 days of data) [2025-09-14T18:05:21.040883] [DEBUG] [LOCAL ] FIGS: Primary data saved (36665 records). [2025-09-14T18:05:21.041054] [INFO ] [MAIN ] FIGS: Full history saved. [2025-09-14T18:05:21.041155] [INFO ] [MAIN ] Update Progress: 834/2370 symbols completed. FIGS took 27.7s. Estimated remaining: 2h 42m 22s. Rate: 9.5 symbols/min [2025-09-14T18:05:21.211207] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:05:21.233911] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T18:05:21.260080] [DEBUG] [LOCAL ] FIS: Loaded 23801 existing records from primary storage. [2025-09-14T18:05:21.260242] [INFO ] [MAIN ] FIS: Loaded 23801 existing records. [2025-09-14T18:05:21.360783] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-09-14T18:05:21.437784] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:05:21.438029] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-09-14T18:05:21.438097] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-09-14T18:05:21.438772] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-09-14T18:05:21.438835] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-09-14T18:05:21.793453] [INFO ] [REMOTE ] FIS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:05:22.158790] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-09-14T18:05:22.270115] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T18:05:22.792603] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-14T18:05:22.823877] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T18:05:22.958873] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-09-14T18:05:23.758883] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-09-14T18:05:24.252779] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-14T18:05:24.558868] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-09-14T18:05:25.149423] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T18:05:25.358914] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-09-14T18:05:25.839577] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-14T18:05:25.844192] [INFO ] [REMOTE ] FIHL: Full fetch complete (43679 records). [2025-09-14T18:05:25.844365] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-09-14T18:05:26.160972] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-09-14T18:05:26.180668] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T18:05:26.250205] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-09-14T18:05:26.250340] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-09-14T18:05:26.251210] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-09-14T18:05:26.251275] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-09-14T18:05:26.252553] [DEBUG] [LOCAL ] FIHL: Trimmed 43679 records to 29260 (keeping 150 days of data) [2025-09-14T18:05:26.435523] [DEBUG] [LOCAL ] FIHL: Primary data saved (29260 records). [2025-09-14T18:05:26.435731] [INFO ] [MAIN ] FIHL: Full history saved. [2025-09-14T18:05:26.435854] [INFO ] [MAIN ] Update Progress: 835/2370 symbols completed. FIHL took 25.8s. Estimated remaining: 2h 42m 13s. Rate: 9.5 symbols/min [2025-09-14T18:05:26.606232] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:05:26.621233] [DEBUG] [LOCAL ] FIX: Loaded 12396 existing records from primary storage. [2025-09-14T18:05:26.621416] [INFO ] [MAIN ] FIX: Loaded 12396 existing records. [2025-09-14T18:05:26.804910] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:05:26.805236] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-09-14T18:05:26.805316] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-09-14T18:05:26.805915] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-09-14T18:05:26.805996] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-09-14T18:05:26.959320] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-09-14T18:05:27.160881] [INFO ] [REMOTE ] FIX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:05:27.733884] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-14T18:05:27.758828] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-09-14T18:05:27.911476] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T18:05:28.558893] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-09-14T18:05:29.309264] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T18:05:29.358842] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-09-14T18:05:30.138500] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-14T18:05:30.158921] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-09-14T18:05:30.830330] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-14T18:05:30.958900] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-09-14T18:05:31.626927] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-14T18:05:31.758899] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-09-14T18:05:32.378780] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-14T18:05:32.519927] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T18:05:32.558845] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-09-14T18:05:33.358844] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-09-14T18:05:34.130602] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-14T18:05:34.158886] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-09-14T18:05:34.424783] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T18:05:34.958872] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-09-14T18:05:35.758864] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-09-14T18:05:35.837568] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T18:05:36.558832] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-09-14T18:05:36.761573] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T18:05:37.036762] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-14T18:05:37.042872] [INFO ] [REMOTE ] FINV: Full fetch complete (48845 records). [2025-09-14T18:05:37.043153] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-09-14T18:05:37.365911] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-09-14T18:05:37.488007] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-09-14T18:05:37.488180] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-09-14T18:05:37.489399] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-09-14T18:05:37.489542] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-09-14T18:05:37.491268] [DEBUG] [LOCAL ] FINV: Trimmed 48845 records to 33673 (keeping 150 days of data) [2025-09-14T18:05:37.752293] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-14T18:05:37.771255] [DEBUG] [LOCAL ] FINV: Primary data saved (33673 records). [2025-09-14T18:05:37.771431] [INFO ] [MAIN ] FINV: Full history saved. [2025-09-14T18:05:37.771557] [INFO ] [MAIN ] Update Progress: 836/2370 symbols completed. FINV took 23.8s. Estimated remaining: 2h 42m 16s. Rate: 9.5 symbols/min [2025-09-14T18:05:37.942555] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:05:37.945954] [DEBUG] [LOCAL ] FIXT: Loaded 1618 existing records from primary storage. [2025-09-14T18:05:37.946051] [INFO ] [MAIN ] FIXT: Loaded 1618 existing records. [2025-09-14T18:05:38.123441] [WARN ] [MAIN ] FIXT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:05:38.123622] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:05:38.125023] [INFO ] [REMOTE ] FINS: Full fetch complete (8800 records). [2025-09-14T18:05:38.125109] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-14T18:05:38.125183] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-09-14T18:05:38.125287] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-14T18:05:38.164129] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-09-14T18:05:38.177512] [DEBUG] [LOCAL ] FIXT: Deleted primary data file. [2025-09-14T18:05:38.191494] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-14T18:05:38.845046] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-09-14T18:05:38.876628] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:05:38.876727] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-09-14T18:05:38.877302] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-09-14T18:05:38.877365] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-09-14T18:05:38.877850] [DEBUG] [LOCAL ] FINS: Trimmed 8800 records to 6552 (keeping 150 days of data) [2025-09-14T18:05:38.919098] [DEBUG] [LOCAL ] FINS: Primary data saved (6552 records). [2025-09-14T18:05:38.919276] [INFO ] [MAIN ] FINS: Full history saved. [2025-09-14T18:05:38.919412] [INFO ] [MAIN ] Update Progress: 837/2370 symbols completed. FINS took 26.4s. Estimated remaining: 2h 42m 0s. Rate: 9.5 symbols/min [2025-09-14T18:05:38.958799] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-09-14T18:05:39.758835] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-02. [2025-09-14T18:05:40.011012] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:05:40.011351] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-02 [2025-09-14T18:05:40.146663] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-14T18:05:40.442972] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T18:05:40.558858] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-09-14T18:05:41.358855] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-09-14T18:05:42.026074] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-14T18:05:42.158851] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-03. [2025-09-14T18:05:42.412720] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:05:42.413059] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-03 [2025-09-14T18:05:42.958855] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-09-14T18:05:43.081942] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T18:05:43.758880] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-09-14T18:05:44.273042] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-14T18:05:44.558882] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-04. [2025-09-14T18:05:45.023288] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:05:45.023825] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-04 [2025-09-14T18:05:45.292508] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T18:05:45.358852] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-09-14T18:05:46.158900] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-09-14T18:05:46.799846] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T18:05:46.803320] [INFO ] [REMOTE ] FIX: Full fetch complete (34787 records). [2025-09-14T18:05:46.803431] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-09-14T18:05:46.959584] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-05. [2025-09-14T18:05:47.169624] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-09-14T18:05:47.169740] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-09-14T18:05:47.170264] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-09-14T18:05:47.170363] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-09-14T18:05:47.171171] [DEBUG] [LOCAL ] FIX: Trimmed 34787 records to 21542 (keeping 150 days of data) [2025-09-14T18:05:47.305948] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:05:47.306596] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-05 [2025-09-14T18:05:47.324064] [DEBUG] [LOCAL ] FIX: Primary data saved (21542 records). [2025-09-14T18:05:47.324227] [INFO ] [MAIN ] FIX: Full history saved. [2025-09-14T18:05:47.324346] [INFO ] [MAIN ] Update Progress: 838/2370 symbols completed. FIX took 20.9s. Estimated remaining: 2h 41m 58s. Rate: 9.5 symbols/min [2025-09-14T18:05:47.372863] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-14T18:05:47.758892] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-06. [2025-09-14T18:05:48.192737] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-14T18:05:48.558833] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-09-14T18:05:49.214628] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:05:49.220227] [INFO ] [REMOTE ] FIS: Full fetch complete (58053 records). [2025-09-14T18:05:49.220363] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-09-14T18:05:49.362200] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-07. [2025-09-14T18:05:49.633955] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-09-14T18:05:49.634068] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-09-14T18:05:49.634938] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-09-14T18:05:49.635010] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-09-14T18:05:49.636314] [DEBUG] [LOCAL ] FIS: Trimmed 58053 records to 40130 (keeping 150 days of data) [2025-09-14T18:05:49.770894] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-14T18:05:49.920139] [DEBUG] [LOCAL ] FIS: Primary data saved (40130 records). [2025-09-14T18:05:49.920408] [INFO ] [MAIN ] FIS: Full history saved. [2025-09-14T18:05:49.920544] [INFO ] [MAIN ] Update Progress: 839/2370 symbols completed. FIS took 28.9s. Estimated remaining: 2h 41m 45s. Rate: 9.5 symbols/min [2025-09-14T18:05:50.158846] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-08. [2025-09-14T18:05:50.648233] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-14T18:05:50.958869] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-09. [2025-09-14T18:05:51.449348] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-14T18:05:51.450306] [INFO ] [REMOTE ] FIXT: Full fetch complete (1618 records). [2025-09-14T18:05:51.450407] [DEBUG] [VALIDATOR ] FIXT: Validating primary data. [2025-09-14T18:05:51.626432] [WARN ] [VALIDATOR ] FIXT: Validation failed - insufficient historical data. Have 62 unique days, need 150 days [2025-09-14T18:05:51.626677] [FATAL] [MAIN ] FIXT: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:05:51.626731] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:05:51.626778] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-14T18:05:51.626847] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-14T18:05:51.626918] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-09-14T18:05:51.626970] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-09-14T18:05:51.627046] [INFO ] [MAIN ] Update Progress: 840/2370 symbols completed. FIXT took 13.9s. Estimated remaining: 2h 41m 30s. Rate: 9.5 symbols/min [2025-09-14T18:05:52.209558] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:05:52.202260] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:05:52.343376] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:05:52.355187] [DEBUG] [LOCAL ] FLC: Loaded 2563 existing records from primary storage. [2025-09-14T18:05:52.372785] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:05:52.374209] [INFO ] [MAIN ] FLC: Loaded 2563 existing records. [2025-09-14T18:05:52.386064] [DEBUG] [LOCAL ] FLNG: Loaded 16146 existing records from primary storage. [2025-09-14T18:05:52.423115] [INFO ] [MAIN ] FLNG: Loaded 16146 existing records. [2025-09-14T18:05:52.684208] [DEBUG] [LOCAL ] FLO: Loaded 23396 existing records from primary storage. [2025-09-14T18:05:52.737698] [DEBUG] [LOCAL ] FLG: Loaded 23836 existing records from primary storage. [2025-09-14T18:05:52.765730] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:05:52.768971] [INFO ] [MAIN ] FLO: Loaded 23396 existing records. [2025-09-14T18:05:52.768899] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:05:52.797709] [INFO ] [MAIN ] FLG: Loaded 23836 existing records. [2025-09-14T18:05:52.802951] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-09-14T18:05:52.803021] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-09-14T18:05:52.835019] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-09-14T18:05:52.846224] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-09-14T18:05:52.856598] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-09-14T18:05:52.918134] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-09-14T18:05:52.907677] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-09-14T18:05:52.935324] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-09-14T18:05:53.123880] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:05:53.282422] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-09-14T18:05:53.356861] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-09-14T18:05:53.362417] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:05:53.474023] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-09-14T18:05:53.540918] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-09-14T18:05:53.549469] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-09-14T18:05:53.619107] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-09-14T18:05:53.720239] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-09-14T18:05:53.767480] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-09-14T18:05:54.019061] [INFO ] [REMOTE ] FLC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:05:54.100852] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-09-14T18:05:54.135242] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:05:54.172529] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-09-14T18:05:54.599258] [INFO ] [REMOTE ] FLO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:05:54.611014] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-09-14T18:05:54.636740] [INFO ] [REMOTE ] FLG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:05:54.637806] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-09-14T18:05:54.957761] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T18:05:54.959399] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-09-14T18:05:55.712950] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-14T18:05:55.736904] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T18:05:55.758774] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-09-14T18:05:56.329241] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-14T18:05:56.424832] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-14T18:05:56.558846] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-09-14T18:05:57.359685] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-09-14T18:05:57.364684] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T18:05:58.158839] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-09-14T18:05:58.265929] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-14T18:05:58.468234] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T18:05:58.958852] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-09-14T18:05:59.758836] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-09-14T18:05:59.983832] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T18:06:00.558874] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-09-14T18:06:00.636995] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T18:06:01.358828] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-09-14T18:06:01.556162] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T18:06:01.924507] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-14T18:06:02.158830] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-09-14T18:06:02.958852] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-09-14T18:06:03.758946] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-09-14T18:06:04.655549] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-09-14T18:06:04.657596] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-09-14T18:06:05.235937] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-14T18:06:05.358945] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-09-14T18:06:05.569788] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T18:06:05.826527] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (4.47 seconds). [2025-09-14T18:06:05.917372] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (2.96 seconds). [2025-09-14T18:06:06.158842] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-09-14T18:06:06.212395] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-14T18:06:06.958894] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-09-14T18:06:07.758863] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-09-14T18:06:07.967930] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-14T18:06:08.558832] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-09-14T18:06:08.688602] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T18:06:09.259820] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T18:06:09.358810] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-09-14T18:06:10.100405] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T18:06:10.158826] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-09-14T18:06:10.962387] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-09-14T18:06:10.967310] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T18:06:11.558161] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T18:06:11.559513] [INFO ] [REMOTE ] FLC: Full fetch complete (6095 records). [2025-09-14T18:06:11.559599] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-09-14T18:06:11.767429] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-09-14T18:06:11.921443] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-09-14T18:06:11.921545] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-09-14T18:06:11.921776] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-09-14T18:06:11.921831] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-09-14T18:06:11.922277] [DEBUG] [LOCAL ] FLC: Trimmed 6095 records to 3956 (keeping 150 days of data) [2025-09-14T18:06:11.948757] [DEBUG] [LOCAL ] FLC: Primary data saved (3956 records). [2025-09-14T18:06:11.948913] [INFO ] [MAIN ] FLC: Full history saved. [2025-09-14T18:06:11.949039] [INFO ] [MAIN ] Update Progress: 841/2370 symbols completed. FLC took 20.3s. Estimated remaining: 2h 41m 49s. Rate: 9.4 symbols/min [2025-09-14T18:06:12.119475] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:06:12.150499] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-14T18:06:12.170462] [DEBUG] [LOCAL ] FLOC: Loaded 12277 existing records from primary storage. [2025-09-14T18:06:12.170621] [INFO ] [MAIN ] FLOC: Loaded 12277 existing records. [2025-09-14T18:06:12.349205] [WARN ] [MAIN ] FLOC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:06:12.349489] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-09-14T18:06:12.349552] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-14T18:06:12.349978] [DEBUG] [LOCAL ] FLOC: Deleted primary data file. [2025-09-14T18:06:12.350048] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-09-14T18:06:12.568752] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-09-14T18:06:12.724475] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:06:13.358824] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-09-14T18:06:13.402609] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T18:06:14.158836] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-09-14T18:06:14.454150] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T18:06:14.751017] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T18:06:14.958839] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-09-14T18:06:15.758845] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-09-14T18:06:16.451585] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-14T18:06:16.478434] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T18:06:16.484092] [INFO ] [REMOTE ] FLG: Full fetch complete (58013 records). [2025-09-14T18:06:16.484228] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-09-14T18:06:16.563944] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-09-14T18:06:16.867787] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-09-14T18:06:16.867898] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-09-14T18:06:16.868728] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-09-14T18:06:16.868797] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-09-14T18:06:16.870004] [DEBUG] [LOCAL ] FLG: Trimmed 58013 records to 40127 (keeping 150 days of data) [2025-09-14T18:06:17.114171] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-14T18:06:17.122120] [INFO ] [REMOTE ] FLNG: Full fetch complete (37695 records). [2025-09-14T18:06:17.123062] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-09-14T18:06:17.363974] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-09-14T18:06:17.518974] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-09-14T18:06:17.519086] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-09-14T18:06:17.519791] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-09-14T18:06:17.520209] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-09-14T18:06:17.522862] [DEBUG] [LOCAL ] FLNG: Trimmed 37695 records to 25164 (keeping 150 days of data) [2025-09-14T18:06:17.633333] [DEBUG] [LOCAL ] FLG: Primary data saved (40127 records). [2025-09-14T18:06:17.633835] [INFO ] [MAIN ] FLG: Full history saved. [2025-09-14T18:06:17.634025] [INFO ] [MAIN ] Update Progress: 842/2370 symbols completed. FLG took 26.0s. Estimated remaining: 2h 41m 41s. Rate: 9.5 symbols/min [2025-09-14T18:06:17.833682] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:06:17.865038] [DEBUG] [LOCAL ] FLR: Loaded 23838 existing records from primary storage. [2025-09-14T18:06:17.865218] [INFO ] [MAIN ] FLR: Loaded 23838 existing records. [2025-09-14T18:06:18.064196] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:06:18.065104] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-09-14T18:06:18.069477] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-09-14T18:06:18.086484] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-09-14T18:06:18.086625] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-09-14T18:06:18.303454] [DEBUG] [LOCAL ] FLNG: Primary data saved (25164 records). [2025-09-14T18:06:18.312129] [INFO ] [MAIN ] FLNG: Full history saved. [2025-09-14T18:06:18.320868] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T18:06:18.345495] [INFO ] [MAIN ] Update Progress: 843/2370 symbols completed. FLNG took 26.7s. Estimated remaining: 2h 41m 25s. Rate: 9.5 symbols/min [2025-09-14T18:06:18.407614] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-09-14T18:06:18.601085] [INFO ] [REMOTE ] FLR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:06:18.669758] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:06:18.692066] [DEBUG] [LOCAL ] FLS: Loaded 22488 existing records from primary storage. [2025-09-14T18:06:18.692226] [INFO ] [MAIN ] FLS: Loaded 22488 existing records. [2025-09-14T18:06:18.870166] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:06:18.870446] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-09-14T18:06:18.870511] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-09-14T18:06:18.871152] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-09-14T18:06:18.871231] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-09-14T18:06:18.967160] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-09-14T18:06:19.223100] [INFO ] [REMOTE ] FLS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:06:19.259034] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T18:06:19.758842] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-09-14T18:06:19.803352] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-14T18:06:20.428872] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:06:20.434850] [INFO ] [REMOTE ] FLO: Full fetch complete (56350 records). [2025-09-14T18:06:20.434970] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-09-14T18:06:20.575444] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-09-14T18:06:20.821148] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-09-14T18:06:20.821322] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-09-14T18:06:20.822155] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-09-14T18:06:20.822213] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-09-14T18:06:20.823489] [DEBUG] [LOCAL ] FLO: Trimmed 56350 records to 39052 (keeping 150 days of data) [2025-09-14T18:06:20.950240] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-14T18:06:21.127088] [DEBUG] [LOCAL ] FLO: Primary data saved (39052 records). [2025-09-14T18:06:21.127301] [INFO ] [MAIN ] FLO: Full history saved. [2025-09-14T18:06:21.127442] [INFO ] [MAIN ] Update Progress: 844/2370 symbols completed. FLO took 29.5s. Estimated remaining: 2h 41m 12s. Rate: 9.5 symbols/min [2025-09-14T18:06:21.301448] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:06:21.326435] [DEBUG] [LOCAL ] FLUT: Loaded 22737 existing records from primary storage. [2025-09-14T18:06:21.326609] [INFO ] [MAIN ] FLUT: Loaded 22737 existing records. [2025-09-14T18:06:21.364087] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-09-14T18:06:21.504318] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:06:21.504543] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-09-14T18:06:21.504602] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-09-14T18:06:21.505282] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-09-14T18:06:21.505345] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-09-14T18:06:21.856237] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:06:22.141335] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T18:06:22.158767] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-09-14T18:06:22.958878] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-09-14T18:06:23.451696] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-14T18:06:23.524510] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-14T18:06:23.758900] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-09-14T18:06:24.246678] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-14T18:06:24.558832] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-09-14T18:06:25.358799] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-09-14T18:06:25.494875] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T18:06:25.527734] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T18:06:26.158882] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-09-14T18:06:26.958836] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-09-14T18:06:27.353498] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-14T18:06:27.415160] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T18:06:27.758850] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-09-14T18:06:28.558834] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-09-14T18:06:28.826865] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T18:06:29.359454] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-09-14T18:06:29.362437] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T18:06:30.158827] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-09-14T18:06:30.244934] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-14T18:06:30.758368] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-14T18:06:30.958844] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-09-14T18:06:31.759638] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-09-14T18:06:31.762725] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T18:06:32.558865] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-09-14T18:06:32.736571] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T18:06:33.358878] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-09-14T18:06:33.499599] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T18:06:34.090555] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T18:06:34.093537] [INFO ] [REMOTE ] FLOC: Full fetch complete (31627 records). [2025-09-14T18:06:34.093634] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-09-14T18:06:34.166611] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-09-14T18:06:34.466514] [DEBUG] [VALIDATOR ] FLOC: All expected trading days are present. [2025-09-14T18:06:34.466631] [DEBUG] [VALIDATOR ] FLOC: Primary data validation passed. [2025-09-14T18:06:34.467257] [INFO ] [MAIN ] FLOC: Fetched primary data is valid. [2025-09-14T18:06:34.467401] [DEBUG] [LOCAL ] FLOC: Saving primary data. [2025-09-14T18:06:34.468434] [DEBUG] [LOCAL ] FLOC: Trimmed 31627 records to 20938 (keeping 150 days of data) [2025-09-14T18:06:34.602377] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-14T18:06:34.652483] [DEBUG] [LOCAL ] FLOC: Primary data saved (20938 records). [2025-09-14T18:06:34.652668] [INFO ] [MAIN ] FLOC: Full history saved. [2025-09-14T18:06:34.652785] [INFO ] [MAIN ] Update Progress: 845/2370 symbols completed. FLOC took 22.7s. Estimated remaining: 2h 41m 19s. Rate: 9.5 symbols/min [2025-09-14T18:06:34.825232] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:06:34.840392] [DEBUG] [LOCAL ] FLXR: Loaded 9963 existing records from primary storage. [2025-09-14T18:06:34.840598] [INFO ] [MAIN ] FLXR: Loaded 9963 existing records. [2025-09-14T18:06:34.964007] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-09-14T18:06:35.017246] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:06:35.017701] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-09-14T18:06:35.017767] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-09-14T18:06:35.018244] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-09-14T18:06:35.018324] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-09-14T18:06:35.376638] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:06:35.715552] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T18:06:35.758848] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-09-14T18:06:36.558846] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-09-14T18:06:36.589435] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T18:06:36.769174] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-14T18:06:37.358821] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-09-14T18:06:37.976211] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T18:06:38.158819] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-09-14T18:06:38.958841] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-09-14T18:06:39.195130] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T18:06:39.758827] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-09-14T18:06:39.965972] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-14T18:06:40.194168] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T18:06:40.200393] [INFO ] [REMOTE ] FLR: Full fetch complete (57729 records). [2025-09-14T18:06:40.200630] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-09-14T18:06:40.559973] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-09-14T18:06:40.652436] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-09-14T18:06:40.652558] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-09-14T18:06:40.653622] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-09-14T18:06:40.653806] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-09-14T18:06:40.655273] [DEBUG] [LOCAL ] FLR: Trimmed 57729 records to 40081 (keeping 150 days of data) [2025-09-14T18:06:40.785353] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T18:06:40.969205] [DEBUG] [LOCAL ] FLR: Primary data saved (40081 records). [2025-09-14T18:06:40.969372] [INFO ] [MAIN ] FLR: Full history saved. [2025-09-14T18:06:40.969477] [INFO ] [MAIN ] Update Progress: 846/2370 symbols completed. FLR took 23.3s. Estimated remaining: 2h 41m 12s. Rate: 9.5 symbols/min [2025-09-14T18:06:41.139416] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:06:41.161494] [DEBUG] [LOCAL ] FMC: Loaded 23010 existing records from primary storage. [2025-09-14T18:06:41.161686] [INFO ] [MAIN ] FMC: Loaded 23010 existing records. [2025-09-14T18:06:41.340828] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:06:41.341105] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-09-14T18:06:41.341170] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-09-14T18:06:41.341846] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-09-14T18:06:41.341916] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-09-14T18:06:41.364066] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-09-14T18:06:41.729127] [INFO ] [REMOTE ] FMC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:06:41.741472] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-14T18:06:42.158855] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-09-14T18:06:42.958911] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-09-14T18:06:43.190925] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T18:06:43.763917] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-09-14T18:06:43.792756] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T18:06:44.558900] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-09-14T18:06:44.691607] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T18:06:44.877064] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-14T18:06:44.963941] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T18:06:44.969246] [INFO ] [REMOTE ] FLS: Full fetch complete (54230 records). [2025-09-14T18:06:44.969370] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-09-14T18:06:45.359754] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-09-14T18:06:45.360017] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-09-14T18:06:45.360142] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-09-14T18:06:45.361697] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-09-14T18:06:45.361764] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-09-14T18:06:45.363034] [DEBUG] [LOCAL ] FLS: Trimmed 54230 records to 37556 (keeping 150 days of data) [2025-09-14T18:06:45.628752] [DEBUG] [LOCAL ] FLS: Primary data saved (37556 records). [2025-09-14T18:06:45.628978] [INFO ] [MAIN ] FLS: Full history saved. [2025-09-14T18:06:45.629097] [INFO ] [MAIN ] Update Progress: 847/2370 symbols completed. FLS took 27.2s. Estimated remaining: 2h 41m 3s. Rate: 9.5 symbols/min [2025-09-14T18:06:45.798241] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:06:45.802297] [DEBUG] [LOCAL ] FMN: Loaded 2450 existing records from primary storage. [2025-09-14T18:06:45.802399] [INFO ] [MAIN ] FMN: Loaded 2450 existing records. [2025-09-14T18:06:45.980845] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:06:45.981127] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-09-14T18:06:45.981193] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-09-14T18:06:45.981455] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-09-14T18:06:45.981516] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-09-14T18:06:46.164483] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-09-14T18:06:46.342969] [INFO ] [REMOTE ] FMN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:06:46.935376] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-14T18:06:46.940859] [INFO ] [REMOTE ] FLUT: Full fetch complete (55446 records). [2025-09-14T18:06:46.941017] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-09-14T18:06:46.964065] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-09-14T18:06:47.349025] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-14T18:06:47.370625] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-09-14T18:06:47.371460] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-09-14T18:06:47.372326] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-09-14T18:06:47.372388] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-09-14T18:06:47.373676] [DEBUG] [LOCAL ] FLUT: Trimmed 55446 records to 38069 (keeping 150 days of data) [2025-09-14T18:06:47.636486] [DEBUG] [LOCAL ] FLUT: Primary data saved (38069 records). [2025-09-14T18:06:47.636690] [INFO ] [MAIN ] FLUT: Full history saved. [2025-09-14T18:06:47.636814] [INFO ] [MAIN ] Update Progress: 848/2370 symbols completed. FLUT took 26.5s. Estimated remaining: 2h 40m 49s. Rate: 9.5 symbols/min [2025-09-14T18:06:47.763900] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-09-14T18:06:47.815022] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:06:47.828516] [DEBUG] [LOCAL ] FMS: Loaded 12543 existing records from primary storage. [2025-09-14T18:06:47.828752] [INFO ] [MAIN ] FMS: Loaded 12543 existing records. [2025-09-14T18:06:48.003544] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:06:48.003866] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-09-14T18:06:48.003931] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-09-14T18:06:48.004413] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-09-14T18:06:48.004473] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-09-14T18:06:48.355088] [INFO ] [REMOTE ] FMS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:06:48.548517] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-14T18:06:48.558775] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-09-14T18:06:48.761057] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T18:06:49.355223] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-14T18:06:49.360623] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-09-14T18:06:50.158849] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-09-14T18:06:50.958815] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-09-14T18:06:51.275301] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T18:06:51.336595] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T18:06:51.758892] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-09-14T18:06:52.236049] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-14T18:06:52.558863] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-09-14T18:06:52.668878] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T18:06:53.358887] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-09-14T18:06:53.552993] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-14T18:06:53.556119] [INFO ] [REMOTE ] FLXR: Full fetch complete (20454 records). [2025-09-14T18:06:53.556242] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-09-14T18:06:53.939281] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-09-14T18:06:53.939576] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-09-14T18:06:53.948374] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-09-14T18:06:53.948496] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-09-14T18:06:53.949941] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-14T18:06:53.955248] [DEBUG] [LOCAL ] FLXR: Trimmed 20454 records to 15326 (keeping 150 days of data) [2025-09-14T18:06:54.058898] [DEBUG] [LOCAL ] FLXR: Primary data saved (15326 records). [2025-09-14T18:06:54.059084] [INFO ] [MAIN ] FLXR: Full history saved. [2025-09-14T18:06:54.059203] [INFO ] [MAIN ] Update Progress: 849/2370 symbols completed. FLXR took 19.4s. Estimated remaining: 2h 40m 43s. Rate: 9.5 symbols/min [2025-09-14T18:06:54.163935] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-09-14T18:06:54.232971] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:06:54.252559] [DEBUG] [LOCAL ] FMX: Loaded 18660 existing records from primary storage. [2025-09-14T18:06:54.252743] [INFO ] [MAIN ] FMX: Loaded 18660 existing records. [2025-09-14T18:06:54.428365] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:06:54.428671] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-09-14T18:06:54.428730] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-09-14T18:06:54.429290] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-09-14T18:06:54.429363] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-09-14T18:06:54.796999] [INFO ] [REMOTE ] FMX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:06:54.958892] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-09-14T18:06:55.069970] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-14T18:06:55.758860] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-09-14T18:06:56.441358] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-14T18:06:56.558813] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-09-14T18:06:57.078725] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-14T18:06:57.358840] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-09-14T18:06:58.168480] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-09-14T18:06:58.171263] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T18:06:58.794124] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-14T18:06:58.958827] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-09-14T18:06:59.087475] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T18:06:59.758842] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-09-14T18:07:00.135678] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-14T18:07:00.558831] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-09-14T18:07:01.358843] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-09-14T18:07:01.520492] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-14T18:07:02.004860] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-14T18:07:02.158913] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-09-14T18:07:02.597717] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-14T18:07:02.958906] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-09-14T18:07:03.627134] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T18:07:03.758792] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-09-14T18:07:04.558891] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-09-14T18:07:04.851111] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-14T18:07:04.928856] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-14T18:07:05.291819] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-14T18:07:05.358875] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-09-14T18:07:06.158878] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-09-14T18:07:06.759394] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-14T18:07:06.958853] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-09-14T18:07:07.758803] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-09-14T18:07:07.847511] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T18:07:08.290591] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-14T18:07:08.334350] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-14T18:07:08.558899] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-09-14T18:07:09.358857] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-09-14T18:07:10.033408] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T18:07:10.158811] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-09-14T18:07:10.834723] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T18:07:10.958846] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-09-14T18:07:11.632402] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-14T18:07:11.637189] [INFO ] [REMOTE ] FMX: Full fetch complete (43878 records). [2025-09-14T18:07:11.637310] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-09-14T18:07:11.763927] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-09-14T18:07:12.020581] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-09-14T18:07:12.020736] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-09-14T18:07:12.021504] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-09-14T18:07:12.021570] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-09-14T18:07:12.022710] [DEBUG] [LOCAL ] FMX: Trimmed 43878 records to 30463 (keeping 150 days of data) [2025-09-14T18:07:12.216355] [DEBUG] [LOCAL ] FMX: Primary data saved (30463 records). [2025-09-14T18:07:12.216558] [INFO ] [MAIN ] FMX: Full history saved. [2025-09-14T18:07:12.216688] [INFO ] [MAIN ] Update Progress: 850/2370 symbols completed. FMX took 18.2s. Estimated remaining: 2h 40m 57s. Rate: 9.4 symbols/min [2025-09-14T18:07:12.384229] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:07:12.386813] [DEBUG] [LOCAL ] FMY: Loaded 691 existing records from primary storage. [2025-09-14T18:07:12.386909] [INFO ] [MAIN ] FMY: Loaded 691 existing records. [2025-09-14T18:07:12.578545] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T18:07:12.576921] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-09-14T18:07:12.583864] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:07:12.586934] [INFO ] [REMOTE ] FMN: Full fetch complete (6881 records). [2025-09-14T18:07:12.587014] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-09-14T18:07:12.587209] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-09-14T18:07:12.587275] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-09-14T18:07:12.612681] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-09-14T18:07:12.668695] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-09-14T18:07:13.239284] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-09-14T18:07:13.269751] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-09-14T18:07:13.275891] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-09-14T18:07:13.296594] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-09-14T18:07:13.354166] [DEBUG] [LOCAL ] FMN: Trimmed 6881 records to 3943 (keeping 150 days of data) [2025-09-14T18:07:13.358902] [INFO ] [REMOTE ] FMY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:07:13.359461] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-09-14T18:07:13.403840] [DEBUG] [LOCAL ] FMN: Primary data saved (3943 records). [2025-09-14T18:07:13.416802] [INFO ] [MAIN ] FMN: Full history saved. [2025-09-14T18:07:13.417562] [INFO ] [MAIN ] Update Progress: 851/2370 symbols completed. FMN took 27.8s. Estimated remaining: 2h 40m 42s. Rate: 9.5 symbols/min [2025-09-14T18:07:13.418808] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-14T18:07:13.598000] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:07:13.616283] [DEBUG] [LOCAL ] FN: Loaded 17182 existing records from primary storage. [2025-09-14T18:07:13.616455] [INFO ] [MAIN ] FN: Loaded 17182 existing records. [2025-09-14T18:07:13.797608] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:07:13.797996] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-09-14T18:07:13.798088] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-09-14T18:07:13.814140] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-09-14T18:07:13.814884] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-14T18:07:13.815022] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-09-14T18:07:13.925084] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-14T18:07:14.161820] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-09-14T18:07:14.189219] [INFO ] [REMOTE ] FN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:07:14.958907] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-09-14T18:07:15.378608] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-14T18:07:15.382304] [INFO ] [REMOTE ] FMS: Full fetch complete (32711 records). [2025-09-14T18:07:15.382408] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-09-14T18:07:15.474205] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-14T18:07:15.749244] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-09-14T18:07:15.749356] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-09-14T18:07:15.749997] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-09-14T18:07:15.750051] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-09-14T18:07:15.750849] [DEBUG] [LOCAL ] FMS: Trimmed 32711 records to 22575 (keeping 150 days of data) [2025-09-14T18:07:15.803072] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-09-14T18:07:15.896651] [DEBUG] [LOCAL ] FMS: Primary data saved (22575 records). [2025-09-14T18:07:15.896805] [INFO ] [MAIN ] FMS: Full history saved. [2025-09-14T18:07:15.896912] [INFO ] [MAIN ] Update Progress: 852/2370 symbols completed. FMS took 28.3s. Estimated remaining: 2h 40m 29s. Rate: 9.5 symbols/min [2025-09-14T18:07:16.067391] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:07:16.091253] [DEBUG] [LOCAL ] FNB: Loaded 23671 existing records from primary storage. [2025-09-14T18:07:16.091631] [INFO ] [MAIN ] FNB: Loaded 23671 existing records. [2025-09-14T18:07:16.252386] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-14T18:07:16.272256] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:07:16.273772] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-09-14T18:07:16.273846] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-09-14T18:07:16.274555] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-09-14T18:07:16.274624] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-09-14T18:07:16.564117] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-09-14T18:07:16.639997] [INFO ] [REMOTE ] FNB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:07:17.322008] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:07:17.327755] [INFO ] [REMOTE ] FMC: Full fetch complete (56509 records). [2025-09-14T18:07:17.327968] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-09-14T18:07:17.364053] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-09-14T18:07:17.712307] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-09-14T18:07:17.712439] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-09-14T18:07:17.713587] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-09-14T18:07:17.713690] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-09-14T18:07:17.715142] [DEBUG] [LOCAL ] FMC: Trimmed 56509 records to 38798 (keeping 150 days of data) [2025-09-14T18:07:17.979749] [DEBUG] [LOCAL ] FMC: Primary data saved (38798 records). [2025-09-14T18:07:17.979996] [INFO ] [MAIN ] FMC: Full history saved. [2025-09-14T18:07:17.980136] [INFO ] [MAIN ] Update Progress: 853/2370 symbols completed. FMC took 37.0s. Estimated remaining: 2h 40m 15s. Rate: 9.5 symbols/min [2025-09-14T18:07:18.158558] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:07:18.159342] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-09-14T18:07:18.184367] [DEBUG] [LOCAL ] FND: Loaded 23234 existing records from primary storage. [2025-09-14T18:07:18.184598] [INFO ] [MAIN ] FND: Loaded 23234 existing records. [2025-09-14T18:07:18.365803] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:07:18.366088] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-09-14T18:07:18.366152] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-09-14T18:07:18.366749] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-09-14T18:07:18.366811] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-09-14T18:07:18.714409] [INFO ] [REMOTE ] FND: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:07:18.940090] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T18:07:18.958843] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-09-14T18:07:19.721896] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T18:07:19.758785] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-09-14T18:07:20.158008] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-14T18:07:20.558801] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-09-14T18:07:20.646891] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T18:07:20.929386] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-14T18:07:21.358893] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-09-14T18:07:22.158882] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-09-14T18:07:22.867533] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T18:07:22.958787] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-09-14T18:07:23.622941] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-14T18:07:23.758871] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-09-14T18:07:24.164763] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-14T18:07:24.535790] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T18:07:24.558819] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-09-14T18:07:25.150987] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-14T18:07:25.358862] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-09-14T18:07:26.158832] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-09-14T18:07:26.958900] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-09-14T18:07:27.216933] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T18:07:27.758879] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-09-14T18:07:28.051630] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-14T18:07:28.558833] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-09-14T18:07:28.715547] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-14T18:07:28.917855] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-14T18:07:28.918733] [INFO ] [REMOTE ] FMY: Full fetch complete (1509 records). [2025-09-14T18:07:28.918828] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-09-14T18:07:29.276365] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-09-14T18:07:29.276519] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-09-14T18:07:29.276692] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-09-14T18:07:29.276780] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-09-14T18:07:29.277166] [DEBUG] [LOCAL ] FMY: Trimmed 1509 records to 1043 (keeping 150 days of data) [2025-09-14T18:07:29.284240] [DEBUG] [LOCAL ] FMY: Primary data saved (1043 records). [2025-09-14T18:07:29.284334] [INFO ] [MAIN ] FMY: Full history saved. [2025-09-14T18:07:29.284466] [INFO ] [MAIN ] Update Progress: 854/2370 symbols completed. FMY took 17.1s. Estimated remaining: 2h 40m 17s. Rate: 9.5 symbols/min [2025-09-14T18:07:29.363901] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-09-14T18:07:29.454130] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:07:29.475236] [DEBUG] [LOCAL ] FNF: Loaded 21988 existing records from primary storage. [2025-09-14T18:07:29.475412] [INFO ] [MAIN ] FNF: Loaded 21988 existing records. [2025-09-14T18:07:29.681836] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:07:29.682268] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-09-14T18:07:29.682372] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-09-14T18:07:29.683048] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-09-14T18:07:29.683126] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-09-14T18:07:29.818703] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-14T18:07:30.083035] [INFO ] [REMOTE ] FNF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:07:30.158781] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-09-14T18:07:30.860908] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T18:07:30.958844] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-09-14T18:07:31.758879] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-09-14T18:07:31.880631] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T18:07:32.120322] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T18:07:32.558828] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-09-14T18:07:33.358868] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-09-14T18:07:33.701809] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T18:07:34.158859] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-09-14T18:07:34.317912] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-14T18:07:34.937355] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T18:07:34.958794] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-09-14T18:07:35.758911] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-09-14T18:07:36.097561] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-14T18:07:36.465771] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T18:07:36.558884] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-09-14T18:07:36.873383] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T18:07:36.877616] [INFO ] [REMOTE ] FN: Full fetch complete (43521 records). [2025-09-14T18:07:36.877753] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-09-14T18:07:37.248302] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-09-14T18:07:37.248434] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-09-14T18:07:37.249232] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-09-14T18:07:37.249300] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-09-14T18:07:37.250512] [DEBUG] [LOCAL ] FN: Trimmed 43521 records to 28785 (keeping 150 days of data) [2025-09-14T18:07:37.359386] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-09-14T18:07:37.439900] [DEBUG] [LOCAL ] FN: Primary data saved (28785 records). [2025-09-14T18:07:37.440116] [INFO ] [MAIN ] FN: Full history saved. [2025-09-14T18:07:37.440280] [INFO ] [MAIN ] Update Progress: 855/2370 symbols completed. FN took 24.0s. Estimated remaining: 2h 40m 14s. Rate: 9.5 symbols/min [2025-09-14T18:07:37.625031] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:07:37.658782] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-14T18:07:37.683829] [DEBUG] [LOCAL ] FNV: Loaded 19924 existing records from primary storage. [2025-09-14T18:07:37.684023] [INFO ] [MAIN ] FNV: Loaded 19924 existing records. [2025-09-14T18:07:37.860056] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:07:37.860350] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-09-14T18:07:37.860412] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-09-14T18:07:37.861058] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-09-14T18:07:37.861128] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-09-14T18:07:38.164022] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-09-14T18:07:38.220335] [INFO ] [REMOTE ] FNV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:07:38.958811] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-09-14T18:07:39.033883] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T18:07:39.758830] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-09-14T18:07:40.052706] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T18:07:40.558830] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-09-14T18:07:40.785669] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T18:07:41.358876] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-09-14T18:07:41.601875] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-14T18:07:41.684387] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T18:07:41.690133] [INFO ] [REMOTE ] FNB: Full fetch complete (56923 records). [2025-09-14T18:07:41.690313] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-09-14T18:07:42.100837] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-09-14T18:07:42.101086] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-09-14T18:07:42.102166] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-09-14T18:07:42.102300] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-09-14T18:07:42.103814] [DEBUG] [LOCAL ] FNB: Trimmed 56923 records to 39382 (keeping 150 days of data) [2025-09-14T18:07:42.172503] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-09-14T18:07:42.227260] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T18:07:42.432633] [DEBUG] [LOCAL ] FNB: Primary data saved (39382 records). [2025-09-14T18:07:42.432901] [INFO ] [MAIN ] FNB: Full history saved. [2025-09-14T18:07:42.433034] [INFO ] [MAIN ] Update Progress: 856/2370 symbols completed. FNB took 26.5s. Estimated remaining: 2h 40m 5s. Rate: 9.5 symbols/min [2025-09-14T18:07:42.610183] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:07:42.618750] [DEBUG] [LOCAL ] FOA: Loaded 5829 existing records from primary storage. [2025-09-14T18:07:42.618934] [INFO ] [MAIN ] FOA: Loaded 5829 existing records. [2025-09-14T18:07:42.803404] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:07:42.803800] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-09-14T18:07:42.803869] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-09-14T18:07:42.804255] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-09-14T18:07:42.804321] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-09-14T18:07:42.964162] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-09-14T18:07:43.181472] [INFO ] [REMOTE ] FOA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:07:43.758850] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-09-14T18:07:44.044384] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T18:07:44.558905] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-09-14T18:07:44.951023] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-14T18:07:45.358870] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-09-14T18:07:45.630437] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T18:07:45.651303] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T18:07:46.034983] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:07:46.040672] [INFO ] [REMOTE ] FND: Full fetch complete (56677 records). [2025-09-14T18:07:46.040848] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-09-14T18:07:46.163947] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-09-14T18:07:46.432846] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-09-14T18:07:46.432981] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-09-14T18:07:46.433954] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-09-14T18:07:46.434035] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-09-14T18:07:46.435494] [DEBUG] [LOCAL ] FND: Trimmed 56677 records to 39229 (keeping 150 days of data) [2025-09-14T18:07:46.666723] [DEBUG] [LOCAL ] FND: Primary data saved (39229 records). [2025-09-14T18:07:46.666907] [INFO ] [MAIN ] FND: Full history saved. [2025-09-14T18:07:46.667054] [INFO ] [MAIN ] Update Progress: 857/2370 symbols completed. FND took 28.7s. Estimated remaining: 2h 39m 55s. Rate: 9.5 symbols/min [2025-09-14T18:07:46.838075] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:07:46.843724] [DEBUG] [LOCAL ] FOF: Loaded 3470 existing records from primary storage. [2025-09-14T18:07:46.843845] [INFO ] [MAIN ] FOF: Loaded 3470 existing records. [2025-09-14T18:07:46.964016] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-09-14T18:07:47.026789] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:07:47.027083] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-09-14T18:07:47.027147] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-09-14T18:07:47.027399] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-09-14T18:07:47.027458] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-09-14T18:07:47.397854] [INFO ] [REMOTE ] FOF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:07:47.410871] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-14T18:07:47.758837] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-09-14T18:07:48.558916] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-09-14T18:07:48.776815] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-14T18:07:48.895457] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-14T18:07:49.358888] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-09-14T18:07:49.419129] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T18:07:50.158830] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-09-14T18:07:50.329007] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-14T18:07:50.958924] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-09-14T18:07:51.758802] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-09-14T18:07:51.799588] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T18:07:51.820783] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T18:07:52.489987] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-14T18:07:52.558834] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-09-14T18:07:53.186303] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-14T18:07:53.358833] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-09-14T18:07:54.158851] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-09-14T18:07:54.185200] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T18:07:54.958854] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-09-14T18:07:54.968134] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-14T18:07:55.753162] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-14T18:07:55.758778] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-09-14T18:07:56.558827] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-09-14T18:07:57.339317] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-14T18:07:57.358787] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-09-14T18:07:57.619045] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T18:07:58.158812] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-09-14T18:07:58.274016] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-14T18:07:58.277339] [INFO ] [REMOTE ] FOA: Full fetch complete (14734 records). [2025-09-14T18:07:58.277518] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-09-14T18:07:58.643362] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-09-14T18:07:58.643519] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-09-14T18:07:58.643949] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-09-14T18:07:58.644015] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-09-14T18:07:58.644597] [DEBUG] [LOCAL ] FOA: Trimmed 14734 records to 9277 (keeping 150 days of data) [2025-09-14T18:07:58.701508] [DEBUG] [LOCAL ] FOA: Primary data saved (9277 records). [2025-09-14T18:07:58.701691] [INFO ] [MAIN ] FOA: Full history saved. [2025-09-14T18:07:58.701812] [INFO ] [MAIN ] Update Progress: 858/2370 symbols completed. FOA took 16.3s. Estimated remaining: 2h 39m 59s. Rate: 9.5 symbols/min [2025-09-14T18:07:58.871523] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:07:58.883863] [DEBUG] [LOCAL ] FOR: Loaded 8200 existing records from primary storage. [2025-09-14T18:07:58.884031] [INFO ] [MAIN ] FOR: Loaded 8200 existing records. [2025-09-14T18:07:58.964054] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-09-14T18:07:59.078828] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:07:59.079332] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-09-14T18:07:59.085728] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-09-14T18:07:59.086630] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T18:07:59.089259] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-09-14T18:07:59.089659] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-09-14T18:07:59.461594] [INFO ] [REMOTE ] FOR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:07:59.758863] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-09-14T18:08:00.558829] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-09-14T18:08:00.786365] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-14T18:08:00.823454] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-14T18:08:01.226740] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-14T18:08:01.358882] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-09-14T18:08:02.008572] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:08:02.010044] [INFO ] [REMOTE ] FOF: Full fetch complete (8716 records). [2025-09-14T18:08:02.010165] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-09-14T18:08:02.163984] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-09-14T18:08:02.381194] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-09-14T18:08:02.381314] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-09-14T18:08:02.381616] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-09-14T18:08:02.381731] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-09-14T18:08:02.382229] [DEBUG] [LOCAL ] FOF: Trimmed 8716 records to 5849 (keeping 150 days of data) [2025-09-14T18:08:02.420085] [DEBUG] [LOCAL ] FOF: Primary data saved (5849 records). [2025-09-14T18:08:02.420263] [INFO ] [MAIN ] FOF: Full history saved. [2025-09-14T18:08:02.420436] [INFO ] [MAIN ] Update Progress: 859/2370 symbols completed. FOF took 15.8s. Estimated remaining: 2h 39m 48s. Rate: 9.5 symbols/min [2025-09-14T18:08:02.596411] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:08:02.624340] [DEBUG] [LOCAL ] FOUR: Loaded 21959 existing records from primary storage. [2025-09-14T18:08:02.624538] [INFO ] [MAIN ] FOUR: Loaded 21959 existing records. [2025-09-14T18:08:02.810817] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:08:02.811179] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-09-14T18:08:02.811247] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-09-14T18:08:02.811878] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-09-14T18:08:02.811946] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-09-14T18:08:02.963972] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-09-14T18:08:03.180264] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:08:03.412089] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-14T18:08:03.678529] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T18:08:03.685090] [INFO ] [REMOTE ] FNF: Full fetch complete (53488 records). [2025-09-14T18:08:03.685229] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-09-14T18:08:03.763901] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-09-14T18:08:04.074846] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-09-14T18:08:04.074964] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-09-14T18:08:04.075869] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-09-14T18:08:04.075933] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-09-14T18:08:04.077155] [DEBUG] [LOCAL ] FNF: Trimmed 53488 records to 36881 (keeping 150 days of data) [2025-09-14T18:08:04.317371] [DEBUG] [LOCAL ] FNF: Primary data saved (36881 records). [2025-09-14T18:08:04.317560] [INFO ] [MAIN ] FNF: Full history saved. [2025-09-14T18:08:04.317902] [INFO ] [MAIN ] Update Progress: 860/2370 symbols completed. FNF took 35.0s. Estimated remaining: 2h 39m 34s. Rate: 9.5 symbols/min [2025-09-14T18:08:04.495117] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:08:04.505069] [DEBUG] [LOCAL ] FPF: Loaded 8181 existing records from primary storage. [2025-09-14T18:08:04.505237] [INFO ] [MAIN ] FPF: Loaded 8181 existing records. [2025-09-14T18:08:04.567403] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-09-14T18:08:04.689554] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:08:04.689855] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-09-14T18:08:04.689919] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-09-14T18:08:04.690309] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-09-14T18:08:04.690368] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-09-14T18:08:05.037134] [INFO ] [REMOTE ] FPF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:08:05.358908] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-09-14T18:08:05.715339] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-14T18:08:05.951198] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T18:08:06.061736] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-14T18:08:06.158834] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-09-14T18:08:06.958820] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-09-14T18:08:07.337988] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-14T18:08:07.758841] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-09-14T18:08:08.097056] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T18:08:08.558869] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-09-14T18:08:09.358808] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-09-14T18:08:09.430023] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T18:08:09.484895] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T18:08:10.158833] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-09-14T18:08:10.958911] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-09-14T18:08:11.203655] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-14T18:08:11.226287] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-14T18:08:11.758883] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-09-14T18:08:11.843912] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-14T18:08:12.558882] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-09-14T18:08:12.938322] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T18:08:13.358892] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-09-14T18:08:14.158852] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-09-14T18:08:14.384994] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T18:08:14.509354] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-14T18:08:14.958901] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-09-14T18:08:15.101925] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-14T18:08:15.104284] [INFO ] [REMOTE ] FOR: Full fetch complete (22368 records). [2025-09-14T18:08:15.104383] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-09-14T18:08:15.477211] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-09-14T18:08:15.477360] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-09-14T18:08:15.477946] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-09-14T18:08:15.478007] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-09-14T18:08:15.478794] [DEBUG] [LOCAL ] FOR: Trimmed 22368 records to 14946 (keeping 150 days of data) [2025-09-14T18:08:15.571261] [DEBUG] [LOCAL ] FOR: Primary data saved (14946 records). [2025-09-14T18:08:15.571454] [INFO ] [MAIN ] FOR: Full history saved. [2025-09-14T18:08:15.571558] [INFO ] [MAIN ] Update Progress: 861/2370 symbols completed. FOR took 16.9s. Estimated remaining: 2h 39m 36s. Rate: 9.5 symbols/min [2025-09-14T18:08:15.749899] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:08:15.760786] [DEBUG] [LOCAL ] FPH: Loaded 9084 existing records from primary storage. [2025-09-14T18:08:15.760431] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-09-14T18:08:15.761129] [INFO ] [MAIN ] FPH: Loaded 9084 existing records. [2025-09-14T18:08:15.944116] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:08:15.944358] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-09-14T18:08:15.944435] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-09-14T18:08:15.944807] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-09-14T18:08:15.944868] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-09-14T18:08:16.341491] [INFO ] [REMOTE ] FPH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:08:16.558886] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-09-14T18:08:16.740422] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-14T18:08:16.958245] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T18:08:17.358873] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-09-14T18:08:17.567441] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-14T18:08:18.158838] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-09-14T18:08:18.721593] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T18:08:18.726401] [INFO ] [REMOTE ] FNV: Full fetch complete (50331 records). [2025-09-14T18:08:18.726528] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-09-14T18:08:18.968085] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-09-14T18:08:19.145209] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-09-14T18:08:19.145327] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-09-14T18:08:19.146210] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-09-14T18:08:19.146275] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-09-14T18:08:19.147920] [DEBUG] [LOCAL ] FNV: Trimmed 50331 records to 34341 (keeping 150 days of data) [2025-09-14T18:08:19.297262] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-14T18:08:19.404299] [DEBUG] [LOCAL ] FNV: Primary data saved (34341 records). [2025-09-14T18:08:19.404509] [INFO ] [MAIN ] FNV: Full history saved. [2025-09-14T18:08:19.404631] [INFO ] [MAIN ] Update Progress: 862/2370 symbols completed. FNV took 42.0s. Estimated remaining: 2h 39m 25s. Rate: 9.5 symbols/min [2025-09-14T18:08:19.580514] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:08:19.596310] [DEBUG] [LOCAL ] FPI: Loaded 13743 existing records from primary storage. [2025-09-14T18:08:19.596502] [INFO ] [MAIN ] FPI: Loaded 13743 existing records. [2025-09-14T18:08:19.760420] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-09-14T18:08:19.781943] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:08:19.782218] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-09-14T18:08:19.782279] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-09-14T18:08:19.782793] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-09-14T18:08:19.782866] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-09-14T18:08:20.138029] [INFO ] [REMOTE ] FPI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:08:20.149920] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-14T18:08:20.558885] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-09-14T18:08:21.358878] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-09-14T18:08:21.629769] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-14T18:08:21.671997] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T18:08:22.073633] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-14T18:08:22.158834] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-09-14T18:08:22.958862] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-09-14T18:08:23.758839] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-09-14T18:08:24.033087] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T18:08:24.067340] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-14T18:08:24.558852] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-09-14T18:08:24.901675] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T18:08:25.358878] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-09-14T18:08:25.493036] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-14T18:08:25.495134] [INFO ] [REMOTE ] FPF: Full fetch complete (18985 records). [2025-09-14T18:08:25.495235] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-09-14T18:08:25.866400] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-09-14T18:08:25.866526] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-09-14T18:08:25.867005] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-09-14T18:08:25.867064] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-09-14T18:08:25.867669] [DEBUG] [LOCAL ] FPF: Trimmed 18985 records to 13063 (keeping 150 days of data) [2025-09-14T18:08:25.951968] [DEBUG] [LOCAL ] FPF: Primary data saved (13063 records). [2025-09-14T18:08:25.952158] [INFO ] [MAIN ] FPF: Full history saved. [2025-09-14T18:08:25.952270] [INFO ] [MAIN ] Update Progress: 863/2370 symbols completed. FPF took 21.6s. Estimated remaining: 2h 39m 19s. Rate: 9.5 symbols/min [2025-09-14T18:08:26.130581] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:08:26.142170] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-14T18:08:26.164223] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-09-14T18:08:26.166725] [DEBUG] [LOCAL ] FR: Loaded 20639 existing records from primary storage. [2025-09-14T18:08:26.166900] [INFO ] [MAIN ] FR: Loaded 20639 existing records. [2025-09-14T18:08:26.346949] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:08:26.347211] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-09-14T18:08:26.347289] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-09-14T18:08:26.347973] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-09-14T18:08:26.348035] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-09-14T18:08:26.722618] [INFO ] [REMOTE ] FR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:08:26.958848] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-09-14T18:08:27.310785] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T18:08:27.758888] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-09-14T18:08:28.558923] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-09-14T18:08:28.769589] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T18:08:29.305620] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T18:08:29.358933] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-09-14T18:08:29.518921] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-14T18:08:30.158849] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-09-14T18:08:30.450730] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T18:08:30.958882] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-09-14T18:08:31.624371] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-14T18:08:31.758865] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-09-14T18:08:32.558894] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-09-14T18:08:32.592004] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T18:08:33.363733] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-09-14T18:08:33.368871] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T18:08:33.717428] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T18:08:33.961179] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T18:08:33.963711] [INFO ] [REMOTE ] FPH: Full fetch complete (22296 records). [2025-09-14T18:08:33.963802] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-09-14T18:08:34.165133] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-09-14T18:08:34.345270] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-09-14T18:08:34.345382] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-09-14T18:08:34.345924] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-09-14T18:08:34.345985] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-09-14T18:08:34.346587] [DEBUG] [LOCAL ] FPH: Trimmed 22296 records to 14659 (keeping 150 days of data) [2025-09-14T18:08:34.429117] [DEBUG] [LOCAL ] FPH: Primary data saved (14659 records). [2025-09-14T18:08:34.429298] [INFO ] [MAIN ] FPH: Full history saved. [2025-09-14T18:08:34.429397] [INFO ] [MAIN ] Update Progress: 864/2370 symbols completed. FPH took 18.9s. Estimated remaining: 2h 39m 17s. Rate: 9.5 symbols/min [2025-09-14T18:08:34.595523] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:08:34.603199] [DEBUG] [LOCAL ] FRA: Loaded 6196 existing records from primary storage. [2025-09-14T18:08:34.603346] [INFO ] [MAIN ] FRA: Loaded 6196 existing records. [2025-09-14T18:08:34.776403] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:08:34.776688] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-09-14T18:08:34.776749] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-09-14T18:08:34.777150] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-09-14T18:08:34.777210] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-09-14T18:08:34.966062] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-09-14T18:08:35.145560] [INFO ] [REMOTE ] FRA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:08:35.758848] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-09-14T18:08:35.890515] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T18:08:36.558845] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-09-14T18:08:36.985021] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-14T18:08:37.167050] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T18:08:37.358824] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-09-14T18:08:38.158822] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-09-14T18:08:38.187350] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T18:08:38.540741] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-14T18:08:38.958894] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-09-14T18:08:39.017384] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T18:08:39.758837] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-09-14T18:08:40.504610] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T18:08:40.558840] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-09-14T18:08:41.358890] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-09-14T18:08:41.695778] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-14T18:08:42.067312] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-14T18:08:42.098005] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-14T18:08:42.158807] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-09-14T18:08:42.958849] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-09-14T18:08:43.234550] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T18:08:43.743341] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-14T18:08:43.748625] [INFO ] [REMOTE ] FOUR: Full fetch complete (54043 records). [2025-09-14T18:08:43.748779] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-09-14T18:08:43.763989] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-09-14T18:08:44.134951] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-09-14T18:08:44.135058] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-09-14T18:08:44.135886] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-09-14T18:08:44.135947] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-09-14T18:08:44.137138] [DEBUG] [LOCAL ] FOUR: Trimmed 54043 records to 36977 (keeping 150 days of data) [2025-09-14T18:08:44.383654] [DEBUG] [LOCAL ] FOUR: Primary data saved (36977 records). [2025-09-14T18:08:44.383858] [INFO ] [MAIN ] FOUR: Full history saved. [2025-09-14T18:08:44.383987] [INFO ] [MAIN ] Update Progress: 865/2370 symbols completed. FOUR took 42.0s. Estimated remaining: 2h 39m 17s. Rate: 9.4 symbols/min [2025-09-14T18:08:44.568528] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-09-14T18:08:44.572189] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:08:44.584624] [DEBUG] [LOCAL ] FRGE: Loaded 6445 existing records from primary storage. [2025-09-14T18:08:44.585227] [INFO ] [MAIN ] FRGE: Loaded 6445 existing records. [2025-09-14T18:08:44.767395] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:08:44.767689] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-09-14T18:08:44.767753] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-09-14T18:08:44.768131] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-09-14T18:08:44.768192] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-09-14T18:08:44.934756] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-14T18:08:45.131611] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:08:45.358835] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-09-14T18:08:45.836918] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-14T18:08:46.158840] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-09-14T18:08:46.798317] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T18:08:46.847890] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-14T18:08:46.958827] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-09-14T18:08:47.758830] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-09-14T18:08:47.930505] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-14T18:08:48.558790] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-09-14T18:08:48.865544] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-14T18:08:48.869040] [INFO ] [REMOTE ] FPI: Full fetch complete (33787 records). [2025-09-14T18:08:48.869197] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-09-14T18:08:49.263564] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-09-14T18:08:49.264662] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-09-14T18:08:49.265850] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-09-14T18:08:49.265923] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-09-14T18:08:49.267312] [DEBUG] [LOCAL ] FPI: Trimmed 33787 records to 23691 (keeping 150 days of data) [2025-09-14T18:08:49.361495] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-09-14T18:08:49.431618] [DEBUG] [LOCAL ] FPI: Primary data saved (23691 records). [2025-09-14T18:08:49.431881] [INFO ] [MAIN ] FPI: Full history saved. [2025-09-14T18:08:49.432034] [INFO ] [MAIN ] Update Progress: 866/2370 symbols completed. FPI took 30.0s. Estimated remaining: 2h 39m 8s. Rate: 9.5 symbols/min [2025-09-14T18:08:49.619948] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:08:49.646207] [DEBUG] [LOCAL ] FRO: Loaded 23166 existing records from primary storage. [2025-09-14T18:08:49.646453] [INFO ] [MAIN ] FRO: Loaded 23166 existing records. [2025-09-14T18:08:49.835833] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:08:49.836375] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-09-14T18:08:49.836527] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-09-14T18:08:49.843406] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-09-14T18:08:49.854492] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-09-14T18:08:49.888020] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T18:08:50.163918] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-09-14T18:08:50.222464] [INFO ] [REMOTE ] FRO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:08:50.231828] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-14T18:08:50.958848] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-09-14T18:08:51.547670] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T18:08:51.758835] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-09-14T18:08:52.448530] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T18:08:52.558843] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-09-14T18:08:52.808625] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-14T18:08:53.358825] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-09-14T18:08:54.158819] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-09-14T18:08:54.249025] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-14T18:08:54.288723] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T18:08:54.958818] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-09-14T18:08:54.970237] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T18:08:54.972213] [INFO ] [REMOTE ] FRA: Full fetch complete (16426 records). [2025-09-14T18:08:54.972301] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-09-14T18:08:55.326815] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-09-14T18:08:55.326936] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-09-14T18:08:55.327382] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-09-14T18:08:55.327432] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-09-14T18:08:55.328000] [DEBUG] [LOCAL ] FRA: Trimmed 16426 records to 10144 (keeping 150 days of data) [2025-09-14T18:08:55.395470] [DEBUG] [LOCAL ] FRA: Primary data saved (10144 records). [2025-09-14T18:08:55.395765] [INFO ] [MAIN ] FRA: Full history saved. [2025-09-14T18:08:55.395892] [INFO ] [MAIN ] Update Progress: 867/2370 symbols completed. FRA took 21.0s. Estimated remaining: 2h 39m 1s. Rate: 9.5 symbols/min [2025-09-14T18:08:55.567522] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:08:55.588839] [DEBUG] [LOCAL ] FRT: Loaded 18749 existing records from primary storage. [2025-09-14T18:08:55.589057] [INFO ] [MAIN ] FRT: Loaded 18749 existing records. [2025-09-14T18:08:55.764421] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-09-14T18:08:55.770034] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:08:55.771303] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-09-14T18:08:55.771396] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-09-14T18:08:55.772000] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-09-14T18:08:55.772070] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-09-14T18:08:56.132323] [INFO ] [REMOTE ] FRT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:08:56.559009] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-09-14T18:08:56.963956] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T18:08:57.060486] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-14T18:08:57.358826] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-09-14T18:08:57.857361] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-14T18:08:58.158854] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-09-14T18:08:58.958804] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-09-14T18:08:59.130945] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-14T18:08:59.453104] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-14T18:08:59.604779] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:08:59.609840] [INFO ] [REMOTE ] FR: Full fetch complete (50759 records). [2025-09-14T18:08:59.609984] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-09-14T18:08:59.765577] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-09-14T18:09:00.005142] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-09-14T18:09:00.005293] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-09-14T18:09:00.006549] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-09-14T18:09:00.006626] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-09-14T18:09:00.008311] [DEBUG] [LOCAL ] FR: Trimmed 50759 records to 35051 (keeping 150 days of data) [2025-09-14T18:09:00.263567] [DEBUG] [LOCAL ] FR: Primary data saved (35051 records). [2025-09-14T18:09:00.263897] [INFO ] [MAIN ] FR: Full history saved. [2025-09-14T18:09:00.264084] [INFO ] [MAIN ] Update Progress: 868/2370 symbols completed. FR took 34.3s. Estimated remaining: 2h 38m 52s. Rate: 9.5 symbols/min [2025-09-14T18:09:00.448969] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:09:00.468591] [DEBUG] [LOCAL ] FSCO: Loaded 16756 existing records from primary storage. [2025-09-14T18:09:00.468868] [INFO ] [MAIN ] FSCO: Loaded 16756 existing records. [2025-09-14T18:09:00.566572] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-09-14T18:09:00.665051] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:09:00.665460] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-09-14T18:09:00.665548] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-09-14T18:09:00.666064] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-09-14T18:09:00.666133] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-09-14T18:09:01.046130] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:09:01.358849] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-09-14T18:09:01.410426] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-14T18:09:01.707137] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-14T18:09:01.709072] [INFO ] [REMOTE ] FRGE: Full fetch complete (22251 records). [2025-09-14T18:09:01.709168] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-09-14T18:09:02.090566] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-09-14T18:09:02.090710] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-09-14T18:09:02.091542] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-09-14T18:09:02.091673] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-09-14T18:09:02.092459] [DEBUG] [LOCAL ] FRGE: Trimmed 22251 records to 11995 (keeping 150 days of data) [2025-09-14T18:09:02.161105] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-09-14T18:09:02.172856] [DEBUG] [LOCAL ] FRGE: Primary data saved (11995 records). [2025-09-14T18:09:02.173013] [INFO ] [MAIN ] FRGE: Full history saved. [2025-09-14T18:09:02.173119] [INFO ] [MAIN ] Update Progress: 869/2370 symbols completed. FRGE took 17.8s. Estimated remaining: 2h 38m 38s. Rate: 9.5 symbols/min [2025-09-14T18:09:02.368896] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:09:02.398368] [DEBUG] [LOCAL ] FSK: Loaded 21955 existing records from primary storage. [2025-09-14T18:09:02.398623] [INFO ] [MAIN ] FSK: Loaded 21955 existing records. [2025-09-14T18:09:02.574406] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:09:02.574746] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-09-14T18:09:02.574829] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-09-14T18:09:02.575459] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-09-14T18:09:02.575547] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-09-14T18:09:02.926437] [INFO ] [REMOTE ] FSK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:09:02.958778] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-09-14T18:09:03.168154] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T18:09:03.758827] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-09-14T18:09:04.558861] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-09-14T18:09:05.281711] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T18:09:05.358857] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-09-14T18:09:05.437599] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (3.28 seconds). [2025-09-14T18:09:05.640745] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (2.68 seconds). [2025-09-14T18:09:06.158887] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-09-14T18:09:06.332264] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T18:09:06.847483] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-14T18:09:06.958870] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-09-14T18:09:07.758862] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-09-14T18:09:07.922457] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T18:09:08.558894] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-09-14T18:09:08.609451] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-14T18:09:09.358920] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-09-14T18:09:09.709899] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-14T18:09:10.158894] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-09-14T18:09:10.313114] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T18:09:10.573525] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-14T18:09:10.958886] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-09-14T18:09:11.759013] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-09-14T18:09:12.266572] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-14T18:09:12.558952] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-09-14T18:09:12.618786] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T18:09:13.256056] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T18:09:13.358825] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-09-14T18:09:14.158855] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-09-14T18:09:14.273860] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T18:09:14.922561] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T18:09:14.958785] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-09-14T18:09:15.758872] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-09-14T18:09:16.130117] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-14T18:09:16.135441] [INFO ] [REMOTE ] FRO: Full fetch complete (56503 records). [2025-09-14T18:09:16.135602] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-09-14T18:09:16.529235] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-09-14T18:09:16.529358] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-09-14T18:09:16.530187] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-09-14T18:09:16.530249] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-09-14T18:09:16.531474] [DEBUG] [LOCAL ] FRO: Trimmed 56503 records to 38882 (keeping 150 days of data) [2025-09-14T18:09:16.590995] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-09-14T18:09:16.655842] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-14T18:09:16.663206] [INFO ] [REMOTE ] FSCO: Full fetch complete (39912 records). [2025-09-14T18:09:16.664490] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-09-14T18:09:17.150199] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-09-14T18:09:17.150315] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-09-14T18:09:17.151027] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-09-14T18:09:17.151104] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-09-14T18:09:17.153204] [DEBUG] [LOCAL ] FSCO: Trimmed 39912 records to 27469 (keeping 150 days of data) [2025-09-14T18:09:17.329284] [DEBUG] [LOCAL ] FSCO: Primary data saved (27469 records). [2025-09-14T18:09:17.333852] [INFO ] [MAIN ] FSCO: Full history saved. [2025-09-14T18:09:17.334020] [INFO ] [MAIN ] Update Progress: 870/2370 symbols completed. FSCO took 17.1s. Estimated remaining: 2h 38m 47s. Rate: 9.4 symbols/min [2025-09-14T18:09:17.443143] [DEBUG] [LOCAL ] FRO: Primary data saved (38882 records). [2025-09-14T18:09:17.445620] [INFO ] [MAIN ] FRO: Full history saved. [2025-09-14T18:09:17.451422] [INFO ] [MAIN ] Update Progress: 871/2370 symbols completed. FRO took 28.0s. Estimated remaining: 2h 38m 30s. Rate: 9.5 symbols/min [2025-09-14T18:09:17.627417] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:09:17.699913] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:09:17.718364] [DEBUG] [LOCAL ] FSLY: Loaded 23041 existing records from primary storage. [2025-09-14T18:09:17.718556] [INFO ] [MAIN ] FSLY: Loaded 23041 existing records. [2025-09-14T18:09:17.834524] [DEBUG] [LOCAL ] FSM: Loaded 23865 existing records from primary storage. [2025-09-14T18:09:17.845543] [INFO ] [MAIN ] FSM: Loaded 23865 existing records. [2025-09-14T18:09:17.990519] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:09:18.019053] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-09-14T18:09:18.019546] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-09-14T18:09:18.045658] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-09-14T18:09:18.065492] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-09-14T18:09:18.130375] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:09:18.228204] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-09-14T18:09:18.231554] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-09-14T18:09:18.272249] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-09-14T18:09:18.290690] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-09-14T18:09:18.473178] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-09-14T18:09:18.547615] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-09-14T18:09:18.713077] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:09:18.786139] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-09-14T18:09:18.896188] [INFO ] [REMOTE ] FSM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:09:18.926612] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-14T18:09:18.958782] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-09-14T18:09:19.758849] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-09-14T18:09:20.311516] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T18:09:20.512118] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T18:09:20.558876] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-09-14T18:09:20.707943] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T18:09:21.133319] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T18:09:21.358932] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-09-14T18:09:22.158842] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-09-14T18:09:22.554900] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-14T18:09:22.966360] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-09-14T18:09:22.989257] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T18:09:23.758900] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-09-14T18:09:23.988387] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T18:09:24.558839] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-09-14T18:09:24.792551] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-14T18:09:25.358938] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-09-14T18:09:25.869397] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-14T18:09:26.024537] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:09:26.030462] [INFO ] [REMOTE ] FRT: Full fetch complete (46028 records). [2025-09-14T18:09:26.030630] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-09-14T18:09:26.163941] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-09-14T18:09:26.417739] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-09-14T18:09:26.417879] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-09-14T18:09:26.418637] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-09-14T18:09:26.418727] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-09-14T18:09:26.419996] [DEBUG] [LOCAL ] FRT: Trimmed 46028 records to 31420 (keeping 150 days of data) [2025-09-14T18:09:26.573410] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-14T18:09:26.659259] [DEBUG] [LOCAL ] FRT: Primary data saved (31420 records). [2025-09-14T18:09:26.659479] [INFO ] [MAIN ] FRT: Full history saved. [2025-09-14T18:09:26.659614] [INFO ] [MAIN ] Update Progress: 872/2370 symbols completed. FRT took 31.3s. Estimated remaining: 2h 38m 28s. Rate: 9.5 symbols/min [2025-09-14T18:09:26.828936] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:09:26.844859] [DEBUG] [LOCAL ] FSS: Loaded 14618 existing records from primary storage. [2025-09-14T18:09:26.845027] [INFO ] [MAIN ] FSS: Loaded 14618 existing records. [2025-09-14T18:09:26.963945] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-09-14T18:09:27.021882] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:09:27.022096] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-09-14T18:09:27.022154] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-09-14T18:09:27.022696] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-09-14T18:09:27.022757] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-09-14T18:09:27.392050] [INFO ] [REMOTE ] FSS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:09:27.758844] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-09-14T18:09:27.992596] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-14T18:09:28.481262] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-14T18:09:28.487914] [INFO ] [REMOTE ] FSK: Full fetch complete (53552 records). [2025-09-14T18:09:28.488135] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-09-14T18:09:28.564058] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-09-14T18:09:28.875818] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-09-14T18:09:28.875933] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-09-14T18:09:28.876809] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-09-14T18:09:28.876866] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-09-14T18:09:28.877947] [DEBUG] [LOCAL ] FSK: Trimmed 53552 records to 36388 (keeping 150 days of data) [2025-09-14T18:09:28.993920] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T18:09:29.157349] [DEBUG] [LOCAL ] FSK: Primary data saved (36388 records). [2025-09-14T18:09:29.157603] [INFO ] [MAIN ] FSK: Full history saved. [2025-09-14T18:09:29.157817] [INFO ] [MAIN ] Update Progress: 873/2370 symbols completed. FSK took 27.0s. Estimated remaining: 2h 38m 16s. Rate: 9.5 symbols/min [2025-09-14T18:09:29.334355] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:09:29.339675] [DEBUG] [LOCAL ] FT: Loaded 2867 existing records from primary storage. [2025-09-14T18:09:29.339814] [INFO ] [MAIN ] FT: Loaded 2867 existing records. [2025-09-14T18:09:29.369977] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-09-14T18:09:29.516679] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:09:29.516943] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-09-14T18:09:29.517013] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-09-14T18:09:29.517274] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-09-14T18:09:29.517342] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-09-14T18:09:29.903668] [INFO ] [REMOTE ] FT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:09:30.158898] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-09-14T18:09:30.684168] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-14T18:09:30.821318] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-14T18:09:30.958853] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-09-14T18:09:31.579868] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-14T18:09:31.758840] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-09-14T18:09:31.959062] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-14T18:09:32.525458] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-14T18:09:32.558774] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-09-14T18:09:33.348883] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-14T18:09:33.358765] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-09-14T18:09:33.955346] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-14T18:09:34.158827] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-09-14T18:09:34.963126] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-09-14T18:09:34.965073] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-14T18:09:35.758883] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-09-14T18:09:36.374387] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-14T18:09:36.558852] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-09-14T18:09:37.358841] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-09-14T18:09:37.624735] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T18:09:38.163963] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-09-14T18:09:38.171955] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T18:09:38.176714] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T18:09:38.958829] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-09-14T18:09:39.549014] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T18:09:39.550372] [INFO ] [REMOTE ] FT: Full fetch complete (6669 records). [2025-09-14T18:09:39.550470] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-09-14T18:09:39.767871] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-09-14T18:09:39.927527] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-09-14T18:09:39.927754] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-09-14T18:09:39.927970] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-09-14T18:09:39.928027] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-09-14T18:09:39.928609] [DEBUG] [LOCAL ] FT: Trimmed 6669 records to 4756 (keeping 150 days of data) [2025-09-14T18:09:39.957014] [DEBUG] [LOCAL ] FT: Primary data saved (4756 records). [2025-09-14T18:09:39.957201] [INFO ] [MAIN ] FT: Full history saved. [2025-09-14T18:09:39.957374] [INFO ] [MAIN ] Update Progress: 874/2370 symbols completed. FT took 10.8s. Estimated remaining: 2h 38m 17s. Rate: 9.5 symbols/min [2025-09-14T18:09:40.133900] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-14T18:09:40.157377] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:09:40.175594] [DEBUG] [LOCAL ] FTHY: Loaded 5323 existing records from primary storage. [2025-09-14T18:09:40.175776] [INFO ] [MAIN ] FTHY: Loaded 5323 existing records. [2025-09-14T18:09:40.360479] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:09:40.360801] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-09-14T18:09:40.360864] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-09-14T18:09:40.361162] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-09-14T18:09:40.361220] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-09-14T18:09:40.568755] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-09-14T18:09:40.722096] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:09:41.358814] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-09-14T18:09:41.575404] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T18:09:42.158872] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-09-14T18:09:42.604929] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-14T18:09:42.958866] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-09-14T18:09:43.222074] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T18:09:43.554335] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-14T18:09:43.758815] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-09-14T18:09:44.558804] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-09-14T18:09:44.619320] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T18:09:45.218833] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T18:09:45.358824] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-09-14T18:09:46.158855] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-09-14T18:09:46.178833] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-14T18:09:46.185680] [INFO ] [REMOTE ] FSLY: Full fetch complete (55895 records). [2025-09-14T18:09:46.185813] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-09-14T18:09:46.582082] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-09-14T18:09:46.582198] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-09-14T18:09:46.583010] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-09-14T18:09:46.583076] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-09-14T18:09:46.584246] [DEBUG] [LOCAL ] FSLY: Trimmed 55895 records to 38359 (keeping 150 days of data) [2025-09-14T18:09:46.827121] [DEBUG] [LOCAL ] FSLY: Primary data saved (38359 records). [2025-09-14T18:09:46.827519] [INFO ] [MAIN ] FSLY: Full history saved. [2025-09-14T18:09:46.827674] [INFO ] [MAIN ] Update Progress: 875/2370 symbols completed. FSLY took 29.5s. Estimated remaining: 2h 38m 11s. Rate: 9.5 symbols/min [2025-09-14T18:09:46.960054] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-09-14T18:09:47.012166] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:09:47.037375] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T18:09:47.069249] [DEBUG] [LOCAL ] FTI: Loaded 23812 existing records from primary storage. [2025-09-14T18:09:47.069463] [INFO ] [MAIN ] FTI: Loaded 23812 existing records. [2025-09-14T18:09:47.260003] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:09:47.260313] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-09-14T18:09:47.260373] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-09-14T18:09:47.261068] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-09-14T18:09:47.261136] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-09-14T18:09:47.645922] [INFO ] [REMOTE ] FTI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:09:47.653735] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-14T18:09:47.670526] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-14T18:09:47.676256] [INFO ] [REMOTE ] FSM: Full fetch complete (57903 records). [2025-09-14T18:09:47.676435] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-09-14T18:09:47.763953] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-09-14T18:09:48.061274] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-09-14T18:09:48.061393] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-09-14T18:09:48.062231] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-09-14T18:09:48.062295] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-09-14T18:09:48.063951] [DEBUG] [LOCAL ] FSM: Trimmed 57903 records to 40060 (keeping 150 days of data) [2025-09-14T18:09:48.304754] [DEBUG] [LOCAL ] FSM: Primary data saved (40060 records). [2025-09-14T18:09:48.304983] [INFO ] [MAIN ] FSM: Full history saved. [2025-09-14T18:09:48.305087] [INFO ] [MAIN ] Update Progress: 876/2370 symbols completed. FSM took 30.8s. Estimated remaining: 2h 37m 57s. Rate: 9.5 symbols/min [2025-09-14T18:09:48.478329] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:09:48.495429] [DEBUG] [LOCAL ] FTK: Loaded 15395 existing records from primary storage. [2025-09-14T18:09:48.495622] [INFO ] [MAIN ] FTK: Loaded 15395 existing records. [2025-09-14T18:09:48.564025] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-09-14T18:09:48.681193] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:09:48.681442] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-09-14T18:09:48.681516] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-09-14T18:09:48.682062] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-09-14T18:09:48.682130] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-09-14T18:09:49.045888] [INFO ] [REMOTE ] FTK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:09:49.064151] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-14T18:09:49.259488] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-14T18:09:49.358880] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-09-14T18:09:50.158835] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-09-14T18:09:50.406377] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-14T18:09:50.958848] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-09-14T18:09:51.478988] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-14T18:09:51.758862] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-09-14T18:09:51.823044] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T18:09:52.500532] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-14T18:09:52.558786] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-09-14T18:09:53.301532] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-14T18:09:53.358810] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-09-14T18:09:54.158862] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-09-14T18:09:54.326241] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-14T18:09:54.554410] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-14T18:09:54.557688] [INFO ] [REMOTE ] FSS: Full fetch complete (38183 records). [2025-09-14T18:09:54.557858] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-09-14T18:09:54.949148] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-09-14T18:09:54.949283] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-09-14T18:09:54.950261] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-09-14T18:09:54.950320] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-09-14T18:09:54.951416] [DEBUG] [LOCAL ] FSS: Trimmed 38183 records to 25400 (keeping 150 days of data) [2025-09-14T18:09:55.015259] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-09-14T18:09:55.137822] [DEBUG] [LOCAL ] FSS: Primary data saved (25400 records). [2025-09-14T18:09:55.138070] [INFO ] [MAIN ] FSS: Full history saved. [2025-09-14T18:09:55.138211] [INFO ] [MAIN ] Update Progress: 877/2370 symbols completed. FSS took 28.5s. Estimated remaining: 2h 37m 51s. Rate: 9.5 symbols/min [2025-09-14T18:09:55.758832] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-09-14T18:09:56.539998] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-14T18:09:56.558812] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-09-14T18:09:56.827901] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T18:09:57.301033] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T18:09:57.302982] [INFO ] [REMOTE ] FTHY: Full fetch complete (12664 records). [2025-09-14T18:09:57.303133] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-09-14T18:09:57.368199] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-09-14T18:09:57.666983] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-09-14T18:09:57.667105] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-09-14T18:09:57.667458] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-09-14T18:09:57.667509] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-09-14T18:09:57.668013] [DEBUG] [LOCAL ] FTHY: Trimmed 12664 records to 8675 (keeping 150 days of data) [2025-09-14T18:09:57.723678] [DEBUG] [LOCAL ] FTHY: Primary data saved (8675 records). [2025-09-14T18:09:57.723866] [INFO ] [MAIN ] FTHY: Full history saved. [2025-09-14T18:09:57.723971] [INFO ] [MAIN ] Update Progress: 878/2370 symbols completed. FTHY took 17.8s. Estimated remaining: 2h 37m 38s. Rate: 9.5 symbols/min [2025-09-14T18:09:58.158836] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-09-14T18:09:59.087856] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T18:09:59.099558] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-09-14T18:09:59.324398] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T18:09:59.758859] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-09-14T18:10:00.797272] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T18:10:00.808993] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-09-14T18:10:00.889327] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-14T18:10:01.358845] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-09-14T18:10:02.886254] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-14T18:10:02.893960] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-09-14T18:10:02.955151] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-14T18:10:02.966815] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-09-14T18:10:04.612548] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T18:10:04.621414] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-09-14T18:10:04.736969] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T18:10:04.750203] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-09-14T18:10:05.600489] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-14T18:10:05.609291] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-09-14T18:10:06.633571] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-14T18:10:06.645472] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-09-14T18:10:07.146445] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-14T18:10:07.153892] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-09-14T18:10:08.345035] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-14T18:10:08.353382] [INFO ] [REMOTE ] FTI: Full fetch complete (57947 records). [2025-09-14T18:10:08.353577] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-09-14T18:10:08.540532] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-14T18:10:08.625665] [INFO ] [REMOTE ] FTK: Full fetch complete (33460 records). [2025-09-14T18:10:08.652314] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-09-14T18:10:08.857122] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-09-14T18:10:08.872510] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-09-14T18:10:08.909480] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-09-14T18:10:08.942486] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-09-14T18:10:09.037768] [DEBUG] [LOCAL ] FTI: Trimmed 57947 records to 40086 (keeping 150 days of data) [2025-09-14T18:10:09.185351] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-09-14T18:10:09.185553] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-09-14T18:10:09.212735] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-09-14T18:10:09.213412] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-09-14T18:10:09.221682] [DEBUG] [LOCAL ] FTK: Trimmed 33460 records to 25122 (keeping 150 days of data) [2025-09-14T18:10:09.495559] [DEBUG] [LOCAL ] FTK: Primary data saved (25122 records). [2025-09-14T18:10:09.496585] [INFO ] [MAIN ] FTK: Full history saved. [2025-09-14T18:10:09.497275] [INFO ] [MAIN ] Update Progress: 879/2370 symbols completed. FTK took 21.2s. Estimated remaining: 2h 37m 41s. Rate: 9.5 symbols/min [2025-09-14T18:10:09.524743] [DEBUG] [LOCAL ] FTI: Primary data saved (40086 records). [2025-09-14T18:10:09.524932] [INFO ] [MAIN ] FTI: Full history saved. [2025-09-14T18:10:09.525036] [INFO ] [MAIN ] Update Progress: 880/2370 symbols completed. FTI took 22.7s. Estimated remaining: 2h 37m 24s. Rate: 9.5 symbols/min [2025-09-14T18:10:10.117829] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:10:10.236215] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:10:10.241410] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:10:10.243280] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:10:10.250041] [DEBUG] [LOCAL ] FTWO: Loaded 905 existing records from primary storage. [2025-09-14T18:10:10.250202] [INFO ] [MAIN ] FTWO: Loaded 905 existing records. [2025-09-14T18:10:10.397261] [DEBUG] [LOCAL ] FTS: Loaded 19106 existing records from primary storage. [2025-09-14T18:10:10.386514] [DEBUG] [LOCAL ] FUBO: Loaded 24111 existing records from primary storage. [2025-09-14T18:10:10.419571] [INFO ] [MAIN ] FTS: Loaded 19106 existing records. [2025-09-14T18:10:10.425837] [INFO ] [MAIN ] FUBO: Loaded 24111 existing records. [2025-09-14T18:10:10.561796] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:10:10.488685] [DEBUG] [LOCAL ] FTV: Loaded 23744 existing records from primary storage. [2025-09-14T18:10:10.649966] [INFO ] [MAIN ] FTV: Loaded 23744 existing records. [2025-09-14T18:10:10.655380] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-09-14T18:10:10.702946] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-09-14T18:10:10.830059] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-09-14T18:10:10.897843] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-09-14T18:10:10.963403] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:10:10.988599] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-09-14T18:10:10.973322] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:10:11.009459] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-09-14T18:10:11.046633] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-09-14T18:10:11.101375] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:10:11.065090] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-09-14T18:10:11.117200] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-09-14T18:10:11.117125] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-09-14T18:10:11.139455] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-09-14T18:10:11.142863] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-09-14T18:10:11.208976] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-09-14T18:10:11.239792] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-09-14T18:10:11.267462] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-09-14T18:10:11.306552] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-09-14T18:10:12.038613] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:10:12.115610] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-09-14T18:10:12.333928] [INFO ] [REMOTE ] FTS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:10:12.403060] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-09-14T18:10:12.595371] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:10:12.601259] [INFO ] [REMOTE ] FTV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:10:12.601632] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-09-14T18:10:12.601848] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-09-14T18:10:12.875800] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-14T18:10:12.877123] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-09-14T18:10:13.374732] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-14T18:10:13.376262] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-09-14T18:10:13.868691] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-14T18:10:13.870600] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-09-14T18:10:13.978999] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T18:10:13.989862] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-09-14T18:10:14.244610] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-14T18:10:14.246581] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-09-14T18:10:14.314903] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T18:10:14.902324] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-14T18:10:14.958797] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-09-14T18:10:15.109349] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-09-14T18:10:15.505711] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-14T18:10:15.613635] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-14T18:10:15.758799] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-09-14T18:10:16.558940] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-09-14T18:10:17.260478] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-14T18:10:17.358884] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-09-14T18:10:18.158825] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-09-14T18:10:18.528292] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-14T18:10:18.650132] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-14T18:10:18.958858] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-09-14T18:10:19.240403] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-14T18:10:19.758916] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-09-14T18:10:20.423408] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T18:10:20.558908] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-09-14T18:10:21.358853] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-09-14T18:10:21.669476] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-14T18:10:22.073942] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T18:10:22.158879] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-09-14T18:10:22.958909] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-09-14T18:10:23.223931] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T18:10:23.289205] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T18:10:23.290164] [INFO ] [REMOTE ] FTWO: Full fetch complete (2042 records). [2025-09-14T18:10:23.290251] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-09-14T18:10:23.709123] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-09-14T18:10:23.709358] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-09-14T18:10:23.709605] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-09-14T18:10:23.709836] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-09-14T18:10:23.710387] [DEBUG] [LOCAL ] FTWO: Trimmed 2042 records to 1288 (keeping 150 days of data) [2025-09-14T18:10:23.719338] [DEBUG] [LOCAL ] FTWO: Primary data saved (1288 records). [2025-09-14T18:10:23.719528] [INFO ] [MAIN ] FTWO: Full history saved. [2025-09-14T18:10:23.719700] [INFO ] [MAIN ] Update Progress: 881/2370 symbols completed. FTWO took 14.2s. Estimated remaining: 2h 37m 31s. Rate: 9.5 symbols/min [2025-09-14T18:10:23.763955] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-09-14T18:10:23.953012] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T18:10:23.954636] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:10:23.977306] [DEBUG] [LOCAL ] FUL: Loaded 10008 existing records from primary storage. [2025-09-14T18:10:23.977504] [INFO ] [MAIN ] FUL: Loaded 10008 existing records. [2025-09-14T18:10:24.150864] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:10:24.151147] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-09-14T18:10:24.151212] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-09-14T18:10:24.151628] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-09-14T18:10:24.151718] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-09-14T18:10:24.516223] [INFO ] [REMOTE ] FUL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:10:24.558838] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-09-14T18:10:25.358865] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-09-14T18:10:26.165589] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-09-14T18:10:26.186473] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-14T18:10:26.234316] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T18:10:26.958805] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-09-14T18:10:27.374567] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-14T18:10:27.742298] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-14T18:10:27.758791] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-09-14T18:10:28.504315] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T18:10:28.558802] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-09-14T18:10:29.103266] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-14T18:10:29.107576] [INFO ] [REMOTE ] FTS: Full fetch complete (45888 records). [2025-09-14T18:10:29.107726] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-09-14T18:10:29.367079] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-09-14T18:10:29.479007] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-09-14T18:10:29.479121] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-09-14T18:10:29.479797] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-09-14T18:10:29.479891] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-09-14T18:10:29.480892] [DEBUG] [LOCAL ] FTS: Trimmed 45888 records to 31771 (keeping 150 days of data) [2025-09-14T18:10:29.676484] [DEBUG] [LOCAL ] FTS: Primary data saved (31771 records). [2025-09-14T18:10:29.676696] [INFO ] [MAIN ] FTS: Full history saved. [2025-09-14T18:10:29.676830] [INFO ] [MAIN ] Update Progress: 882/2370 symbols completed. FTS took 20.1s. Estimated remaining: 2h 37m 24s. Rate: 9.5 symbols/min [2025-09-14T18:10:29.848419] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:10:29.870943] [DEBUG] [LOCAL ] FUN: Loaded 23434 existing records from primary storage. [2025-09-14T18:10:29.871131] [INFO ] [MAIN ] FUN: Loaded 23434 existing records. [2025-09-14T18:10:30.058225] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:10:30.058586] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-09-14T18:10:30.058819] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-09-14T18:10:30.059546] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-09-14T18:10:30.059618] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-09-14T18:10:30.161946] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-09-14T18:10:30.439491] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T18:10:30.458503] [INFO ] [REMOTE ] FUN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:10:30.958861] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-09-14T18:10:31.428372] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-14T18:10:31.758900] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-09-14T18:10:32.114885] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-14T18:10:32.498327] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-14T18:10:32.558936] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-09-14T18:10:33.358875] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-09-14T18:10:34.165074] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-09-14T18:10:34.171794] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-14T18:10:34.437542] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T18:10:34.958856] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-09-14T18:10:35.162463] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T18:10:35.189575] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T18:10:35.758833] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-09-14T18:10:36.558841] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-09-14T18:10:37.087890] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-14T18:10:37.119784] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-14T18:10:37.358922] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-09-14T18:10:38.158835] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-09-14T18:10:38.487651] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-14T18:10:38.958890] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-09-14T18:10:39.214694] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-14T18:10:39.220369] [INFO ] [REMOTE ] FUBO: Full fetch complete (58379 records). [2025-09-14T18:10:39.220539] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-09-14T18:10:39.619658] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-09-14T18:10:39.619785] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-09-14T18:10:39.620686] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-09-14T18:10:39.621218] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-09-14T18:10:39.622579] [DEBUG] [LOCAL ] FUBO: Trimmed 58379 records to 40467 (keeping 150 days of data) [2025-09-14T18:10:39.737426] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-14T18:10:39.744275] [INFO ] [REMOTE ] FTV: Full fetch complete (57503 records). [2025-09-14T18:10:39.744659] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-09-14T18:10:39.766195] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-09-14T18:10:40.087295] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-14T18:10:40.201433] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-09-14T18:10:40.201545] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-09-14T18:10:40.203040] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-09-14T18:10:40.204262] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-09-14T18:10:40.207982] [DEBUG] [LOCAL ] FTV: Trimmed 57503 records to 39924 (keeping 150 days of data) [2025-09-14T18:10:40.558841] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-09-14T18:10:40.569447] [DEBUG] [LOCAL ] FUBO: Primary data saved (40467 records). [2025-09-14T18:10:40.571124] [INFO ] [MAIN ] FUBO: Full history saved. [2025-09-14T18:10:40.571758] [INFO ] [MAIN ] Update Progress: 883/2370 symbols completed. FUBO took 31.0s. Estimated remaining: 2h 37m 26s. Rate: 9.4 symbols/min [2025-09-14T18:10:40.753703] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:10:40.768424] [DEBUG] [LOCAL ] FVR: Loaded 9905 existing records from primary storage. [2025-09-14T18:10:40.769224] [INFO ] [MAIN ] FVR: Loaded 9905 existing records. [2025-09-14T18:10:40.937574] [DEBUG] [LOCAL ] FTV: Primary data saved (39924 records). [2025-09-14T18:10:40.957565] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:10:40.957741] [INFO ] [MAIN ] FTV: Full history saved. [2025-09-14T18:10:40.958130] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-09-14T18:10:40.958290] [INFO ] [MAIN ] Update Progress: 884/2370 symbols completed. FTV took 31.4s. Estimated remaining: 2h 37m 9s. Rate: 9.5 symbols/min [2025-09-14T18:10:40.963869] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-09-14T18:10:41.025188] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-09-14T18:10:41.042607] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-09-14T18:10:41.251342] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:10:41.467019] [DEBUG] [LOCAL ] FVRR: Loaded 18423 existing records from primary storage. [2025-09-14T18:10:41.520593] [INFO ] [REMOTE ] FVR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:10:41.521034] [INFO ] [MAIN ] FVRR: Loaded 18423 existing records. [2025-09-14T18:10:41.533528] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-09-14T18:10:41.729956] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:10:41.731567] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-14T18:10:41.731798] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-09-14T18:10:41.739462] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-09-14T18:10:41.740197] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-09-14T18:10:41.740266] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-09-14T18:10:42.099392] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:10:42.158803] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-09-14T18:10:42.414775] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T18:10:42.631283] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T18:10:42.958838] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-09-14T18:10:43.685069] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T18:10:43.758788] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-09-14T18:10:44.161936] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-14T18:10:44.558824] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-09-14T18:10:45.358816] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-09-14T18:10:45.383041] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-14T18:10:46.158851] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-09-14T18:10:46.233198] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T18:10:46.490878] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-14T18:10:46.958859] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-09-14T18:10:47.758778] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-09-14T18:10:47.787892] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T18:10:48.100417] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T18:10:48.558837] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-09-14T18:10:49.061327] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-14T18:10:49.358829] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-09-14T18:10:49.985010] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T18:10:49.992830] [INFO ] [REMOTE ] FUL: Full fetch complete (35709 records). [2025-09-14T18:10:49.993002] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-09-14T18:10:50.159686] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-09-14T18:10:50.374962] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-09-14T18:10:50.375195] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-09-14T18:10:50.375970] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-09-14T18:10:50.376044] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-09-14T18:10:50.377052] [DEBUG] [LOCAL ] FUL: Trimmed 35709 records to 23457 (keeping 150 days of data) [2025-09-14T18:10:50.503527] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-14T18:10:50.571428] [DEBUG] [LOCAL ] FUL: Primary data saved (23457 records). [2025-09-14T18:10:50.571609] [INFO ] [MAIN ] FUL: Full history saved. [2025-09-14T18:10:50.571752] [INFO ] [MAIN ] Update Progress: 885/2370 symbols completed. FUL took 26.9s. Estimated remaining: 2h 37m 8s. Rate: 9.5 symbols/min [2025-09-14T18:10:50.746457] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:10:50.748950] [DEBUG] [LOCAL ] FXED: Loaded 585 existing records from primary storage. [2025-09-14T18:10:50.749042] [INFO ] [MAIN ] FXED: Loaded 585 existing records. [2025-09-14T18:10:50.935020] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:10:50.935417] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-09-14T18:10:50.935504] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-09-14T18:10:50.935743] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-09-14T18:10:50.935811] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-09-14T18:10:50.966979] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-09-14T18:10:51.315103] [INFO ] [REMOTE ] FXED: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:10:51.758800] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-09-14T18:10:51.846563] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-14T18:10:52.558794] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-09-14T18:10:52.874073] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-14T18:10:52.978509] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-14T18:10:53.358864] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-09-14T18:10:53.698585] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-14T18:10:54.015334] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T18:10:54.158821] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-09-14T18:10:54.958839] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-09-14T18:10:55.675192] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-14T18:10:55.758771] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-09-14T18:10:56.083955] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-14T18:10:56.558810] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-09-14T18:10:57.058057] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T18:10:57.063820] [INFO ] [REMOTE ] FUN: Full fetch complete (55533 records). [2025-09-14T18:10:57.064018] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-09-14T18:10:57.359704] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-09-14T18:10:57.463878] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-09-14T18:10:57.464058] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-09-14T18:10:57.465086] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-09-14T18:10:57.465169] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-09-14T18:10:57.466993] [DEBUG] [LOCAL ] FUN: Trimmed 55533 records to 39041 (keeping 150 days of data) [2025-09-14T18:10:57.586149] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T18:10:57.753078] [DEBUG] [LOCAL ] FUN: Primary data saved (39041 records). [2025-09-14T18:10:57.753272] [INFO ] [MAIN ] FUN: Full history saved. [2025-09-14T18:10:57.753384] [INFO ] [MAIN ] Update Progress: 886/2370 symbols completed. FUN took 28.1s. Estimated remaining: 2h 37m 3s. Rate: 9.4 symbols/min [2025-09-14T18:10:57.865070] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-14T18:10:57.937592] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:10:57.960681] [DEBUG] [LOCAL ] G: Loaded 22348 existing records from primary storage. [2025-09-14T18:10:57.960860] [INFO ] [MAIN ] G: Loaded 22348 existing records. [2025-09-14T18:10:58.143614] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:10:58.143924] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-09-14T18:10:58.143985] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-09-14T18:10:58.144689] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-09-14T18:10:58.144754] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-09-14T18:10:58.165716] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-09-14T18:10:58.516610] [INFO ] [REMOTE ] G: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:10:58.630712] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-14T18:10:58.959001] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-09-14T18:10:59.758906] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-09-14T18:11:00.558847] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-09-14T18:11:00.632501] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T18:11:00.889176] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-14T18:11:00.893781] [INFO ] [REMOTE ] FVRR: Full fetch complete (44003 records). [2025-09-14T18:11:00.893944] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-09-14T18:11:01.201977] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-14T18:11:01.314904] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-09-14T18:11:01.315066] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-09-14T18:11:01.316336] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-09-14T18:11:01.316407] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-09-14T18:11:01.318209] [DEBUG] [LOCAL ] FVRR: Trimmed 44003 records to 30096 (keeping 150 days of data) [2025-09-14T18:11:01.372606] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-09-14T18:11:01.543913] [DEBUG] [LOCAL ] FVRR: Primary data saved (30096 records). [2025-09-14T18:11:01.544112] [INFO ] [MAIN ] FVRR: Full history saved. [2025-09-14T18:11:01.544219] [INFO ] [MAIN ] Update Progress: 887/2370 symbols completed. FVRR took 20.6s. Estimated remaining: 2h 36m 53s. Rate: 9.5 symbols/min [2025-09-14T18:11:01.720948] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:11:01.734241] [DEBUG] [LOCAL ] GAB: Loaded 11670 existing records from primary storage. [2025-09-14T18:11:01.734448] [INFO ] [MAIN ] GAB: Loaded 11670 existing records. [2025-09-14T18:11:01.920745] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:11:01.921075] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-09-14T18:11:01.921150] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-09-14T18:11:01.921508] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-09-14T18:11:01.921565] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-09-14T18:11:02.160698] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-09-14T18:11:02.184746] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-14T18:11:02.321754] [INFO ] [REMOTE ] GAB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:11:02.958924] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-09-14T18:11:03.417315] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T18:11:03.758804] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-09-14T18:11:04.100403] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T18:11:04.508247] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T18:11:04.510557] [INFO ] [REMOTE ] FVR: Full fetch complete (23339 records). [2025-09-14T18:11:04.510759] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-09-14T18:11:04.563942] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-09-14T18:11:04.877286] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-09-14T18:11:04.877438] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-09-14T18:11:04.878088] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-09-14T18:11:04.878164] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-09-14T18:11:04.878885] [DEBUG] [LOCAL ] FVR: Trimmed 23339 records to 16555 (keeping 150 days of data) [2025-09-14T18:11:04.978873] [DEBUG] [LOCAL ] FVR: Primary data saved (16555 records). [2025-09-14T18:11:04.979071] [INFO ] [MAIN ] FVR: Full history saved. [2025-09-14T18:11:04.979218] [INFO ] [MAIN ] Update Progress: 888/2370 symbols completed. FVR took 24.4s. Estimated remaining: 2h 36m 42s. Rate: 9.5 symbols/min [2025-09-14T18:11:05.147096] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:11:05.150561] [DEBUG] [LOCAL ] GAM: Loaded 1782 existing records from primary storage. [2025-09-14T18:11:05.150689] [INFO ] [MAIN ] GAM: Loaded 1782 existing records. [2025-09-14T18:11:05.326580] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:11:05.326874] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-09-14T18:11:05.326933] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-09-14T18:11:05.327205] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-09-14T18:11:05.327264] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-09-14T18:11:05.364026] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-09-14T18:11:05.687720] [INFO ] [REMOTE ] GAM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:11:05.913543] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-14T18:11:06.015022] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-14T18:11:06.158859] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-09-14T18:11:06.648189] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-14T18:11:06.958902] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-09-14T18:11:07.322909] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-14T18:11:07.323750] [INFO ] [REMOTE ] FXED: Full fetch complete (1283 records). [2025-09-14T18:11:07.323862] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-09-14T18:11:07.707043] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-09-14T18:11:07.707171] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-09-14T18:11:07.707268] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-09-14T18:11:07.707321] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-09-14T18:11:07.707698] [DEBUG] [LOCAL ] FXED: Trimmed 1283 records to 881 (keeping 150 days of data) [2025-09-14T18:11:07.713749] [DEBUG] [LOCAL ] FXED: Primary data saved (881 records). [2025-09-14T18:11:07.713822] [INFO ] [MAIN ] FXED: Full history saved. [2025-09-14T18:11:07.713907] [INFO ] [MAIN ] Update Progress: 889/2370 symbols completed. FXED took 17.1s. Estimated remaining: 2h 36m 29s. Rate: 9.5 symbols/min [2025-09-14T18:11:07.764373] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-09-14T18:11:07.891402] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:11:07.915833] [DEBUG] [LOCAL ] GAP: Loaded 24070 existing records from primary storage. [2025-09-14T18:11:07.916034] [INFO ] [MAIN ] GAP: Loaded 24070 existing records. [2025-09-14T18:11:08.097163] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:11:08.097551] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-09-14T18:11:08.097618] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-09-14T18:11:08.098307] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-09-14T18:11:08.098380] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-09-14T18:11:08.460048] [INFO ] [REMOTE ] GAP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:11:08.558795] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-09-14T18:11:09.358835] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-09-14T18:11:09.586292] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T18:11:10.158836] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-09-14T18:11:10.233453] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T18:11:10.958798] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-09-14T18:11:11.442079] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-14T18:11:11.758854] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-09-14T18:11:11.885435] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T18:11:12.108775] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-14T18:11:12.558856] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-09-14T18:11:12.634470] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T18:11:13.358858] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-09-14T18:11:14.158909] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-09-14T18:11:14.427155] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T18:11:14.617473] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T18:11:14.950281] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-14T18:11:14.958773] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-09-14T18:11:15.651532] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-14T18:11:15.758822] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-09-14T18:11:16.558857] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-09-14T18:11:17.358835] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-09-14T18:11:17.676347] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T18:11:17.858303] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-14T18:11:18.158848] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-09-14T18:11:18.773413] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-14T18:11:18.958840] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-09-14T18:11:19.130518] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T18:11:19.508166] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-14T18:11:19.758856] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-09-14T18:11:20.452592] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-14T18:11:20.558854] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-09-14T18:11:21.358848] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-09-14T18:11:21.983737] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-14T18:11:22.158809] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-09-14T18:11:22.591811] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-14T18:11:22.958840] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-09-14T18:11:23.322255] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T18:11:23.758860] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-09-14T18:11:24.389211] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T18:11:24.390238] [INFO ] [REMOTE ] GAM: Full fetch complete (4990 records). [2025-09-14T18:11:24.390338] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-09-14T18:11:24.571089] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-09-14T18:11:24.755739] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-09-14T18:11:24.755880] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-09-14T18:11:24.756065] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-09-14T18:11:24.756117] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-09-14T18:11:24.756557] [DEBUG] [LOCAL ] GAM: Trimmed 4990 records to 2802 (keeping 150 days of data) [2025-09-14T18:11:24.773707] [DEBUG] [LOCAL ] GAM: Primary data saved (2802 records). [2025-09-14T18:11:24.773798] [INFO ] [MAIN ] GAM: Full history saved. [2025-09-14T18:11:24.773889] [INFO ] [MAIN ] Update Progress: 890/2370 symbols completed. GAM took 19.8s. Estimated remaining: 2h 36m 41s. Rate: 9.4 symbols/min [2025-09-14T18:11:24.956059] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:11:24.966327] [DEBUG] [LOCAL ] GATX: Loaded 7402 existing records from primary storage. [2025-09-14T18:11:24.966512] [INFO ] [MAIN ] GATX: Loaded 7402 existing records. [2025-09-14T18:11:25.207507] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-14T18:11:25.204418] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:11:25.207995] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-09-14T18:11:25.220699] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-14T18:11:25.221541] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-09-14T18:11:25.221689] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-09-14T18:11:25.364008] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-09-14T18:11:25.708476] [INFO ] [REMOTE ] GATX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:11:26.158918] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-09-14T18:11:26.486681] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-14T18:11:26.667621] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-14T18:11:26.671462] [INFO ] [REMOTE ] GAB: Full fetch complete (29384 records). [2025-09-14T18:11:26.671573] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-09-14T18:11:26.962335] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-09-14T18:11:27.052530] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-09-14T18:11:27.052745] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-09-14T18:11:27.054085] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-09-14T18:11:27.054260] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-09-14T18:11:27.060939] [DEBUG] [LOCAL ] GAB: Trimmed 29384 records to 19836 (keeping 150 days of data) [2025-09-14T18:11:27.066759] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T18:11:27.184676] [DEBUG] [LOCAL ] GAB: Primary data saved (19836 records). [2025-09-14T18:11:27.184894] [INFO ] [MAIN ] GAB: Full history saved. [2025-09-14T18:11:27.185095] [INFO ] [MAIN ] Update Progress: 891/2370 symbols completed. GAB took 25.6s. Estimated remaining: 2h 36m 28s. Rate: 9.5 symbols/min [2025-09-14T18:11:27.365297] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:11:27.374181] [DEBUG] [LOCAL ] GBAB: Loaded 6343 existing records from primary storage. [2025-09-14T18:11:27.374339] [INFO ] [MAIN ] GBAB: Loaded 6343 existing records. [2025-09-14T18:11:27.560627] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:11:27.560948] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-09-14T18:11:27.561010] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-09-14T18:11:27.561344] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-09-14T18:11:27.561404] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-09-14T18:11:27.766432] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-09-14T18:11:27.931332] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:11:28.558793] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-09-14T18:11:28.910342] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-14T18:11:29.083773] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-14T18:11:29.358882] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-09-14T18:11:30.016675] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-14T18:11:30.158831] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-09-14T18:11:30.831662] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:11:30.837294] [INFO ] [REMOTE ] G: Full fetch complete (54217 records). [2025-09-14T18:11:30.837412] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-09-14T18:11:30.964021] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-09-14T18:11:31.223738] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-09-14T18:11:31.224008] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-09-14T18:11:31.224902] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-09-14T18:11:31.225125] [DEBUG] [LOCAL ] G: Saving primary data. [2025-09-14T18:11:31.226361] [DEBUG] [LOCAL ] G: Trimmed 54217 records to 37400 (keeping 150 days of data) [2025-09-14T18:11:31.355057] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-14T18:11:31.505556] [DEBUG] [LOCAL ] G: Primary data saved (37400 records). [2025-09-14T18:11:31.505761] [INFO ] [MAIN ] G: Full history saved. [2025-09-14T18:11:31.505879] [INFO ] [MAIN ] Update Progress: 892/2370 symbols completed. G took 33.8s. Estimated remaining: 2h 36m 18s. Rate: 9.5 symbols/min [2025-09-14T18:11:31.673231] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:11:31.692215] [DEBUG] [LOCAL ] GBCI: Loaded 18526 existing records from primary storage. [2025-09-14T18:11:31.692394] [INFO ] [MAIN ] GBCI: Loaded 18526 existing records. [2025-09-14T18:11:31.765356] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-09-14T18:11:31.875221] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:11:31.875567] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-09-14T18:11:31.875629] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-14T18:11:31.876151] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-09-14T18:11:31.876210] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-09-14T18:11:32.221765] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:11:32.236984] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-14T18:11:32.558839] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-09-14T18:11:33.358897] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-09-14T18:11:33.586586] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-14T18:11:33.927409] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-14T18:11:34.158853] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-09-14T18:11:34.498675] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T18:11:34.958832] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-09-14T18:11:35.091876] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-14T18:11:35.758827] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-09-14T18:11:36.518756] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T18:11:36.558789] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-09-14T18:11:36.955549] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-14T18:11:37.358829] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-09-14T18:11:37.583495] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-14T18:11:38.158812] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-09-14T18:11:38.435620] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T18:11:38.958812] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-09-14T18:11:39.022240] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T18:11:39.643916] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:11:39.649618] [INFO ] [REMOTE ] GAP: Full fetch complete (58331 records). [2025-09-14T18:11:39.649840] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-09-14T18:11:39.764010] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-09-14T18:11:40.035591] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-09-14T18:11:40.035724] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-09-14T18:11:40.036568] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-09-14T18:11:40.036625] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-09-14T18:11:40.038261] [DEBUG] [LOCAL ] GAP: Trimmed 58331 records to 40398 (keeping 150 days of data) [2025-09-14T18:11:40.317020] [DEBUG] [LOCAL ] GAP: Primary data saved (40398 records). [2025-09-14T18:11:40.317190] [INFO ] [MAIN ] GAP: Full history saved. [2025-09-14T18:11:40.317309] [INFO ] [MAIN ] Update Progress: 893/2370 symbols completed. GAP took 32.6s. Estimated remaining: 2h 36m 16s. Rate: 9.5 symbols/min [2025-09-14T18:11:40.484336] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:11:40.490511] [DEBUG] [LOCAL ] GBLI: Loaded 464 existing records from primary storage. [2025-09-14T18:11:40.490677] [INFO ] [MAIN ] GBLI: Loaded 464 existing records. [2025-09-14T18:11:40.568733] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-09-14T18:11:40.675002] [WARN ] [MAIN ] GBLI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:11:40.675265] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-14T18:11:40.675324] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-14T18:11:40.675595] [DEBUG] [LOCAL ] GBLI: Deleted primary data file. [2025-09-14T18:11:40.675683] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-14T18:11:41.036845] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:11:41.050163] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-14T18:11:41.358836] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-14T18:11:41.725289] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-14T18:11:42.158802] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-14T18:11:42.230416] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T18:11:42.474338] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-14T18:11:42.958837] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-09-14T18:11:43.758843] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-14T18:11:44.162282] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-14T18:11:44.570327] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T18:11:44.568635] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-14T18:11:45.006155] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-14T18:11:45.358825] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-09-14T18:11:46.158827] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-09-14T18:11:46.443961] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T18:11:46.958865] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-14T18:11:47.262094] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-14T18:11:47.332793] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-14T18:11:47.758886] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-09-14T18:11:48.558871] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-09-14T18:11:49.358876] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-09-14T18:11:49.388503] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-14T18:11:49.545449] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T18:11:49.925684] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T18:11:49.928566] [INFO ] [REMOTE ] GATX: Full fetch complete (18887 records). [2025-09-14T18:11:49.928683] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-09-14T18:11:50.164114] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-09-14T18:11:50.294927] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-09-14T18:11:50.295039] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-09-14T18:11:50.295525] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-09-14T18:11:50.295579] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-09-14T18:11:50.296578] [DEBUG] [LOCAL ] GATX: Trimmed 18887 records to 13288 (keeping 150 days of data) [2025-09-14T18:11:50.385678] [DEBUG] [LOCAL ] GATX: Primary data saved (13288 records). [2025-09-14T18:11:50.385873] [INFO ] [MAIN ] GATX: Full history saved. [2025-09-14T18:11:50.385973] [INFO ] [MAIN ] Update Progress: 894/2370 symbols completed. GATX took 25.6s. Estimated remaining: 2h 36m 16s. Rate: 9.4 symbols/min [2025-09-14T18:11:50.552396] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:11:50.570111] [DEBUG] [LOCAL ] GBTG: Loaded 17488 existing records from primary storage. [2025-09-14T18:11:50.570320] [INFO ] [MAIN ] GBTG: Loaded 17488 existing records. [2025-09-14T18:11:50.749608] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:11:50.750007] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-09-14T18:11:50.750072] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-09-14T18:11:50.750743] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-09-14T18:11:50.750811] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-09-14T18:11:50.964054] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-09-14T18:11:51.114114] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:11:51.650246] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T18:11:51.758846] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-14T18:11:52.067493] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-14T18:11:52.079496] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T18:11:52.558835] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-09-14T18:11:53.018930] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-14T18:11:53.023028] [INFO ] [REMOTE ] GBCI: Full fetch complete (43618 records). [2025-09-14T18:11:53.023136] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-09-14T18:11:53.364008] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-09-14T18:11:53.404486] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-09-14T18:11:53.404617] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-09-14T18:11:53.405474] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-09-14T18:11:53.405558] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-09-14T18:11:53.406701] [DEBUG] [LOCAL ] GBCI: Trimmed 43618 records to 29959 (keeping 150 days of data) [2025-09-14T18:11:53.605558] [DEBUG] [LOCAL ] GBCI: Primary data saved (29959 records). [2025-09-14T18:11:53.605769] [INFO ] [MAIN ] GBCI: Full history saved. [2025-09-14T18:11:53.605887] [INFO ] [MAIN ] Update Progress: 895/2370 symbols completed. GBCI took 22.1s. Estimated remaining: 2h 36m 4s. Rate: 9.5 symbols/min [2025-09-14T18:11:53.777669] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:11:53.791149] [DEBUG] [LOCAL ] GBX: Loaded 12317 existing records from primary storage. [2025-09-14T18:11:53.791316] [INFO ] [MAIN ] GBX: Loaded 12317 existing records. [2025-09-14T18:11:54.004722] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:11:54.005001] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-09-14T18:11:54.005061] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-09-14T18:11:54.005608] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-09-14T18:11:54.005703] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-09-14T18:11:54.163721] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-14T18:11:54.371895] [INFO ] [REMOTE ] GBX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:11:54.380254] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-14T18:11:54.631349] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-14T18:11:54.958825] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-14T18:11:55.204682] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-09-14T18:11:55.205501] [INFO ] [REMOTE ] GBLI: Full fetch complete (1054 records). [2025-09-14T18:11:55.205588] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-09-14T18:11:55.421313] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-14T18:11:55.421622] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:11:55.421712] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:11:55.421780] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-14T18:11:55.421880] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-14T18:11:55.421944] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-09-14T18:11:55.422010] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-09-14T18:11:55.422119] [INFO ] [MAIN ] Update Progress: 896/2370 symbols completed. GBLI took 15.1s. Estimated remaining: 2h 35m 50s. Rate: 9.5 symbols/min [2025-09-14T18:11:55.599154] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:11:55.619609] [DEBUG] [LOCAL ] GCI: Loaded 19477 existing records from primary storage. [2025-09-14T18:11:55.619798] [INFO ] [MAIN ] GCI: Loaded 19477 existing records. [2025-09-14T18:11:55.763120] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-09-14T18:11:55.796713] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:11:55.796947] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-09-14T18:11:55.797004] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-09-14T18:11:55.797573] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-09-14T18:11:55.797634] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-09-14T18:11:56.149317] [INFO ] [REMOTE ] GCI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:11:56.558862] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-09-14T18:11:57.241780] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-14T18:11:57.358843] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-09-14T18:11:57.859620] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-14T18:11:58.158845] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-09-14T18:11:58.814976] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T18:11:58.958862] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-09-14T18:11:59.546490] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-14T18:11:59.758818] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-09-14T18:12:00.503667] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-14T18:12:00.558853] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-09-14T18:12:01.358894] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-09-14T18:12:01.659958] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-14T18:12:01.999622] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-14T18:12:02.158851] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-09-14T18:12:02.958869] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-09-14T18:12:03.758847] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-09-14T18:12:04.641066] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (3.28 seconds). [2025-09-14T18:12:04.651588] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-09-14T18:12:04.720800] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-09-14T18:12:05.077560] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-14T18:12:05.079607] [INFO ] [REMOTE ] GBAB: Full fetch complete (14405 records). [2025-09-14T18:12:05.079744] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-09-14T18:12:05.360668] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-09-14T18:12:05.459471] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-09-14T18:12:05.459750] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-09-14T18:12:05.460230] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-09-14T18:12:05.460310] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-09-14T18:12:05.461049] [DEBUG] [LOCAL ] GBAB: Trimmed 14405 records to 9681 (keeping 150 days of data) [2025-09-14T18:12:05.538624] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-14T18:12:05.555940] [DEBUG] [LOCAL ] GBAB: Primary data saved (9681 records). [2025-09-14T18:12:05.556064] [INFO ] [MAIN ] GBAB: Full history saved. [2025-09-14T18:12:05.556155] [INFO ] [MAIN ] Update Progress: 897/2370 symbols completed. GBAB took 38.4s. Estimated remaining: 2h 35m 50s. Rate: 9.5 symbols/min [2025-09-14T18:12:05.725893] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:12:05.738552] [DEBUG] [LOCAL ] GCO: Loaded 9633 existing records from primary storage. [2025-09-14T18:12:05.738729] [INFO ] [MAIN ] GCO: Loaded 9633 existing records. [2025-09-14T18:12:05.914564] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:12:05.914854] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-09-14T18:12:05.914916] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-09-14T18:12:05.915330] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-09-14T18:12:05.915395] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-09-14T18:12:06.162895] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-09-14T18:12:06.267909] [INFO ] [REMOTE ] GCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:12:06.292825] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-14T18:12:06.581749] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T18:12:06.958842] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-09-14T18:12:07.758836] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-09-14T18:12:07.954750] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T18:12:08.012766] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T18:12:08.558881] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-09-14T18:12:09.311748] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T18:12:09.358793] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-09-14T18:12:10.117872] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T18:12:10.158790] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-09-14T18:12:10.470746] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T18:12:10.958894] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-09-14T18:12:11.617882] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T18:12:11.758816] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-09-14T18:12:12.356305] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-14T18:12:12.558861] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-09-14T18:12:12.820162] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-14T18:12:13.358848] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-09-14T18:12:14.019514] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-14T18:12:14.158843] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-09-14T18:12:14.276455] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-14T18:12:14.958822] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-09-14T18:12:15.476460] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-14T18:12:15.758847] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-09-14T18:12:16.334395] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-14T18:12:16.338802] [INFO ] [REMOTE ] GBTG: Full fetch complete (43457 records). [2025-09-14T18:12:16.338938] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-09-14T18:12:16.568143] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-09-14T18:12:16.715620] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-09-14T18:12:16.715752] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-09-14T18:12:16.716546] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-09-14T18:12:16.716603] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-09-14T18:12:16.717705] [DEBUG] [LOCAL ] GBTG: Trimmed 43457 records to 30281 (keeping 150 days of data) [2025-09-14T18:12:16.899280] [DEBUG] [LOCAL ] GBTG: Primary data saved (30281 records). [2025-09-14T18:12:16.899458] [INFO ] [MAIN ] GBTG: Full history saved. [2025-09-14T18:12:16.899559] [INFO ] [MAIN ] Update Progress: 898/2370 symbols completed. GBTG took 26.5s. Estimated remaining: 2h 35m 52s. Rate: 9.4 symbols/min [2025-09-14T18:12:17.072025] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:12:17.085766] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-14T18:12:17.097813] [DEBUG] [LOCAL ] GCTS: Loaded 8506 existing records from primary storage. [2025-09-14T18:12:17.097965] [INFO ] [MAIN ] GCTS: Loaded 8506 existing records. [2025-09-14T18:12:17.277447] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:12:17.277777] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-09-14T18:12:17.277839] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-14T18:12:17.278225] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-09-14T18:12:17.278287] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-09-14T18:12:17.368706] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-09-14T18:12:17.668187] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:12:18.158912] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-09-14T18:12:18.557008] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-14T18:12:18.958914] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-09-14T18:12:19.302514] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-14T18:12:19.758861] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-09-14T18:12:19.970312] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T18:12:20.067863] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-14T18:12:20.558841] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-09-14T18:12:20.707337] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-14T18:12:21.358846] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-09-14T18:12:21.439899] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T18:12:22.158860] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-09-14T18:12:22.573803] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-14T18:12:22.578575] [INFO ] [REMOTE ] GCI: Full fetch complete (48005 records). [2025-09-14T18:12:22.578758] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-09-14T18:12:22.960667] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-09-14T18:12:22.973033] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-09-14T18:12:22.973108] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-09-14T18:12:22.973960] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-09-14T18:12:22.974114] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-09-14T18:12:22.975365] [DEBUG] [LOCAL ] GCI: Trimmed 48005 records to 33004 (keeping 150 days of data) [2025-09-14T18:12:23.162022] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T18:12:23.166555] [INFO ] [REMOTE ] GCO: Full fetch complete (27820 records). [2025-09-14T18:12:23.167258] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-09-14T18:12:23.453974] [DEBUG] [LOCAL ] GCI: Primary data saved (33004 records). [2025-09-14T18:12:23.469696] [INFO ] [MAIN ] GCI: Full history saved. [2025-09-14T18:12:23.480688] [INFO ] [MAIN ] Update Progress: 899/2370 symbols completed. GCI took 28.1s. Estimated remaining: 2h 35m 46s. Rate: 9.4 symbols/min [2025-09-14T18:12:23.574490] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-09-14T18:12:23.562084] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T18:12:23.595882] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-09-14T18:12:23.620727] [INFO ] [REMOTE ] GBX: Full fetch complete (32590 records). [2025-09-14T18:12:23.644913] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-09-14T18:12:23.665675] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-09-14T18:12:23.644988] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-09-14T18:12:23.734066] [DEBUG] [LOCAL ] GCO: Trimmed 27820 records to 17713 (keeping 150 days of data) [2025-09-14T18:12:23.766035] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-09-14T18:12:23.748454] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:12:23.922699] [DEBUG] [LOCAL ] GCV: Loaded 3208 existing records from primary storage. [2025-09-14T18:12:23.943002] [INFO ] [MAIN ] GCV: Loaded 3208 existing records. [2025-09-14T18:12:24.418159] [DEBUG] [LOCAL ] GCO: Primary data saved (17713 records). [2025-09-14T18:12:24.450895] [INFO ] [MAIN ] GCO: Full history saved. [2025-09-14T18:12:24.421528] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:12:24.453278] [INFO ] [MAIN ] Update Progress: 900/2370 symbols completed. GCO took 18.9s. Estimated remaining: 2h 35m 31s. Rate: 9.5 symbols/min [2025-09-14T18:12:24.453608] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-09-14T18:12:24.454284] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-14T18:12:24.453953] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-09-14T18:12:24.466203] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-09-14T18:12:24.454765] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-09-14T18:12:24.492799] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-09-14T18:12:24.512494] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-09-14T18:12:24.576523] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-09-14T18:12:24.710363] [DEBUG] [LOCAL ] GBX: Trimmed 32590 records to 21172 (keeping 150 days of data) [2025-09-14T18:12:24.773400] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:12:25.115208] [DEBUG] [LOCAL ] GD: Loaded 20571 existing records from primary storage. [2025-09-14T18:12:25.109041] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-14T18:12:25.151325] [INFO ] [MAIN ] GD: Loaded 20571 existing records. [2025-09-14T18:12:25.156541] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-09-14T18:12:25.191088] [INFO ] [REMOTE ] GCV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:12:25.370560] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-09-14T18:12:25.420450] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:12:25.430292] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-09-14T18:12:25.431095] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-09-14T18:12:25.432344] [DEBUG] [LOCAL ] GBX: Primary data saved (21172 records). [2025-09-14T18:12:25.432464] [INFO ] [MAIN ] GBX: Full history saved. [2025-09-14T18:12:25.432561] [INFO ] [MAIN ] Update Progress: 901/2370 symbols completed. GBX took 31.8s. Estimated remaining: 2h 35m 16s. Rate: 9.5 symbols/min [2025-09-14T18:12:25.444439] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-09-14T18:12:25.466906] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-09-14T18:12:25.780597] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:12:26.024791] [INFO ] [REMOTE ] GD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:12:26.027885] [DEBUG] [LOCAL ] GDDY: Loaded 22543 existing records from primary storage. [2025-09-14T18:12:26.028158] [INFO ] [MAIN ] GDDY: Loaded 22543 existing records. [2025-09-14T18:12:26.164032] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-09-14T18:12:26.225809] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:12:26.232076] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T18:12:26.232230] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-09-14T18:12:26.234037] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-09-14T18:12:26.235475] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-09-14T18:12:26.235561] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-09-14T18:12:26.586858] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:12:26.602870] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-14T18:12:26.958856] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-09-14T18:12:27.758876] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-09-14T18:12:28.134709] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-14T18:12:28.424793] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-14T18:12:28.558865] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-09-14T18:12:28.702065] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T18:12:29.358842] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-09-14T18:12:30.158848] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-09-14T18:12:30.527918] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-14T18:12:30.958896] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-09-14T18:12:31.090026] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-14T18:12:31.638314] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T18:12:31.758842] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-09-14T18:12:32.558851] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-09-14T18:12:33.319185] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-14T18:12:33.346229] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T18:12:33.358771] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-09-14T18:12:34.158895] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-09-14T18:12:34.405509] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T18:12:34.427506] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-14T18:12:34.958894] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-09-14T18:12:35.758810] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-09-14T18:12:35.862899] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T18:12:35.985339] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-14T18:12:35.989059] [INFO ] [REMOTE ] GCTS: Full fetch complete (20559 records). [2025-09-14T18:12:35.989228] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-09-14T18:12:36.366826] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-09-14T18:12:36.366936] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-09-14T18:12:36.367396] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-09-14T18:12:36.367448] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-09-14T18:12:36.368087] [DEBUG] [LOCAL ] GCTS: Trimmed 20559 records to 15783 (keeping 150 days of data) [2025-09-14T18:12:36.465039] [DEBUG] [LOCAL ] GCTS: Primary data saved (15783 records). [2025-09-14T18:12:36.465221] [INFO ] [MAIN ] GCTS: Full history saved. [2025-09-14T18:12:36.465323] [INFO ] [MAIN ] Update Progress: 902/2370 symbols completed. GCTS took 19.6s. Estimated remaining: 2h 35m 17s. Rate: 9.5 symbols/min [2025-09-14T18:12:36.563912] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-09-14T18:12:36.636541] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:12:36.639941] [DEBUG] [LOCAL ] GDIV: Loaded 1278 existing records from primary storage. [2025-09-14T18:12:36.640039] [INFO ] [MAIN ] GDIV: Loaded 1278 existing records. [2025-09-14T18:12:36.822558] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:12:36.823875] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-09-14T18:12:36.823939] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-09-14T18:12:36.824451] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-09-14T18:12:36.824513] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-09-14T18:12:37.180361] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:12:37.358828] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-09-14T18:12:37.594749] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T18:12:37.955569] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-14T18:12:38.158917] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-09-14T18:12:38.159873] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-14T18:12:38.605634] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-14T18:12:38.958838] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-09-14T18:12:39.758836] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-09-14T18:12:39.807866] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-14T18:12:40.558852] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-09-14T18:12:41.173114] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-14T18:12:41.358824] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-09-14T18:12:41.653520] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-14T18:12:42.158884] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-09-14T18:12:42.182152] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T18:12:42.958840] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-09-14T18:12:43.758874] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-09-14T18:12:43.986191] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T18:12:44.558850] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-09-14T18:12:44.591799] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T18:12:44.624768] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T18:12:45.200213] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T18:12:45.204851] [INFO ] [REMOTE ] GD: Full fetch complete (52250 records). [2025-09-14T18:12:45.204986] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-09-14T18:12:45.365763] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-09-14T18:12:45.591262] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-09-14T18:12:45.591382] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-09-14T18:12:45.592235] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-09-14T18:12:45.592297] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-09-14T18:12:45.593486] [DEBUG] [LOCAL ] GD: Trimmed 52250 records to 35042 (keeping 150 days of data) [2025-09-14T18:12:45.838944] [DEBUG] [LOCAL ] GD: Primary data saved (35042 records). [2025-09-14T18:12:45.839160] [INFO ] [MAIN ] GD: Full history saved. [2025-09-14T18:12:45.839304] [INFO ] [MAIN ] Update Progress: 903/2370 symbols completed. GD took 21.4s. Estimated remaining: 2h 35m 16s. Rate: 9.4 symbols/min [2025-09-14T18:12:46.009154] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:12:46.012294] [DEBUG] [LOCAL ] GDL: Loaded 1284 existing records from primary storage. [2025-09-14T18:12:46.012387] [INFO ] [MAIN ] GDL: Loaded 1284 existing records. [2025-09-14T18:12:46.163899] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-09-14T18:12:46.192481] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:12:46.192885] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-09-14T18:12:46.192950] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-14T18:12:46.193193] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-09-14T18:12:46.193252] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-09-14T18:12:46.550863] [INFO ] [REMOTE ] GDL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:12:46.895950] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-14T18:12:46.958872] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-09-14T18:12:47.176228] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-14T18:12:47.753612] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-14T18:12:47.758768] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-09-14T18:12:48.555616] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-14T18:12:48.558759] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-09-14T18:12:49.318566] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:12:49.320180] [INFO ] [REMOTE ] GCV: Full fetch complete (7384 records). [2025-09-14T18:12:49.320267] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-09-14T18:12:49.364137] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-09-14T18:12:49.694070] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-09-14T18:12:49.694184] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-09-14T18:12:49.694422] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-09-14T18:12:49.694534] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-09-14T18:12:49.695229] [DEBUG] [LOCAL ] GCV: Trimmed 7384 records to 5535 (keeping 150 days of data) [2025-09-14T18:12:49.727793] [DEBUG] [LOCAL ] GCV: Primary data saved (5535 records). [2025-09-14T18:12:49.727938] [INFO ] [MAIN ] GCV: Full history saved. [2025-09-14T18:12:49.728117] [INFO ] [MAIN ] Update Progress: 904/2370 symbols completed. GCV took 26.2s. Estimated remaining: 2h 35m 5s. Rate: 9.5 symbols/min [2025-09-14T18:12:49.900456] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:12:49.905049] [DEBUG] [LOCAL ] GDO: Loaded 2747 existing records from primary storage. [2025-09-14T18:12:49.905159] [INFO ] [MAIN ] GDO: Loaded 2747 existing records. [2025-09-14T18:12:50.082556] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:12:50.082871] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-09-14T18:12:50.082974] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-09-14T18:12:50.083277] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-09-14T18:12:50.083339] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-09-14T18:12:50.164016] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-09-14T18:12:50.467325] [INFO ] [REMOTE ] GDO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:12:50.734532] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-14T18:12:50.958856] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-09-14T18:12:51.273457] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-14T18:12:51.357115] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-14T18:12:51.758844] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-09-14T18:12:52.453310] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:12:52.458912] [INFO ] [REMOTE ] GDDY: Full fetch complete (54314 records). [2025-09-14T18:12:52.459118] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-09-14T18:12:52.560856] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-09-14T18:12:52.846802] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-09-14T18:12:52.846943] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-09-14T18:12:52.847768] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-09-14T18:12:52.847827] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-09-14T18:12:52.849183] [DEBUG] [LOCAL ] GDDY: Trimmed 54314 records to 37225 (keeping 150 days of data) [2025-09-14T18:12:52.962550] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-14T18:12:53.102298] [DEBUG] [LOCAL ] GDDY: Primary data saved (37225 records). [2025-09-14T18:12:53.102487] [INFO ] [MAIN ] GDDY: Full history saved. [2025-09-14T18:12:53.102626] [INFO ] [MAIN ] Update Progress: 905/2370 symbols completed. GDDY took 27.7s. Estimated remaining: 2h 34m 54s. Rate: 9.5 symbols/min [2025-09-14T18:12:53.275907] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:12:53.293129] [DEBUG] [LOCAL ] GDOT: Loaded 16898 existing records from primary storage. [2025-09-14T18:12:53.293333] [INFO ] [MAIN ] GDOT: Loaded 16898 existing records. [2025-09-14T18:12:53.363948] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-09-14T18:12:53.484023] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:12:53.484293] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-09-14T18:12:53.484356] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-09-14T18:12:53.484875] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-09-14T18:12:53.484938] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-09-14T18:12:53.841481] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:12:54.032216] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-14T18:12:54.158796] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-09-14T18:12:54.958832] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-09-14T18:12:55.459374] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-14T18:12:55.476501] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-14T18:12:55.758816] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-09-14T18:12:56.558848] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-09-14T18:12:57.256028] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-14T18:12:57.358807] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-09-14T18:12:57.417992] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-14T18:12:57.823511] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-14T18:12:57.824554] [INFO ] [REMOTE ] GDIV: Full fetch complete (4192 records). [2025-09-14T18:12:57.824679] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-09-14T18:12:58.161859] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-09-14T18:12:58.186354] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-09-14T18:12:58.186471] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-09-14T18:12:58.186688] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-09-14T18:12:58.186764] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-09-14T18:12:58.187163] [DEBUG] [LOCAL ] GDIV: Trimmed 4192 records to 2692 (keeping 150 days of data) [2025-09-14T18:12:58.205178] [DEBUG] [LOCAL ] GDIV: Primary data saved (2692 records). [2025-09-14T18:12:58.205298] [INFO ] [MAIN ] GDIV: Full history saved. [2025-09-14T18:12:58.205403] [INFO ] [MAIN ] Update Progress: 906/2370 symbols completed. GDIV took 21.7s. Estimated remaining: 2h 34m 46s. Rate: 9.5 symbols/min [2025-09-14T18:12:58.381597] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:12:58.392278] [DEBUG] [LOCAL ] GDV: Loaded 8513 existing records from primary storage. [2025-09-14T18:12:58.392498] [INFO ] [MAIN ] GDV: Loaded 8513 existing records. [2025-09-14T18:12:58.582585] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:12:58.586199] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-14T18:12:58.586480] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-09-14T18:12:58.587800] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-09-14T18:12:58.588160] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-09-14T18:12:58.588231] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-09-14T18:12:58.938239] [INFO ] [REMOTE ] GDV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:12:58.958784] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-09-14T18:12:59.758852] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-09-14T18:13:00.414466] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T18:13:00.434361] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-14T18:13:00.558829] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-09-14T18:13:01.358899] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-09-14T18:13:02.158839] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-09-14T18:13:02.418004] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T18:13:02.511414] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-14T18:13:02.644335] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-14T18:13:02.958886] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-09-14T18:13:03.309397] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-14T18:13:03.758852] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-09-14T18:13:04.293012] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-14T18:13:04.558840] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-09-14T18:13:05.358788] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-09-14T18:13:05.521257] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-14T18:13:06.008028] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-14T18:13:06.158894] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-09-14T18:13:06.832950] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-14T18:13:06.958879] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-09-14T18:13:07.561799] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-14T18:13:07.758839] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-09-14T18:13:08.225293] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-14T18:13:08.558826] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-09-14T18:13:09.273363] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-14T18:13:09.358830] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-09-14T18:13:10.158808] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-09-14T18:13:10.574662] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-14T18:13:10.958918] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-09-14T18:13:11.714074] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-14T18:13:11.731926] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-14T18:13:11.758782] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-09-14T18:13:12.282287] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T18:13:12.283535] [INFO ] [REMOTE ] GDO: Full fetch complete (6448 records). [2025-09-14T18:13:12.283620] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-09-14T18:13:12.560358] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-09-14T18:13:12.638670] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-09-14T18:13:12.638785] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-09-14T18:13:12.638987] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-09-14T18:13:12.639041] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-09-14T18:13:12.639468] [DEBUG] [LOCAL ] GDO: Trimmed 6448 records to 4390 (keeping 150 days of data) [2025-09-14T18:13:12.668298] [DEBUG] [LOCAL ] GDO: Primary data saved (4390 records). [2025-09-14T18:13:12.668419] [INFO ] [MAIN ] GDO: Full history saved. [2025-09-14T18:13:12.668530] [INFO ] [MAIN ] Update Progress: 907/2370 symbols completed. GDO took 22.9s. Estimated remaining: 2h 34m 53s. Rate: 9.4 symbols/min [2025-09-14T18:13:12.836856] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:13:12.861036] [DEBUG] [LOCAL ] GE: Loaded 24084 existing records from primary storage. [2025-09-14T18:13:12.861231] [INFO ] [MAIN ] GE: Loaded 24084 existing records. [2025-09-14T18:13:13.035247] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:13:13.035573] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-09-14T18:13:13.035658] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-09-14T18:13:13.036328] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-09-14T18:13:13.036391] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-09-14T18:13:13.365257] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-09-14T18:13:13.395574] [INFO ] [REMOTE ] GE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:13:13.719469] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T18:13:13.933852] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T18:13:13.934905] [INFO ] [REMOTE ] GDL: Full fetch complete (2536 records). [2025-09-14T18:13:13.934992] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-09-14T18:13:14.164010] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-09-14T18:13:14.285025] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-09-14T18:13:14.285149] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-09-14T18:13:14.285289] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-09-14T18:13:14.285343] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-09-14T18:13:14.285832] [DEBUG] [LOCAL ] GDL: Trimmed 2536 records to 1759 (keeping 150 days of data) [2025-09-14T18:13:14.297333] [DEBUG] [LOCAL ] GDL: Primary data saved (1759 records). [2025-09-14T18:13:14.297544] [INFO ] [MAIN ] GDL: Full history saved. [2025-09-14T18:13:14.297683] [INFO ] [MAIN ] Update Progress: 908/2370 symbols completed. GDL took 28.5s. Estimated remaining: 2h 34m 39s. Rate: 9.5 symbols/min [2025-09-14T18:13:14.465800] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:13:14.477047] [DEBUG] [LOCAL ] GEF: Loaded 10019 existing records from primary storage. [2025-09-14T18:13:14.477246] [INFO ] [MAIN ] GEF: Loaded 10019 existing records. [2025-09-14T18:13:14.653003] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:13:14.653298] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-09-14T18:13:14.653380] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-09-14T18:13:14.653772] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-09-14T18:13:14.653835] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-09-14T18:13:14.967113] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-09-14T18:13:15.004394] [INFO ] [REMOTE ] GEF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:13:15.758833] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-09-14T18:13:15.911074] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-14T18:13:16.558819] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-09-14T18:13:16.674871] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-14T18:13:17.062925] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-14T18:13:17.358930] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-09-14T18:13:17.775204] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T18:13:18.158927] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-09-14T18:13:18.958807] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-09-14T18:13:19.067290] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-14T18:13:19.615729] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-14T18:13:19.758846] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-09-14T18:13:20.559110] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-09-14T18:13:20.560127] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-14T18:13:20.588114] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-14T18:13:21.358861] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-09-14T18:13:21.643952] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-14T18:13:22.158800] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-09-14T18:13:22.537027] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-14T18:13:22.958831] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-09-14T18:13:23.609174] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:13:23.613843] [INFO ] [REMOTE ] GDOT: Full fetch complete (41164 records). [2025-09-14T18:13:23.614041] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-09-14T18:13:23.763915] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-09-14T18:13:23.989590] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-09-14T18:13:23.989728] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-09-14T18:13:23.990413] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-09-14T18:13:23.990479] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-09-14T18:13:23.991464] [DEBUG] [LOCAL ] GDOT: Trimmed 41164 records to 27838 (keeping 150 days of data) [2025-09-14T18:13:24.170482] [DEBUG] [LOCAL ] GDOT: Primary data saved (27838 records). [2025-09-14T18:13:24.170690] [INFO ] [MAIN ] GDOT: Full history saved. [2025-09-14T18:13:24.170834] [INFO ] [MAIN ] Update Progress: 909/2370 symbols completed. GDOT took 31.1s. Estimated remaining: 2h 34m 38s. Rate: 9.4 symbols/min [2025-09-14T18:13:24.342939] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:13:24.360271] [DEBUG] [LOCAL ] GEL: Loaded 15870 existing records from primary storage. [2025-09-14T18:13:24.360461] [INFO ] [MAIN ] GEL: Loaded 15870 existing records. [2025-09-14T18:13:24.544406] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:13:24.544966] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-09-14T18:13:24.545033] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-09-14T18:13:24.545573] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-09-14T18:13:24.545676] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-09-14T18:13:24.566408] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-09-14T18:13:24.838654] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-14T18:13:24.938330] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-14T18:13:24.957923] [INFO ] [REMOTE ] GEL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:13:24.960258] [INFO ] [REMOTE ] GDV: Full fetch complete (21844 records). [2025-09-14T18:13:24.960363] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-09-14T18:13:25.320730] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-09-14T18:13:25.320856] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-09-14T18:13:25.321370] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-09-14T18:13:25.321425] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-09-14T18:13:25.322199] [DEBUG] [LOCAL ] GDV: Trimmed 21844 records to 14594 (keeping 150 days of data) [2025-09-14T18:13:25.369701] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-09-14T18:13:25.414298] [DEBUG] [LOCAL ] GDV: Primary data saved (14594 records). [2025-09-14T18:13:25.414444] [INFO ] [MAIN ] GDV: Full history saved. [2025-09-14T18:13:25.414557] [INFO ] [MAIN ] Update Progress: 910/2370 symbols completed. GDV took 27.2s. Estimated remaining: 2h 34m 23s. Rate: 9.5 symbols/min [2025-09-14T18:13:25.584211] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:13:25.594155] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T18:13:25.618346] [DEBUG] [LOCAL ] GENI: Loaded 23670 existing records from primary storage. [2025-09-14T18:13:25.618532] [INFO ] [MAIN ] GENI: Loaded 23670 existing records. [2025-09-14T18:13:25.792200] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:13:25.792490] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-09-14T18:13:25.792551] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-09-14T18:13:25.793250] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-09-14T18:13:25.793316] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-09-14T18:13:26.148262] [INFO ] [REMOTE ] GENI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:13:26.158784] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-09-14T18:13:26.743789] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-14T18:13:26.958894] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-09-14T18:13:27.758832] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-09-14T18:13:27.868577] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T18:13:28.558943] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-09-14T18:13:28.611172] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-14T18:13:29.358900] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-09-14T18:13:29.844223] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T18:13:29.892916] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-14T18:13:30.158886] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-09-14T18:13:30.729954] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-14T18:13:30.958832] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-09-14T18:13:31.224224] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-14T18:13:31.758830] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-09-14T18:13:32.558886] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-09-14T18:13:32.850585] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-14T18:13:33.358830] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-09-14T18:13:33.586182] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T18:13:33.636401] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-14T18:13:34.158828] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-09-14T18:13:34.958901] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-09-14T18:13:35.525178] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-14T18:13:35.758855] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-09-14T18:13:36.044360] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T18:13:36.537997] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-14T18:13:36.558787] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-09-14T18:13:36.873860] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T18:13:37.358877] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-09-14T18:13:37.718392] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T18:13:37.767103] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T18:13:37.769947] [INFO ] [REMOTE ] GEF: Full fetch complete (22101 records). [2025-09-14T18:13:37.770038] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-09-14T18:13:38.141431] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-09-14T18:13:38.141559] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-09-14T18:13:38.142273] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-09-14T18:13:38.142343] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-09-14T18:13:38.143726] [DEBUG] [LOCAL ] GEF: Trimmed 22101 records to 15434 (keeping 150 days of data) [2025-09-14T18:13:38.184085] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-09-14T18:13:38.240866] [DEBUG] [LOCAL ] GEF: Primary data saved (15434 records). [2025-09-14T18:13:38.241062] [INFO ] [MAIN ] GEF: Full history saved. [2025-09-14T18:13:38.241189] [INFO ] [MAIN ] Update Progress: 911/2370 symbols completed. GEF took 23.9s. Estimated remaining: 2h 34m 27s. Rate: 9.4 symbols/min [2025-09-14T18:13:38.416392] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:13:38.440294] [DEBUG] [LOCAL ] GEO: Loaded 23282 existing records from primary storage. [2025-09-14T18:13:38.440485] [INFO ] [MAIN ] GEO: Loaded 23282 existing records. [2025-09-14T18:13:38.613849] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:13:38.614143] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-09-14T18:13:38.614238] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-09-14T18:13:38.614841] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-09-14T18:13:38.614918] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-09-14T18:13:38.960807] [INFO ] [REMOTE ] GEO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:13:38.960988] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-09-14T18:13:39.758840] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-09-14T18:13:40.403607] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-14T18:13:40.531861] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T18:13:40.558872] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-09-14T18:13:41.363994] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-09-14T18:13:41.386592] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T18:13:41.741248] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-14T18:13:41.746608] [INFO ] [REMOTE ] GEL: Full fetch complete (37971 records). [2025-09-14T18:13:41.746866] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-09-14T18:13:42.197041] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-09-14T18:13:42.225016] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-14T18:13:42.223832] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-09-14T18:13:42.231693] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-09-14T18:13:42.233473] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-09-14T18:13:42.234015] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-09-14T18:13:42.235145] [INFO ] [REMOTE ] GE: Full fetch complete (58390 records). [2025-09-14T18:13:42.235528] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-09-14T18:13:42.235626] [DEBUG] [LOCAL ] GEL: Trimmed 37971 records to 25309 (keeping 150 days of data) [2025-09-14T18:13:42.778273] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-09-14T18:13:42.779577] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-09-14T18:13:42.782460] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-09-14T18:13:42.783228] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-09-14T18:13:42.791758] [DEBUG] [LOCAL ] GE: Trimmed 58390 records to 40461 (keeping 150 days of data) [2025-09-14T18:13:42.944441] [DEBUG] [LOCAL ] GEL: Primary data saved (25309 records). [2025-09-14T18:13:42.945969] [INFO ] [MAIN ] GEL: Full history saved. [2025-09-14T18:13:42.946938] [INFO ] [MAIN ] Update Progress: 912/2370 symbols completed. GEL took 18.8s. Estimated remaining: 2h 34m 18s. Rate: 9.4 symbols/min [2025-09-14T18:13:42.961056] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-09-14T18:13:43.142895] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:13:43.172358] [DEBUG] [LOCAL ] GES: Loaded 16479 existing records from primary storage. [2025-09-14T18:13:43.172601] [INFO ] [MAIN ] GES: Loaded 16479 existing records. [2025-09-14T18:13:43.457462] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:13:43.460449] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-09-14T18:13:43.462373] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-09-14T18:13:43.463899] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-09-14T18:13:43.464671] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-09-14T18:13:43.855225] [INFO ] [REMOTE ] GES: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:13:43.863297] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-09-14T18:13:43.865060] [DEBUG] [LOCAL ] GE: Primary data saved (40461 records). [2025-09-14T18:13:43.865294] [INFO ] [MAIN ] GE: Full history saved. [2025-09-14T18:13:43.865439] [INFO ] [MAIN ] Update Progress: 913/2370 symbols completed. GE took 31.2s. Estimated remaining: 2h 34m 3s. Rate: 9.5 symbols/min [2025-09-14T18:13:44.048993] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:13:44.066903] [DEBUG] [LOCAL ] GETY: Loaded 15644 existing records from primary storage. [2025-09-14T18:13:44.067155] [INFO ] [MAIN ] GETY: Loaded 15644 existing records. [2025-09-14T18:13:44.250936] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:13:44.251377] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-09-14T18:13:44.251505] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-09-14T18:13:44.252167] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-09-14T18:13:44.252243] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-09-14T18:13:44.547064] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-14T18:13:44.628821] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-09-14T18:13:44.720521] [INFO ] [REMOTE ] GETY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:13:44.964706] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-14T18:13:45.291504] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T18:13:45.358872] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-09-14T18:13:46.158865] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-09-14T18:13:46.508144] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-14T18:13:46.958846] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-09-14T18:13:47.240705] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T18:13:47.766307] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-09-14T18:13:47.772741] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T18:13:48.558873] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-09-14T18:13:48.745722] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-14T18:13:49.291843] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-14T18:13:49.358866] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-09-14T18:13:50.060434] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-14T18:13:50.158836] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-09-14T18:13:50.903791] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-14T18:13:50.958827] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-09-14T18:13:51.758828] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-09-14T18:13:51.898363] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-14T18:13:52.561317] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-09-14T18:13:52.561225] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-14T18:13:53.278790] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-14T18:13:53.358863] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-09-14T18:13:54.158839] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-09-14T18:13:54.597998] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-14T18:13:54.842286] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-14T18:13:54.958879] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-09-14T18:13:55.359886] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T18:13:55.758889] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-09-14T18:13:56.558862] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-09-14T18:13:56.831161] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T18:13:57.335559] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T18:13:57.358785] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-09-14T18:13:58.101755] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T18:13:58.158840] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-09-14T18:13:58.836992] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-14T18:13:58.958867] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-09-14T18:13:59.474959] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T18:13:59.480880] [INFO ] [REMOTE ] GEO: Full fetch complete (56884 records). [2025-09-14T18:13:59.481056] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-09-14T18:13:59.763222] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-09-14T18:13:59.890226] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-09-14T18:13:59.890405] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-09-14T18:13:59.891509] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-09-14T18:13:59.891636] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-09-14T18:13:59.893174] [DEBUG] [LOCAL ] GEO: Trimmed 56884 records to 39206 (keeping 150 days of data) [2025-09-14T18:14:00.014388] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T18:14:00.187147] [DEBUG] [LOCAL ] GEO: Primary data saved (39206 records). [2025-09-14T18:14:00.187365] [INFO ] [MAIN ] GEO: Full history saved. [2025-09-14T18:14:00.187489] [INFO ] [MAIN ] Update Progress: 914/2370 symbols completed. GEO took 21.9s. Estimated remaining: 2h 34m 13s. Rate: 9.4 symbols/min [2025-09-14T18:14:00.364684] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:14:00.389335] [DEBUG] [LOCAL ] GEV: Loaded 23696 existing records from primary storage. [2025-09-14T18:14:00.389537] [INFO ] [MAIN ] GEV: Loaded 23696 existing records. [2025-09-14T18:14:00.560926] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-09-14T18:14:00.564239] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:14:00.565229] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-09-14T18:14:00.565297] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-09-14T18:14:00.566083] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-09-14T18:14:00.566217] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-09-14T18:14:00.918116] [INFO ] [REMOTE ] GEV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:14:01.358876] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-09-14T18:14:01.555284] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T18:14:02.034418] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:14:02.043329] [INFO ] [REMOTE ] GES: Full fetch complete (44588 records). [2025-09-14T18:14:02.048854] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-09-14T18:14:02.163905] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-09-14T18:14:02.471529] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-09-14T18:14:02.471734] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-09-14T18:14:02.472860] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-09-14T18:14:02.472996] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-09-14T18:14:02.474375] [DEBUG] [LOCAL ] GES: Trimmed 44588 records to 28871 (keeping 150 days of data) [2025-09-14T18:14:02.638383] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-14T18:14:02.647691] [INFO ] [REMOTE ] GENI: Full fetch complete (57201 records). [2025-09-14T18:14:02.651365] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-09-14T18:14:02.970822] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-09-14T18:14:03.404774] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-09-14T18:14:03.408906] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-09-14T18:14:03.410387] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-09-14T18:14:03.411188] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-09-14T18:14:03.419864] [DEBUG] [LOCAL ] GES: Primary data saved (28871 records). [2025-09-14T18:14:03.422901] [INFO ] [MAIN ] GES: Full history saved. [2025-09-14T18:14:03.423473] [INFO ] [MAIN ] Update Progress: 915/2370 symbols completed. GES took 20.5s. Estimated remaining: 2h 34m 2s. Rate: 9.4 symbols/min [2025-09-14T18:14:03.429767] [DEBUG] [LOCAL ] GENI: Trimmed 57201 records to 39790 (keeping 150 days of data) [2025-09-14T18:14:03.807740] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:14:03.816760] [DEBUG] [LOCAL ] GF: Loaded 928 existing records from primary storage. [2025-09-14T18:14:03.818866] [INFO ] [MAIN ] GF: Loaded 928 existing records. [2025-09-14T18:14:04.026084] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T18:14:04.024235] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:14:04.096754] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-09-14T18:14:04.123687] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-09-14T18:14:04.123869] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-09-14T18:14:04.125782] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-09-14T18:14:04.126480] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-09-14T18:14:04.513021] [INFO ] [REMOTE ] GF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:14:04.523222] [DEBUG] [LOCAL ] GENI: Primary data saved (39790 records). [2025-09-14T18:14:04.523364] [INFO ] [MAIN ] GENI: Full history saved. [2025-09-14T18:14:04.523473] [INFO ] [MAIN ] Update Progress: 916/2370 symbols completed. GENI took 39.1s. Estimated remaining: 2h 33m 47s. Rate: 9.5 symbols/min [2025-09-14T18:14:04.566283] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-09-14T18:14:04.695244] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:14:04.709834] [DEBUG] [LOCAL ] GFF: Loaded 12974 existing records from primary storage. [2025-09-14T18:14:04.710016] [INFO ] [MAIN ] GFF: Loaded 12974 existing records. [2025-09-14T18:14:04.884588] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:14:04.884880] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-09-14T18:14:04.884941] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-09-14T18:14:04.885477] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-09-14T18:14:04.885553] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-09-14T18:14:05.235610] [INFO ] [REMOTE ] GFF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:14:05.264362] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-14T18:14:05.358794] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-09-14T18:14:05.394535] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-14T18:14:05.683748] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T18:14:06.158923] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-09-14T18:14:06.323009] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-14T18:14:06.792010] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-14T18:14:06.958866] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-09-14T18:14:07.758845] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-09-14T18:14:08.307023] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-14T18:14:08.558888] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-09-14T18:14:09.104544] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-14T18:14:09.358830] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-09-14T18:14:09.963971] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-14T18:14:09.967922] [INFO ] [REMOTE ] GETY: Full fetch complete (40692 records). [2025-09-14T18:14:09.968034] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-09-14T18:14:10.169264] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-09-14T18:14:10.362047] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-09-14T18:14:10.362180] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-09-14T18:14:10.362896] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-09-14T18:14:10.362954] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-09-14T18:14:10.364057] [DEBUG] [LOCAL ] GETY: Trimmed 40692 records to 26329 (keeping 150 days of data) [2025-09-14T18:14:10.517717] [DEBUG] [LOCAL ] GETY: Primary data saved (26329 records). [2025-09-14T18:14:10.517900] [INFO ] [MAIN ] GETY: Full history saved. [2025-09-14T18:14:10.518002] [INFO ] [MAIN ] Update Progress: 917/2370 symbols completed. GETY took 26.7s. Estimated remaining: 2h 33m 40s. Rate: 9.5 symbols/min [2025-09-14T18:14:10.958934] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-09-14T18:14:10.984775] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T18:14:11.758861] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-09-14T18:14:11.850806] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-14T18:14:12.374321] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T18:14:12.539037] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-14T18:14:12.558800] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-09-14T18:14:12.959188] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-14T18:14:13.358845] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-09-14T18:14:13.865964] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-14T18:14:14.158865] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-09-14T18:14:14.546681] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T18:14:14.547585] [INFO ] [REMOTE ] GF: Full fetch complete (4015 records). [2025-09-14T18:14:14.547689] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-09-14T18:14:14.914219] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-09-14T18:14:14.914345] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-09-14T18:14:14.914520] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-09-14T18:14:14.914574] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-09-14T18:14:14.915019] [DEBUG] [LOCAL ] GF: Trimmed 4015 records to 2145 (keeping 150 days of data) [2025-09-14T18:14:14.929730] [DEBUG] [LOCAL ] GF: Primary data saved (2145 records). [2025-09-14T18:14:14.929920] [INFO ] [MAIN ] GF: Full history saved. [2025-09-14T18:14:14.930025] [INFO ] [MAIN ] Update Progress: 918/2370 symbols completed. GF took 11.5s. Estimated remaining: 2h 33m 31s. Rate: 9.5 symbols/min [2025-09-14T18:14:14.958842] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-09-14T18:14:15.758862] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-09-14T18:14:17.396844] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-14T18:14:17.405189] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-09-14T18:14:17.552733] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-09-14T18:14:17.564470] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-09-14T18:14:18.834252] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-14T18:14:18.842231] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-09-14T18:14:19.626034] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-14T18:14:19.637855] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-09-14T18:14:20.129272] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T18:14:20.135786] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-09-14T18:14:21.436912] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-14T18:14:21.443803] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-09-14T18:14:22.222865] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-14T18:14:22.234963] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-09-14T18:14:22.927248] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-14T18:14:22.934837] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-09-14T18:14:23.480599] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T18:14:23.484106] [INFO ] [REMOTE ] GFF: Full fetch complete (33948 records). [2025-09-14T18:14:23.484273] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-09-14T18:14:23.869876] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-09-14T18:14:23.869995] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-09-14T18:14:23.870615] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-09-14T18:14:23.870684] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-09-14T18:14:23.871502] [DEBUG] [LOCAL ] GFF: Trimmed 33948 records to 22815 (keeping 150 days of data) [2025-09-14T18:14:24.036970] [DEBUG] [LOCAL ] GFF: Primary data saved (22815 records). [2025-09-14T18:14:24.037143] [INFO ] [MAIN ] GFF: Full history saved. [2025-09-14T18:14:24.037242] [INFO ] [MAIN ] Update Progress: 919/2370 symbols completed. GFF took 19.5s. Estimated remaining: 2h 33m 29s. Rate: 9.5 symbols/min [2025-09-14T18:14:24.616295] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-14T18:14:24.627872] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-09-14T18:14:25.308216] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:14:25.313802] [INFO ] [REMOTE ] GEV: Full fetch complete (57828 records). [2025-09-14T18:14:25.313949] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-09-14T18:14:25.699464] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-09-14T18:14:25.699611] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-09-14T18:14:25.700561] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-09-14T18:14:25.700631] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-09-14T18:14:25.702080] [DEBUG] [LOCAL ] GEV: Trimmed 57828 records to 39972 (keeping 150 days of data) [2025-09-14T18:14:25.960875] [DEBUG] [LOCAL ] GEV: Primary data saved (39972 records). [2025-09-14T18:14:25.961063] [INFO ] [MAIN ] GEV: Full history saved. [2025-09-14T18:14:25.961162] [INFO ] [MAIN ] Update Progress: 920/2370 symbols completed. GEV took 25.8s. Estimated remaining: 2h 33m 15s. Rate: 9.5 symbols/min [2025-09-14T18:14:26.447293] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:14:26.640629] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:14:26.677354] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:14:26.672997] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:14:26.683273] [DEBUG] [LOCAL ] GFR: Loaded 2403 existing records from primary storage. [2025-09-14T18:14:26.683505] [INFO ] [MAIN ] GFR: Loaded 2403 existing records. [2025-09-14T18:14:26.826754] [DEBUG] [LOCAL ] GGB: Loaded 23072 existing records from primary storage. [2025-09-14T18:14:26.827658] [DEBUG] [LOCAL ] GFI: Loaded 23660 existing records from primary storage. [2025-09-14T18:14:26.877978] [INFO ] [MAIN ] GFI: Loaded 23660 existing records. [2025-09-14T18:14:26.854132] [DEBUG] [LOCAL ] GFL: Loaded 20702 existing records from primary storage. [2025-09-14T18:14:26.906040] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:14:26.878058] [INFO ] [MAIN ] GGB: Loaded 23072 existing records. [2025-09-14T18:14:26.917427] [INFO ] [MAIN ] GFL: Loaded 20702 existing records. [2025-09-14T18:14:26.917520] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-09-14T18:14:27.005040] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-09-14T18:14:27.133524] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-09-14T18:14:27.229166] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-09-14T18:14:27.388877] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:14:27.632264] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:14:27.714472] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:14:27.733760] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-09-14T18:14:27.743352] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-09-14T18:14:27.752018] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-09-14T18:14:27.768904] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-09-14T18:14:27.751850] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-09-14T18:14:27.815487] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-09-14T18:14:27.821411] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-09-14T18:14:27.826762] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-09-14T18:14:27.826857] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-09-14T18:14:27.845487] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-09-14T18:14:27.845604] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-09-14T18:14:27.845752] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-09-14T18:14:28.183927] [INFO ] [REMOTE ] GFR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:14:28.271636] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-09-14T18:14:28.981457] [INFO ] [REMOTE ] GFL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:14:29.037599] [INFO ] [REMOTE ] GFI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:14:29.062389] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-09-14T18:14:29.062670] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-09-14T18:14:29.082866] [INFO ] [REMOTE ] GGB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:14:29.084748] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-09-14T18:14:29.202186] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-14T18:14:29.205728] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-09-14T18:14:30.144697] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-14T18:14:30.148358] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-09-14T18:14:30.749979] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T18:14:30.760949] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-09-14T18:14:30.803266] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T18:14:30.824500] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-09-14T18:14:30.828021] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-14T18:14:30.832093] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-09-14T18:14:31.056401] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-14T18:14:31.067345] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-09-14T18:14:31.639692] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-14T18:14:31.758967] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-09-14T18:14:32.373979] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T18:14:32.432384] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T18:14:32.558869] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-09-14T18:14:32.730800] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T18:14:32.899738] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T18:14:33.358857] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-09-14T18:14:34.033745] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-14T18:14:34.158799] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-09-14T18:14:34.370800] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T18:14:34.743527] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-14T18:14:34.958851] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-09-14T18:14:35.758831] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-09-14T18:14:36.333204] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T18:14:36.334394] [INFO ] [REMOTE ] GFR: Full fetch complete (9156 records). [2025-09-14T18:14:36.334507] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-09-14T18:14:36.564022] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-09-14T18:14:36.702913] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-09-14T18:14:36.703032] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-09-14T18:14:36.703304] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-09-14T18:14:36.703358] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-09-14T18:14:36.703850] [DEBUG] [LOCAL ] GFR: Trimmed 9156 records to 5201 (keeping 150 days of data) [2025-09-14T18:14:36.732323] [DEBUG] [LOCAL ] GFR: Primary data saved (5201 records). [2025-09-14T18:14:36.732456] [INFO ] [MAIN ] GFR: Full history saved. [2025-09-14T18:14:36.732555] [INFO ] [MAIN ] Update Progress: 921/2370 symbols completed. GFR took 10.8s. Estimated remaining: 2h 33m 16s. Rate: 9.5 symbols/min [2025-09-14T18:14:36.903326] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:14:36.920853] [DEBUG] [LOCAL ] GGG: Loaded 17558 existing records from primary storage. [2025-09-14T18:14:36.921024] [INFO ] [MAIN ] GGG: Loaded 17558 existing records. [2025-09-14T18:14:37.108912] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:14:37.109317] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-09-14T18:14:37.109448] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-09-14T18:14:37.110127] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-09-14T18:14:37.110196] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-09-14T18:14:37.360662] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-09-14T18:14:37.485967] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-14T18:14:37.535996] [INFO ] [REMOTE ] GGG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:14:38.158848] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-09-14T18:14:38.537492] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-14T18:14:38.958887] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-09-14T18:14:39.173322] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T18:14:39.261924] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T18:14:39.758831] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-09-14T18:14:40.558875] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-09-14T18:14:40.838687] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-14T18:14:41.031386] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T18:14:41.358863] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-09-14T18:14:42.158822] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-09-14T18:14:42.471291] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T18:14:42.956907] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T18:14:42.966482] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-09-14T18:14:43.758800] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-09-14T18:14:43.860682] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T18:14:44.558847] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-09-14T18:14:44.690147] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T18:14:45.358795] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-09-14T18:14:45.751192] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-14T18:14:46.132508] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T18:14:46.158779] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-09-14T18:14:46.919798] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T18:14:46.958801] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-09-14T18:14:47.528732] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-14T18:14:47.758842] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-09-14T18:14:48.558843] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-09-14T18:14:48.598688] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-14T18:14:48.603879] [INFO ] [REMOTE ] GGB: Full fetch complete (55417 records). [2025-09-14T18:14:48.603998] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-09-14T18:14:48.992538] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-09-14T18:14:48.992686] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-09-14T18:14:48.993471] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-09-14T18:14:48.993525] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-09-14T18:14:48.994804] [DEBUG] [LOCAL ] GGB: Trimmed 55417 records to 38585 (keeping 150 days of data) [2025-09-14T18:14:49.241182] [DEBUG] [LOCAL ] GGB: Primary data saved (38585 records). [2025-09-14T18:14:49.241373] [INFO ] [MAIN ] GGB: Full history saved. [2025-09-14T18:14:49.241483] [INFO ] [MAIN ] Update Progress: 922/2370 symbols completed. GGB took 23.3s. Estimated remaining: 2h 33m 19s. Rate: 9.4 symbols/min [2025-09-14T18:14:49.363942] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-09-14T18:14:49.427744] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:14:49.437000] [DEBUG] [LOCAL ] GGT: Loaded 6258 existing records from primary storage. [2025-09-14T18:14:49.437175] [INFO ] [MAIN ] GGT: Loaded 6258 existing records. [2025-09-14T18:14:49.618616] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:14:49.619628] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-09-14T18:14:49.619711] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-09-14T18:14:49.620397] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-09-14T18:14:49.620458] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-09-14T18:14:49.997771] [INFO ] [REMOTE ] GGT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:14:50.029270] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-14T18:14:50.158825] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-09-14T18:14:50.289651] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T18:14:50.651783] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-14T18:14:50.958826] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-09-14T18:14:51.758855] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-09-14T18:14:52.312936] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-14T18:14:52.453876] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-14T18:14:52.458834] [INFO ] [REMOTE ] GFL: Full fetch complete (52375 records). [2025-09-14T18:14:52.458953] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-09-14T18:14:52.558971] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-09-14T18:14:52.617575] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T18:14:52.847423] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-09-14T18:14:52.847539] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-09-14T18:14:52.848342] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-09-14T18:14:52.848401] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-09-14T18:14:52.849503] [DEBUG] [LOCAL ] GFL: Trimmed 52375 records to 35480 (keeping 150 days of data) [2025-09-14T18:14:53.121486] [DEBUG] [LOCAL ] GFL: Primary data saved (35480 records). [2025-09-14T18:14:53.121738] [INFO ] [MAIN ] GFL: Full history saved. [2025-09-14T18:14:53.121924] [INFO ] [MAIN ] Update Progress: 923/2370 symbols completed. GFL took 27.2s. Estimated remaining: 2h 33m 9s. Rate: 9.4 symbols/min [2025-09-14T18:14:53.313337] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:14:53.317192] [DEBUG] [LOCAL ] GGZ: Loaded 959 existing records from primary storage. [2025-09-14T18:14:53.317310] [INFO ] [MAIN ] GGZ: Loaded 959 existing records. [2025-09-14T18:14:53.364016] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-09-14T18:14:53.517837] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:14:53.518182] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-09-14T18:14:53.518264] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-09-14T18:14:53.518636] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-09-14T18:14:53.518753] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-09-14T18:14:53.930022] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:14:54.158816] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-09-14T18:14:54.237920] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-14T18:14:54.492205] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-14T18:14:54.958909] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-09-14T18:14:55.308828] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-14T18:14:55.314827] [INFO ] [REMOTE ] GFI: Full fetch complete (57717 records). [2025-09-14T18:14:55.314983] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-09-14T18:14:55.725142] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-09-14T18:14:55.725283] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-09-14T18:14:55.726352] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-09-14T18:14:55.726432] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-09-14T18:14:55.727963] [DEBUG] [LOCAL ] GFI: Trimmed 57717 records to 39887 (keeping 150 days of data) [2025-09-14T18:14:55.785188] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-09-14T18:14:55.994414] [DEBUG] [LOCAL ] GFI: Primary data saved (39887 records). [2025-09-14T18:14:55.994617] [INFO ] [MAIN ] GFI: Full history saved. [2025-09-14T18:14:55.994762] [INFO ] [MAIN ] Update Progress: 924/2370 symbols completed. GFI took 30.0s. Estimated remaining: 2h 32m 57s. Rate: 9.5 symbols/min [2025-09-14T18:14:56.162889] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:14:56.166282] [DEBUG] [LOCAL ] GHC: Loaded 1325 existing records from primary storage. [2025-09-14T18:14:56.166381] [INFO ] [MAIN ] GHC: Loaded 1325 existing records. [2025-09-14T18:14:56.345659] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:14:56.346101] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-09-14T18:14:56.346235] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-09-14T18:14:56.346522] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-09-14T18:14:56.346582] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-09-14T18:14:56.582379] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-09-14T18:14:56.649299] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T18:14:56.667672] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T18:14:56.811758] [INFO ] [REMOTE ] GHC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:14:57.152606] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-14T18:14:57.358893] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-09-14T18:14:58.007349] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-14T18:14:58.158883] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-09-14T18:14:58.958883] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-09-14T18:14:59.049313] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-14T18:14:59.758912] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-09-14T18:15:00.349137] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T18:15:00.558913] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-09-14T18:15:00.953087] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-14T18:15:01.358887] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-09-14T18:15:01.532117] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-14T18:15:01.536264] [INFO ] [REMOTE ] GGG: Full fetch complete (44546 records). [2025-09-14T18:15:01.536419] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-09-14T18:15:01.996240] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-09-14T18:15:01.996385] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-09-14T18:15:01.997303] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-09-14T18:15:01.997369] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-09-14T18:15:01.998755] [DEBUG] [LOCAL ] GGG: Trimmed 44546 records to 30224 (keeping 150 days of data) [2025-09-14T18:15:02.168981] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-09-14T18:15:02.208340] [DEBUG] [LOCAL ] GGG: Primary data saved (30224 records). [2025-09-14T18:15:02.208789] [INFO ] [MAIN ] GGG: Full history saved. [2025-09-14T18:15:02.208927] [INFO ] [MAIN ] Update Progress: 925/2370 symbols completed. GGG took 25.5s. Estimated remaining: 2h 32m 51s. Rate: 9.5 symbols/min [2025-09-14T18:15:02.383703] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:15:02.387324] [DEBUG] [LOCAL ] GHG: Loaded 1297 existing records from primary storage. [2025-09-14T18:15:02.387493] [INFO ] [MAIN ] GHG: Loaded 1297 existing records. [2025-09-14T18:15:02.570268] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:15:02.570575] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-09-14T18:15:02.570637] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-14T18:15:02.570891] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-09-14T18:15:02.570951] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-09-14T18:15:02.932583] [INFO ] [REMOTE ] GHG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:15:02.958819] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-09-14T18:15:02.971269] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T18:15:03.758896] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-09-14T18:15:04.558895] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-09-14T18:15:04.917105] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T18:15:05.203200] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (3.03 seconds). [2025-09-14T18:15:05.269064] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-14T18:15:05.314464] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-14T18:15:05.358812] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-09-14T18:15:05.859214] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-14T18:15:06.158871] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-09-14T18:15:06.593398] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-14T18:15:06.958840] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-09-14T18:15:07.758881] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-09-14T18:15:07.812865] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-14T18:15:08.418407] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-14T18:15:08.558886] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-09-14T18:15:09.092672] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-14T18:15:09.358826] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-09-14T18:15:10.158824] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-09-14T18:15:10.303944] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-14T18:15:10.541331] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-14T18:15:10.958856] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-09-14T18:15:11.538101] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-14T18:15:11.758855] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-09-14T18:15:12.438033] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-14T18:15:12.558845] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-09-14T18:15:13.165432] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-14T18:15:13.358899] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-09-14T18:15:14.158887] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-09-14T18:15:14.593660] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-14T18:15:14.595946] [INFO ] [REMOTE ] GGT: Full fetch complete (14853 records). [2025-09-14T18:15:14.596052] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-09-14T18:15:14.964004] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-09-14T18:15:15.004244] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-09-14T18:15:15.004379] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-09-14T18:15:15.004823] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-09-14T18:15:15.004892] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-09-14T18:15:15.005943] [DEBUG] [LOCAL ] GGT: Trimmed 14853 records to 11004 (keeping 150 days of data) [2025-09-14T18:15:15.080407] [DEBUG] [LOCAL ] GGT: Primary data saved (11004 records). [2025-09-14T18:15:15.080658] [INFO ] [MAIN ] GGT: Full history saved. [2025-09-14T18:15:15.080803] [INFO ] [MAIN ] Update Progress: 926/2370 symbols completed. GGT took 25.8s. Estimated remaining: 2h 32m 55s. Rate: 9.4 symbols/min [2025-09-14T18:15:15.254065] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:15:15.259893] [DEBUG] [LOCAL ] GHI: Loaded 3414 existing records from primary storage. [2025-09-14T18:15:15.260066] [INFO ] [MAIN ] GHI: Loaded 3414 existing records. [2025-09-14T18:15:15.436922] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:15:15.437275] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-09-14T18:15:15.437358] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-09-14T18:15:15.437763] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-09-14T18:15:15.437841] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-09-14T18:15:15.764188] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-09-14T18:15:15.819616] [INFO ] [REMOTE ] GHI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:15:15.821859] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T18:15:15.952293] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T18:15:16.558905] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-09-14T18:15:16.565450] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T18:15:16.566710] [INFO ] [REMOTE ] GGZ: Full fetch complete (2730 records). [2025-09-14T18:15:16.566836] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-09-14T18:15:17.036719] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-09-14T18:15:17.036851] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-09-14T18:15:17.037007] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-09-14T18:15:17.037060] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-09-14T18:15:17.037489] [DEBUG] [LOCAL ] GGZ: Trimmed 2730 records to 1716 (keeping 150 days of data) [2025-09-14T18:15:17.048673] [DEBUG] [LOCAL ] GGZ: Primary data saved (1716 records). [2025-09-14T18:15:17.048764] [INFO ] [MAIN ] GGZ: Full history saved. [2025-09-14T18:15:17.048874] [INFO ] [MAIN ] Update Progress: 927/2370 symbols completed. GGZ took 23.9s. Estimated remaining: 2h 32m 41s. Rate: 9.5 symbols/min [2025-09-14T18:15:17.233722] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:15:17.238031] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-14T18:15:17.244424] [DEBUG] [LOCAL ] GHLD: Loaded 2795 existing records from primary storage. [2025-09-14T18:15:17.244668] [INFO ] [MAIN ] GHLD: Loaded 2795 existing records. [2025-09-14T18:15:17.363910] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-09-14T18:15:17.468245] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:15:17.468595] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-09-14T18:15:17.468677] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-09-14T18:15:17.468969] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-09-14T18:15:17.469033] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-09-14T18:15:17.842719] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:15:18.158879] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-09-14T18:15:18.220959] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T18:15:18.541004] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-14T18:15:18.958898] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-09-14T18:15:19.608603] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-14T18:15:19.758853] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-09-14T18:15:20.440770] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-14T18:15:20.558844] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-09-14T18:15:21.334047] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-14T18:15:21.358808] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-09-14T18:15:22.149422] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-14T18:15:22.158771] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-09-14T18:15:22.671154] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-14T18:15:22.958866] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-09-14T18:15:23.700879] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-14T18:15:23.758838] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-09-14T18:15:24.066669] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T18:15:24.067563] [INFO ] [REMOTE ] GHC: Full fetch complete (2680 records). [2025-09-14T18:15:24.067665] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-09-14T18:15:24.424072] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-09-14T18:15:24.424222] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-09-14T18:15:24.424396] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-09-14T18:15:24.424470] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-09-14T18:15:24.425092] [DEBUG] [LOCAL ] GHC: Trimmed 2680 records to 2078 (keeping 150 days of data) [2025-09-14T18:15:24.439579] [DEBUG] [LOCAL ] GHC: Primary data saved (2078 records). [2025-09-14T18:15:24.439790] [INFO ] [MAIN ] GHC: Full history saved. [2025-09-14T18:15:24.439929] [INFO ] [MAIN ] Update Progress: 928/2370 symbols completed. GHC took 28.4s. Estimated remaining: 2h 32m 37s. Rate: 9.4 symbols/min [2025-09-14T18:15:24.563990] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-09-14T18:15:24.624508] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:15:24.633848] [DEBUG] [LOCAL ] GHM: Loaded 6887 existing records from primary storage. [2025-09-14T18:15:24.634027] [INFO ] [MAIN ] GHM: Loaded 6887 existing records. [2025-09-14T18:15:24.807586] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:15:24.807904] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-09-14T18:15:24.807964] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-09-14T18:15:24.808288] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-09-14T18:15:24.808350] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-09-14T18:15:25.162106] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-14T18:15:25.161991] [INFO ] [REMOTE ] GHM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:15:25.358817] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-09-14T18:15:26.158884] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-09-14T18:15:26.658956] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-14T18:15:26.958869] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-09-14T18:15:27.548682] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-14T18:15:27.555175] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-14T18:15:27.758841] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-09-14T18:15:28.558844] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-09-14T18:15:28.768180] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-14T18:15:29.115757] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T18:15:29.117814] [INFO ] [REMOTE ] GHG: Full fetch complete (3344 records). [2025-09-14T18:15:29.118135] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-09-14T18:15:29.364034] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-09-14T18:15:29.484052] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-09-14T18:15:29.484189] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-09-14T18:15:29.484368] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-09-14T18:15:29.484423] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-09-14T18:15:29.484818] [DEBUG] [LOCAL ] GHG: Trimmed 3344 records to 2514 (keeping 150 days of data) [2025-09-14T18:15:29.499916] [DEBUG] [LOCAL ] GHG: Primary data saved (2514 records). [2025-09-14T18:15:29.500059] [INFO ] [MAIN ] GHG: Full history saved. [2025-09-14T18:15:29.500172] [INFO ] [MAIN ] Update Progress: 929/2370 symbols completed. GHG took 27.3s. Estimated remaining: 2h 32m 28s. Rate: 9.5 symbols/min [2025-09-14T18:15:29.670504] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:15:29.681495] [DEBUG] [LOCAL ] GHY: Loaded 9224 existing records from primary storage. [2025-09-14T18:15:29.681681] [INFO ] [MAIN ] GHY: Loaded 9224 existing records. [2025-09-14T18:15:29.855164] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:15:29.855472] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-09-14T18:15:29.855557] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-09-14T18:15:29.855996] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-09-14T18:15:29.856058] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-09-14T18:15:30.164025] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-09-14T18:15:30.219380] [INFO ] [REMOTE ] GHY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:15:30.359002] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-14T18:15:30.710121] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-14T18:15:30.958832] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-09-14T18:15:31.758887] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-09-14T18:15:31.868616] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-14T18:15:32.558904] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-09-14T18:15:32.585997] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-14T18:15:33.128774] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-14T18:15:33.358842] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-09-14T18:15:34.158851] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-09-14T18:15:34.411610] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T18:15:34.958893] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-09-14T18:15:35.017951] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-14T18:15:35.758905] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-09-14T18:15:36.059187] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-14T18:15:36.413698] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-14T18:15:36.558842] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-09-14T18:15:37.358873] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-09-14T18:15:37.511568] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-14T18:15:38.019619] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:15:38.020893] [INFO ] [REMOTE ] GHI: Full fetch complete (7562 records). [2025-09-14T18:15:38.020976] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-09-14T18:15:38.164021] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-09-14T18:15:38.390438] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-09-14T18:15:38.390566] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-09-14T18:15:38.390815] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-09-14T18:15:38.390878] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-09-14T18:15:38.391400] [DEBUG] [LOCAL ] GHI: Trimmed 7562 records to 5287 (keeping 150 days of data) [2025-09-14T18:15:38.423621] [DEBUG] [LOCAL ] GHI: Primary data saved (5287 records). [2025-09-14T18:15:38.423769] [INFO ] [MAIN ] GHI: Full history saved. [2025-09-14T18:15:38.423881] [INFO ] [MAIN ] Update Progress: 930/2370 symbols completed. GHI took 23.3s. Estimated remaining: 2h 32m 26s. Rate: 9.4 symbols/min [2025-09-14T18:15:38.594000] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:15:38.611618] [DEBUG] [LOCAL ] GIB: Loaded 14392 existing records from primary storage. [2025-09-14T18:15:38.611830] [INFO ] [MAIN ] GIB: Loaded 14392 existing records. [2025-09-14T18:15:38.789406] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:15:38.789719] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-09-14T18:15:38.789781] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-09-14T18:15:38.790270] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-09-14T18:15:38.790341] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-09-14T18:15:38.966870] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-09-14T18:15:39.152667] [INFO ] [REMOTE ] GIB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:15:39.389711] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-14T18:15:39.748660] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-14T18:15:39.758773] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-09-14T18:15:40.318164] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T18:15:40.319387] [INFO ] [REMOTE ] GHLD: Full fetch complete (4015 records). [2025-09-14T18:15:40.319475] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-09-14T18:15:40.563999] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-09-14T18:15:40.677945] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-09-14T18:15:40.678072] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-09-14T18:15:40.678246] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-09-14T18:15:40.678298] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-09-14T18:15:40.678801] [DEBUG] [LOCAL ] GHLD: Trimmed 4015 records to 3308 (keeping 150 days of data) [2025-09-14T18:15:40.700129] [DEBUG] [LOCAL ] GHLD: Primary data saved (3308 records). [2025-09-14T18:15:40.700285] [INFO ] [MAIN ] GHLD: Full history saved. [2025-09-14T18:15:40.700386] [INFO ] [MAIN ] Update Progress: 931/2370 symbols completed. GHLD took 23.7s. Estimated remaining: 2h 32m 13s. Rate: 9.5 symbols/min [2025-09-14T18:15:40.875011] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:15:40.882906] [DEBUG] [LOCAL ] GIC: Loaded 6401 existing records from primary storage. [2025-09-14T18:15:40.883063] [INFO ] [MAIN ] GIC: Loaded 6401 existing records. [2025-09-14T18:15:41.064742] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:15:41.065047] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-09-14T18:15:41.065144] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-14T18:15:41.065563] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-09-14T18:15:41.065665] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-09-14T18:15:41.363913] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-09-14T18:15:41.421522] [INFO ] [REMOTE ] GIC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:15:42.071211] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T18:15:42.158805] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-09-14T18:15:42.534259] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-14T18:15:42.958826] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-09-14T18:15:43.730538] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-14T18:15:43.758776] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-09-14T18:15:43.983749] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T18:15:44.558875] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-09-14T18:15:45.349141] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T18:15:45.358763] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-09-14T18:15:45.773551] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T18:15:46.114204] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-14T18:15:46.158819] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-09-14T18:15:46.958803] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-09-14T18:15:47.264434] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-14T18:15:47.758864] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-09-14T18:15:47.967056] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-14T18:15:48.372071] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T18:15:48.373905] [INFO ] [REMOTE ] GHM: Full fetch complete (16356 records). [2025-09-14T18:15:48.374010] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-09-14T18:15:48.566689] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-09-14T18:15:48.756259] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-09-14T18:15:48.756378] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-09-14T18:15:48.756887] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-09-14T18:15:48.756951] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-09-14T18:15:48.758609] [DEBUG] [LOCAL ] GHM: Trimmed 16356 records to 10444 (keeping 150 days of data) [2025-09-14T18:15:48.827307] [DEBUG] [LOCAL ] GHM: Primary data saved (10444 records). [2025-09-14T18:15:48.827484] [INFO ] [MAIN ] GHM: Full history saved. [2025-09-14T18:15:48.827616] [INFO ] [MAIN ] Update Progress: 932/2370 symbols completed. GHM took 24.4s. Estimated remaining: 2h 32m 10s. Rate: 9.5 symbols/min [2025-09-14T18:15:48.997590] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:15:49.020772] [DEBUG] [LOCAL ] GIL: Loaded 19297 existing records from primary storage. [2025-09-14T18:15:49.020964] [INFO ] [MAIN ] GIL: Loaded 19297 existing records. [2025-09-14T18:15:49.194169] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:15:49.194449] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-09-14T18:15:49.194507] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-09-14T18:15:49.195185] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-09-14T18:15:49.195250] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-09-14T18:15:49.366309] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-09-14T18:15:49.551191] [INFO ] [REMOTE ] GIL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:15:49.683387] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-14T18:15:50.158870] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-09-14T18:15:50.862006] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T18:15:50.958810] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-09-14T18:15:51.717489] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T18:15:51.758799] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-09-14T18:15:51.932725] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T18:15:52.558886] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-09-14T18:15:53.349939] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T18:15:53.358856] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-09-14T18:15:53.767176] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T18:15:54.158844] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-09-14T18:15:54.846536] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-14T18:15:54.927757] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-14T18:15:54.958788] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-09-14T18:15:55.758871] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-09-14T18:15:55.798494] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-14T18:15:56.558878] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-09-14T18:15:56.898048] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-14T18:15:57.358881] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-09-14T18:15:57.458924] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-14T18:15:58.158819] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-09-14T18:15:58.832051] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T18:15:58.958858] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-09-14T18:15:59.758870] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-09-14T18:15:59.818951] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T18:15:59.990760] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-14T18:16:00.558886] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-09-14T18:16:01.121263] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T18:16:01.124872] [INFO ] [REMOTE ] GIB: Full fetch complete (35466 records). [2025-09-14T18:16:01.124976] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-09-14T18:16:01.363947] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-09-14T18:16:01.511969] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-09-14T18:16:01.512122] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-09-14T18:16:01.513204] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-09-14T18:16:01.513284] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-09-14T18:16:01.514370] [DEBUG] [LOCAL ] GIB: Trimmed 35466 records to 23149 (keeping 150 days of data) [2025-09-14T18:16:01.644408] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-14T18:16:01.648187] [INFO ] [REMOTE ] GIC: Full fetch complete (15189 records). [2025-09-14T18:16:01.648541] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-09-14T18:16:02.045586] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-09-14T18:16:02.045927] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-09-14T18:16:02.046393] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-09-14T18:16:02.046975] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-09-14T18:16:02.052746] [DEBUG] [LOCAL ] GIC: Trimmed 15189 records to 10183 (keeping 150 days of data) [2025-09-14T18:16:02.130381] [DEBUG] [LOCAL ] GIB: Primary data saved (23149 records). [2025-09-14T18:16:02.131338] [INFO ] [MAIN ] GIB: Full history saved. [2025-09-14T18:16:02.131498] [INFO ] [MAIN ] Update Progress: 933/2370 symbols completed. GIB took 23.7s. Estimated remaining: 2h 32m 14s. Rate: 9.4 symbols/min [2025-09-14T18:16:02.163680] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-09-14T18:16:02.290591] [DEBUG] [LOCAL ] GIC: Primary data saved (10183 records). [2025-09-14T18:16:02.321035] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:16:02.321126] [INFO ] [MAIN ] GIC: Full history saved. [2025-09-14T18:16:02.321337] [INFO ] [MAIN ] Update Progress: 934/2370 symbols completed. GIC took 21.6s. Estimated remaining: 2h 31m 58s. Rate: 9.4 symbols/min [2025-09-14T18:16:02.501537] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:16:02.510075] [DEBUG] [LOCAL ] GIS: Loaded 24107 existing records from primary storage. [2025-09-14T18:16:02.510487] [INFO ] [MAIN ] GIS: Loaded 24107 existing records. [2025-09-14T18:16:02.701185] [DEBUG] [LOCAL ] GKOS: Loaded 18710 existing records from primary storage. [2025-09-14T18:16:02.701305] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:16:02.701497] [INFO ] [MAIN ] GKOS: Loaded 18710 existing records. [2025-09-14T18:16:02.782289] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-09-14T18:16:02.803665] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-09-14T18:16:02.830399] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-09-14T18:16:02.863247] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-09-14T18:16:02.887216] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:16:02.962979] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-09-14T18:16:02.991223] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-09-14T18:16:02.997196] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-09-14T18:16:03.019204] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-09-14T18:16:03.390138] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-14T18:16:03.522825] [INFO ] [REMOTE ] GHY: Full fetch complete (23051 records). [2025-09-14T18:16:03.546611] [INFO ] [REMOTE ] GIS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:16:03.565669] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-09-14T18:16:03.565561] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-09-14T18:16:03.761913] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:16:03.771314] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-14T18:16:03.783766] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-09-14T18:16:04.051390] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-09-14T18:16:04.051531] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-09-14T18:16:04.052124] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-09-14T18:16:04.052188] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-09-14T18:16:04.052988] [DEBUG] [LOCAL ] GHY: Trimmed 23051 records to 15424 (keeping 150 days of data) [2025-09-14T18:16:04.158853] [DEBUG] [LOCAL ] GHY: Primary data saved (15424 records). [2025-09-14T18:16:04.159041] [INFO ] [MAIN ] GHY: Full history saved. [2025-09-14T18:16:04.159162] [INFO ] [MAIN ] Update Progress: 935/2370 symbols completed. GHY took 34.7s. Estimated remaining: 2h 31m 45s. Rate: 9.5 symbols/min [2025-09-14T18:16:04.338801] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:16:04.356716] [DEBUG] [LOCAL ] GL: Loaded 16711 existing records from primary storage. [2025-09-14T18:16:04.356902] [INFO ] [MAIN ] GL: Loaded 16711 existing records. [2025-09-14T18:16:04.529859] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:16:04.530144] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-09-14T18:16:04.530201] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-09-14T18:16:04.530810] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-09-14T18:16:04.530872] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-09-14T18:16:04.572395] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-09-14T18:16:04.879050] [INFO ] [REMOTE ] GL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:16:05.361762] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-09-14T18:16:05.368421] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T18:16:05.570234] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-14T18:16:06.072119] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T18:16:06.158860] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-09-14T18:16:06.958875] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-09-14T18:16:06.988995] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T18:16:07.758853] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-09-14T18:16:07.825804] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-14T18:16:08.558840] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-09-14T18:16:09.140313] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-14T18:16:09.358916] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-09-14T18:16:09.711439] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T18:16:10.158896] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-09-14T18:16:10.458815] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T18:16:10.958902] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-09-14T18:16:11.189220] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T18:16:11.758851] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-09-14T18:16:11.907615] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T18:16:12.070047] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-14T18:16:12.074971] [INFO ] [REMOTE ] GIL: Full fetch complete (46542 records). [2025-09-14T18:16:12.075096] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-09-14T18:16:12.454847] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-09-14T18:16:12.454976] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-09-14T18:16:12.458120] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-09-14T18:16:12.458210] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-09-14T18:16:12.459367] [DEBUG] [LOCAL ] GIL: Trimmed 46542 records to 32288 (keeping 150 days of data) [2025-09-14T18:16:12.558877] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-09-14T18:16:12.671707] [DEBUG] [LOCAL ] GIL: Primary data saved (32288 records). [2025-09-14T18:16:12.671904] [INFO ] [MAIN ] GIL: Full history saved. [2025-09-14T18:16:12.672006] [INFO ] [MAIN ] Update Progress: 936/2370 symbols completed. GIL took 23.8s. Estimated remaining: 2h 31m 42s. Rate: 9.5 symbols/min [2025-09-14T18:16:12.845746] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:16:12.867574] [DEBUG] [LOCAL ] GLOB: Loaded 21977 existing records from primary storage. [2025-09-14T18:16:12.867783] [INFO ] [MAIN ] GLOB: Loaded 21977 existing records. [2025-09-14T18:16:13.044904] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:16:13.045191] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-09-14T18:16:13.045252] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-09-14T18:16:13.045971] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-09-14T18:16:13.046037] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-09-14T18:16:13.363977] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-09-14T18:16:13.431164] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:16:13.944598] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-14T18:16:14.158815] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-09-14T18:16:14.250685] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-14T18:16:14.835084] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-14T18:16:14.958889] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-09-14T18:16:15.758871] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-09-14T18:16:16.224955] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-14T18:16:16.290732] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-14T18:16:16.558852] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-09-14T18:16:17.297592] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T18:16:17.358866] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-09-14T18:16:18.158858] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-09-14T18:16:18.663068] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-14T18:16:18.958896] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-09-14T18:16:19.134971] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-14T18:16:19.750380] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T18:16:19.758767] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-09-14T18:16:20.558906] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-09-14T18:16:20.787047] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T18:16:21.358888] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-09-14T18:16:21.508671] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T18:16:22.064398] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-14T18:16:22.158806] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-09-14T18:16:22.826312] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:16:22.829947] [INFO ] [REMOTE ] GL: Full fetch complete (41707 records). [2025-09-14T18:16:22.830075] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-09-14T18:16:22.973195] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-09-14T18:16:23.208189] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-09-14T18:16:23.208329] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-09-14T18:16:23.209273] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-09-14T18:16:23.209335] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-09-14T18:16:23.210519] [DEBUG] [LOCAL ] GL: Trimmed 41707 records to 28207 (keeping 150 days of data) [2025-09-14T18:16:23.434661] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-14T18:16:23.452307] [DEBUG] [LOCAL ] GL: Primary data saved (28207 records). [2025-09-14T18:16:23.452507] [INFO ] [MAIN ] GL: Full history saved. [2025-09-14T18:16:23.452626] [INFO ] [MAIN ] Update Progress: 937/2370 symbols completed. GL took 19.3s. Estimated remaining: 2h 31m 42s. Rate: 9.4 symbols/min [2025-09-14T18:16:23.631462] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:16:23.638054] [DEBUG] [LOCAL ] GLP: Loaded 4318 existing records from primary storage. [2025-09-14T18:16:23.638272] [INFO ] [MAIN ] GLP: Loaded 4318 existing records. [2025-09-14T18:16:23.764002] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-09-14T18:16:23.826288] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:16:23.826637] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-09-14T18:16:23.826733] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-14T18:16:23.827077] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-09-14T18:16:23.827139] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-09-14T18:16:24.181089] [INFO ] [REMOTE ] GLP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:16:24.562529] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-09-14T18:16:24.565933] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T18:16:24.574120] [INFO ] [REMOTE ] GIS: Full fetch complete (58353 records). [2025-09-14T18:16:24.574315] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-09-14T18:16:24.957116] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T18:16:24.999927] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-09-14T18:16:25.000424] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-09-14T18:16:25.001352] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-09-14T18:16:25.001492] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-09-14T18:16:25.002755] [DEBUG] [LOCAL ] GIS: Trimmed 58353 records to 40420 (keeping 150 days of data) [2025-09-14T18:16:25.262339] [DEBUG] [LOCAL ] GIS: Primary data saved (40420 records). [2025-09-14T18:16:25.262527] [INFO ] [MAIN ] GIS: Full history saved. [2025-09-14T18:16:25.262663] [INFO ] [MAIN ] Update Progress: 938/2370 symbols completed. GIS took 23.1s. Estimated remaining: 2h 31m 29s. Rate: 9.5 symbols/min [2025-09-14T18:16:25.361713] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-09-14T18:16:25.434349] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:16:25.457818] [DEBUG] [LOCAL ] GLW: Loaded 24014 existing records from primary storage. [2025-09-14T18:16:25.458020] [INFO ] [MAIN ] GLW: Loaded 24014 existing records. [2025-09-14T18:16:25.636749] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:16:25.637041] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-09-14T18:16:25.637101] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-09-14T18:16:25.637904] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-09-14T18:16:25.637970] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-09-14T18:16:25.985255] [INFO ] [REMOTE ] GLW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:16:26.068875] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T18:16:26.155892] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-14T18:16:26.160530] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-09-14T18:16:26.816537] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-14T18:16:26.958878] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-09-14T18:16:27.758909] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-09-14T18:16:28.479511] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-14T18:16:28.558842] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-09-14T18:16:28.637928] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T18:16:29.358889] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-09-14T18:16:29.515672] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-14T18:16:30.158844] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-09-14T18:16:30.882655] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-14T18:16:30.958916] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-09-14T18:16:31.140087] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-14T18:16:31.758896] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-09-14T18:16:31.865818] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T18:16:32.448830] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:16:32.454046] [INFO ] [REMOTE ] GKOS: Full fetch complete (46534 records). [2025-09-14T18:16:32.454257] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-09-14T18:16:32.558956] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-09-14T18:16:32.855851] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-09-14T18:16:32.855977] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-09-14T18:16:32.856758] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-09-14T18:16:32.856829] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-09-14T18:16:32.857937] [DEBUG] [LOCAL ] GKOS: Trimmed 46534 records to 31951 (keeping 150 days of data) [2025-09-14T18:16:33.060543] [DEBUG] [LOCAL ] GKOS: Primary data saved (31951 records). [2025-09-14T18:16:33.060750] [INFO ] [MAIN ] GKOS: Full history saved. [2025-09-14T18:16:33.060856] [INFO ] [MAIN ] Update Progress: 939/2370 symbols completed. GKOS took 30.7s. Estimated remaining: 2h 31m 25s. Rate: 9.5 symbols/min [2025-09-14T18:16:33.230327] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:16:33.253415] [DEBUG] [LOCAL ] GM: Loaded 24091 existing records from primary storage. [2025-09-14T18:16:33.253600] [INFO ] [MAIN ] GM: Loaded 24091 existing records. [2025-09-14T18:16:33.363876] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-09-14T18:16:33.438252] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:16:33.438560] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-09-14T18:16:33.438690] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-09-14T18:16:33.439440] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-09-14T18:16:33.439516] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-09-14T18:16:33.587364] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-14T18:16:33.799495] [INFO ] [REMOTE ] GM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:16:34.158814] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-09-14T18:16:34.273110] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-14T18:16:34.767143] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-14T18:16:34.958853] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-09-14T18:16:35.758860] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-09-14T18:16:36.558842] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-09-14T18:16:36.638877] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T18:16:36.807772] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T18:16:37.358889] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-09-14T18:16:37.562460] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-14T18:16:37.860561] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-14T18:16:38.158832] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-09-14T18:16:38.958869] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-09-14T18:16:39.111747] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-14T18:16:39.510816] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-14T18:16:39.758900] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-09-14T18:16:40.558891] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-09-14T18:16:41.358978] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-09-14T18:16:41.439998] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T18:16:41.442458] [INFO ] [REMOTE ] GLP: Full fetch complete (10449 records). [2025-09-14T18:16:41.442593] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-09-14T18:16:41.802138] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-14T18:16:41.888532] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-09-14T18:16:41.888691] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-09-14T18:16:41.888965] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-09-14T18:16:41.889126] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-09-14T18:16:41.889742] [DEBUG] [LOCAL ] GLP: Trimmed 10449 records to 7000 (keeping 150 days of data) [2025-09-14T18:16:41.934119] [DEBUG] [LOCAL ] GLP: Primary data saved (7000 records). [2025-09-14T18:16:41.934306] [INFO ] [MAIN ] GLP: Full history saved. [2025-09-14T18:16:41.934531] [INFO ] [MAIN ] Update Progress: 940/2370 symbols completed. GLP took 18.5s. Estimated remaining: 2h 31m 22s. Rate: 9.4 symbols/min [2025-09-14T18:16:42.106076] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-14T18:16:42.169690] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-09-14T18:16:42.173118] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:16:42.197810] [DEBUG] [LOCAL ] GME: Loaded 24154 existing records from primary storage. [2025-09-14T18:16:42.197992] [INFO ] [MAIN ] GME: Loaded 24154 existing records. [2025-09-14T18:16:42.381622] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:16:42.381952] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-09-14T18:16:42.382016] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-09-14T18:16:42.382700] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-09-14T18:16:42.382766] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-09-14T18:16:42.734958] [INFO ] [REMOTE ] GME: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:16:42.958831] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-09-14T18:16:43.758884] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-09-14T18:16:43.895257] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-14T18:16:44.089574] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-14T18:16:44.558845] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-09-14T18:16:44.763713] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-14T18:16:45.358818] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-09-14T18:16:46.158820] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-09-14T18:16:46.317264] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-14T18:16:46.360303] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-14T18:16:46.669122] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-14T18:16:46.958879] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-09-14T18:16:47.593329] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-14T18:16:47.758828] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-09-14T18:16:48.558805] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-09-14T18:16:48.714308] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-14T18:16:48.900525] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-14T18:16:48.906281] [INFO ] [REMOTE ] GLW: Full fetch complete (58306 records). [2025-09-14T18:16:48.906433] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-09-14T18:16:49.284954] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-09-14T18:16:49.285076] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-09-14T18:16:49.286036] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-09-14T18:16:49.286112] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-09-14T18:16:49.287429] [DEBUG] [LOCAL ] GLW: Trimmed 58306 records to 40377 (keeping 150 days of data) [2025-09-14T18:16:49.379124] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-09-14T18:16:49.559420] [DEBUG] [LOCAL ] GLW: Primary data saved (40377 records). [2025-09-14T18:16:49.559590] [INFO ] [MAIN ] GLW: Full history saved. [2025-09-14T18:16:49.559706] [INFO ] [MAIN ] Update Progress: 941/2370 symbols completed. GLW took 24.3s. Estimated remaining: 2h 31m 18s. Rate: 9.4 symbols/min [2025-09-14T18:16:49.738355] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:16:49.760382] [DEBUG] [LOCAL ] GMED: Loaded 21411 existing records from primary storage. [2025-09-14T18:16:49.760570] [INFO ] [MAIN ] GMED: Loaded 21411 existing records. [2025-09-14T18:16:49.941779] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:16:49.942117] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-09-14T18:16:49.942181] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-09-14T18:16:49.942873] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-09-14T18:16:49.942937] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-09-14T18:16:50.165481] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-09-14T18:16:50.308891] [INFO ] [REMOTE ] GMED: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:16:50.811132] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:16:50.817590] [INFO ] [REMOTE ] GM: Full fetch complete (58409 records). [2025-09-14T18:16:50.817804] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-09-14T18:16:50.966994] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-09-14T18:16:51.210023] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-09-14T18:16:51.210314] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-09-14T18:16:51.211437] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-09-14T18:16:51.223383] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-09-14T18:16:51.227287] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-14T18:16:51.233282] [INFO ] [REMOTE ] GLOB: Full fetch complete (50656 records). [2025-09-14T18:16:51.233437] [DEBUG] [LOCAL ] GM: Trimmed 58409 records to 40470 (keeping 150 days of data) [2025-09-14T18:16:51.234067] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-09-14T18:16:51.760467] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-09-14T18:16:51.838338] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-09-14T18:16:51.840491] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-09-14T18:16:51.843876] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-09-14T18:16:51.844660] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-09-14T18:16:51.850832] [DEBUG] [LOCAL ] GLOB: Trimmed 50656 records to 35854 (keeping 150 days of data) [2025-09-14T18:16:51.995438] [DEBUG] [LOCAL ] GM: Primary data saved (40470 records). [2025-09-14T18:16:51.996381] [INFO ] [MAIN ] GM: Full history saved. [2025-09-14T18:16:51.997435] [INFO ] [MAIN ] Update Progress: 942/2370 symbols completed. GM took 18.9s. Estimated remaining: 2h 31m 6s. Rate: 9.5 symbols/min [2025-09-14T18:16:52.256898] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:16:52.279374] [DEBUG] [LOCAL ] GMRE: Loaded 17252 existing records from primary storage. [2025-09-14T18:16:52.280578] [INFO ] [MAIN ] GMRE: Loaded 17252 existing records. [2025-09-14T18:16:52.474093] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:16:52.474571] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-09-14T18:16:52.474690] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-09-14T18:16:52.476106] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-09-14T18:16:52.476453] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-09-14T18:16:52.556128] [DEBUG] [LOCAL ] GLOB: Primary data saved (35854 records). [2025-09-14T18:16:52.585894] [INFO ] [MAIN ] GLOB: Full history saved. [2025-09-14T18:16:52.590913] [INFO ] [MAIN ] Update Progress: 943/2370 symbols completed. GLOB took 39.9s. Estimated remaining: 2h 30m 51s. Rate: 9.5 symbols/min [2025-09-14T18:16:52.985188] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:16:53.021080] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:16:53.021742] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-09-14T18:16:53.032860] [DEBUG] [LOCAL ] GNE: Loaded 10109 existing records from primary storage. [2025-09-14T18:16:53.033073] [INFO ] [MAIN ] GNE: Loaded 10109 existing records. [2025-09-14T18:16:53.209943] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:16:53.210201] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-09-14T18:16:53.210260] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-09-14T18:16:53.210699] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-09-14T18:16:53.210767] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-09-14T18:16:53.575171] [INFO ] [REMOTE ] GNE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:16:53.576074] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-09-14T18:16:53.608469] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-14T18:16:53.648484] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.68 seconds). [2025-09-14T18:16:54.128380] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-14T18:16:54.150967] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-14T18:16:54.158784] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-09-14T18:16:54.958868] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-09-14T18:16:55.649171] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-14T18:16:55.758830] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-09-14T18:16:56.558896] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-09-14T18:16:56.628315] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T18:16:56.773911] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T18:16:57.358842] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-09-14T18:16:58.158874] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-09-14T18:16:58.958954] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-09-14T18:16:59.164373] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T18:16:59.213307] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-09-14T18:16:59.264086] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-14T18:16:59.758840] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-09-14T18:16:59.873262] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-14T18:17:00.558914] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-09-14T18:17:01.358896] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-09-14T18:17:02.159456] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-09-14T18:17:02.718391] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.96 seconds). [2025-09-14T18:17:02.805489] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-14T18:17:02.958803] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-09-14T18:17:03.256309] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-14T18:17:03.758816] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-14T18:17:03.758883] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-09-14T18:17:04.558828] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-09-14T18:17:05.011227] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-14T18:17:05.358874] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-09-14T18:17:05.408137] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-14T18:17:05.965224] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T18:17:06.158858] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-09-14T18:17:06.958800] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-09-14T18:17:07.062798] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-14T18:17:07.758838] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-09-14T18:17:07.784783] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-14T18:17:08.019237] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-14T18:17:08.558855] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-09-14T18:17:09.358809] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-09-14T18:17:09.560156] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-14T18:17:10.158842] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-09-14T18:17:10.452181] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-09-14T18:17:10.958809] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-09-14T18:17:10.982000] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-14T18:17:11.758796] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-09-14T18:17:11.801239] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-14T18:17:11.803478] [INFO ] [REMOTE ] GNE: Full fetch complete (18062 records). [2025-09-14T18:17:11.803565] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-09-14T18:17:12.170209] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-09-14T18:17:12.170374] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-09-14T18:17:12.170999] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-09-14T18:17:12.171169] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-09-14T18:17:12.172209] [DEBUG] [LOCAL ] GNE: Trimmed 18062 records to 14647 (keeping 150 days of data) [2025-09-14T18:17:12.273363] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-14T18:17:12.309125] [DEBUG] [LOCAL ] GNE: Primary data saved (14647 records). [2025-09-14T18:17:12.309356] [INFO ] [MAIN ] GNE: Full history saved. [2025-09-14T18:17:12.309540] [INFO ] [MAIN ] Update Progress: 944/2370 symbols completed. GNE took 19.7s. Estimated remaining: 2h 31m 4s. Rate: 9.4 symbols/min [2025-09-14T18:17:12.480308] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:17:12.498549] [DEBUG] [LOCAL ] GNK: Loaded 17582 existing records from primary storage. [2025-09-14T18:17:12.498793] [INFO ] [MAIN ] GNK: Loaded 17582 existing records. [2025-09-14T18:17:12.564055] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-09-14T18:17:12.681376] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:17:12.681735] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-09-14T18:17:12.681804] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-09-14T18:17:12.682388] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-09-14T18:17:12.682454] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-09-14T18:17:13.047220] [INFO ] [REMOTE ] GNK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:17:13.358856] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-09-14T18:17:13.827620] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-14T18:17:13.831626] [INFO ] [REMOTE ] GMRE: Full fetch complete (40252 records). [2025-09-14T18:17:13.831756] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-09-14T18:17:14.160587] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-09-14T18:17:14.204430] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-09-14T18:17:14.204579] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-09-14T18:17:14.205397] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-09-14T18:17:14.205695] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-09-14T18:17:14.206835] [DEBUG] [LOCAL ] GMRE: Trimmed 40252 records to 28453 (keeping 150 days of data) [2025-09-14T18:17:14.395756] [DEBUG] [LOCAL ] GMRE: Primary data saved (28453 records). [2025-09-14T18:17:14.395979] [INFO ] [MAIN ] GMRE: Full history saved. [2025-09-14T18:17:14.396168] [INFO ] [MAIN ] Update Progress: 945/2370 symbols completed. GMRE took 22.4s. Estimated remaining: 2h 30m 52s. Rate: 9.4 symbols/min [2025-09-14T18:17:14.579179] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:17:14.602249] [DEBUG] [LOCAL ] GNL: Loaded 20781 existing records from primary storage. [2025-09-14T18:17:14.602659] [INFO ] [MAIN ] GNL: Loaded 20781 existing records. [2025-09-14T18:17:14.832672] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (3.07 seconds). [2025-09-14T18:17:14.832831] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:17:14.844414] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-09-14T18:17:14.844491] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-09-14T18:17:14.845448] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-09-14T18:17:14.845550] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-09-14T18:17:14.962375] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-09-14T18:17:15.238588] [INFO ] [REMOTE ] GNL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:17:15.241630] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T18:17:15.758844] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-09-14T18:17:15.798693] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T18:17:16.558860] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-09-14T18:17:16.977621] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-14T18:17:16.983140] [INFO ] [REMOTE ] GMED: Full fetch complete (52615 records). [2025-09-14T18:17:16.983334] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-09-14T18:17:17.371510] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-09-14T18:17:17.392265] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-09-14T18:17:17.392635] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-09-14T18:17:17.394243] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-09-14T18:17:17.395020] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-09-14T18:17:17.436219] [DEBUG] [LOCAL ] GMED: Trimmed 52615 records to 36187 (keeping 150 days of data) [2025-09-14T18:17:17.441344] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-14T18:17:17.576554] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-14T18:17:17.712415] [DEBUG] [LOCAL ] GMED: Primary data saved (36187 records). [2025-09-14T18:17:17.712604] [INFO ] [MAIN ] GMED: Full history saved. [2025-09-14T18:17:17.712759] [INFO ] [MAIN ] Update Progress: 946/2370 symbols completed. GMED took 28.2s. Estimated remaining: 2h 30m 41s. Rate: 9.5 symbols/min [2025-09-14T18:17:17.886591] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:17:17.909362] [DEBUG] [LOCAL ] GNRC: Loaded 20404 existing records from primary storage. [2025-09-14T18:17:17.909587] [INFO ] [MAIN ] GNRC: Loaded 20404 existing records. [2025-09-14T18:17:18.091340] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:17:18.091632] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-09-14T18:17:18.091717] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-09-14T18:17:18.092304] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-09-14T18:17:18.092367] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-09-14T18:17:18.163970] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-09-14T18:17:18.494612] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:17:18.903417] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T18:17:18.909231] [INFO ] [REMOTE ] GME: Full fetch complete (58435 records). [2025-09-14T18:17:18.909387] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-09-14T18:17:18.964112] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-09-14T18:17:19.299036] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-09-14T18:17:19.299200] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-09-14T18:17:19.300182] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-09-14T18:17:19.300330] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-09-14T18:17:19.301833] [DEBUG] [LOCAL ] GME: Trimmed 58435 records to 40527 (keeping 150 days of data) [2025-09-14T18:17:19.412057] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-14T18:17:19.591093] [DEBUG] [LOCAL ] GME: Primary data saved (40527 records). [2025-09-14T18:17:19.591273] [INFO ] [MAIN ] GME: Full history saved. [2025-09-14T18:17:19.591383] [INFO ] [MAIN ] Update Progress: 947/2370 symbols completed. GME took 37.7s. Estimated remaining: 2h 30m 28s. Rate: 9.5 symbols/min [2025-09-14T18:17:19.761838] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:17:19.761945] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-09-14T18:17:19.768613] [DEBUG] [LOCAL ] GNT: Loaded 3383 existing records from primary storage. [2025-09-14T18:17:19.768747] [INFO ] [MAIN ] GNT: Loaded 3383 existing records. [2025-09-14T18:17:19.944103] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:17:19.944380] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-09-14T18:17:19.944500] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-09-14T18:17:19.944772] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-09-14T18:17:19.944832] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-09-14T18:17:20.344699] [INFO ] [REMOTE ] GNT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:17:20.558870] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-09-14T18:17:20.715451] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T18:17:21.358840] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-09-14T18:17:21.461091] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-14T18:17:21.495052] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T18:17:22.158829] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-09-14T18:17:22.856298] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-14T18:17:22.910936] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T18:17:22.958776] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-09-14T18:17:23.758839] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-09-14T18:17:24.558995] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-09-14T18:17:24.807031] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T18:17:24.842924] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T18:17:25.358868] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-09-14T18:17:26.158894] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-09-14T18:17:26.329067] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T18:17:26.959326] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-09-14T18:17:26.962730] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-14T18:17:26.989600] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T18:17:27.758828] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-09-14T18:17:28.563995] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-09-14T18:17:28.589705] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T18:17:29.293809] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-14T18:17:29.358879] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-09-14T18:17:29.889366] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-14T18:17:30.154406] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-14T18:17:30.158773] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-09-14T18:17:30.958898] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-09-14T18:17:30.981320] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-14T18:17:31.758828] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-09-14T18:17:32.558835] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-09-14T18:17:32.689572] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T18:17:33.276997] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-14T18:17:33.358814] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-09-14T18:17:33.440957] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T18:17:34.158840] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-09-14T18:17:34.866572] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T18:17:34.958853] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-09-14T18:17:35.570250] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T18:17:35.572030] [INFO ] [REMOTE ] GNT: Full fetch complete (8172 records). [2025-09-14T18:17:35.572120] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-09-14T18:17:35.759021] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-09-14T18:17:35.993388] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-14T18:17:35.993669] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-09-14T18:17:36.003225] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-09-14T18:17:36.004053] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-09-14T18:17:36.004253] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-09-14T18:17:36.005751] [DEBUG] [LOCAL ] GNT: Trimmed 8172 records to 5911 (keeping 150 days of data) [2025-09-14T18:17:36.050116] [DEBUG] [LOCAL ] GNT: Primary data saved (5911 records). [2025-09-14T18:17:36.050338] [INFO ] [MAIN ] GNT: Full history saved. [2025-09-14T18:17:36.050508] [INFO ] [MAIN ] Update Progress: 948/2370 symbols completed. GNT took 16.5s. Estimated remaining: 2h 30m 37s. Rate: 9.4 symbols/min [2025-09-14T18:17:36.222764] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:17:36.231333] [DEBUG] [LOCAL ] GNTY: Loaded 4302 existing records from primary storage. [2025-09-14T18:17:36.231515] [INFO ] [MAIN ] GNTY: Loaded 4302 existing records. [2025-09-14T18:17:36.409067] [WARN ] [MAIN ] GNTY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:17:36.409367] [INFO ] [MAIN ] GNTY: Wiping existing primary data before full refresh. [2025-09-14T18:17:36.409428] [INFO ] [LOCAL ] GNTY: Starting deletion of primary data. [2025-09-14T18:17:36.409764] [DEBUG] [LOCAL ] GNTY: Deleted primary data file. [2025-09-14T18:17:36.409839] [INFO ] [MAIN ] GNTY: Starting full primary refresh. [2025-09-14T18:17:36.567046] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-09-14T18:17:36.774908] [INFO ] [REMOTE ] GNTY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:17:37.358851] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-02. [2025-09-14T18:17:37.494363] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-14T18:17:38.006798] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-14T18:17:38.158835] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-09-14T18:17:38.463856] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-14T18:17:38.958841] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-03. [2025-09-14T18:17:39.659956] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-14T18:17:39.758799] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-09-14T18:17:40.260125] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-14T18:17:40.558853] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-09-14T18:17:41.355201] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-14T18:17:41.364823] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-09-14T18:17:42.059233] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-14T18:17:42.158832] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-04. [2025-09-14T18:17:42.366292] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T18:17:42.370422] [INFO ] [REMOTE ] GNK: Full fetch complete (44343 records). [2025-09-14T18:17:42.370559] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-09-14T18:17:42.701264] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-14T18:17:42.774818] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-09-14T18:17:42.774968] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-09-14T18:17:42.776012] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-09-14T18:17:42.776110] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-09-14T18:17:42.777471] [DEBUG] [LOCAL ] GNK: Trimmed 44343 records to 29950 (keeping 150 days of data) [2025-09-14T18:17:42.959373] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-09-14T18:17:42.976665] [DEBUG] [LOCAL ] GNK: Primary data saved (29950 records). [2025-09-14T18:17:42.976887] [INFO ] [MAIN ] GNK: Full history saved. [2025-09-14T18:17:42.977064] [INFO ] [MAIN ] Update Progress: 949/2370 symbols completed. GNK took 30.7s. Estimated remaining: 2h 30m 31s. Rate: 9.4 symbols/min [2025-09-14T18:17:43.157832] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:17:43.184201] [DEBUG] [LOCAL ] GNW: Loaded 22935 existing records from primary storage. [2025-09-14T18:17:43.184449] [INFO ] [MAIN ] GNW: Loaded 22935 existing records. [2025-09-14T18:17:43.379474] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:17:43.379836] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-09-14T18:17:43.379910] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-09-14T18:17:43.380683] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-09-14T18:17:43.380754] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-09-14T18:17:43.771285] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-05. [2025-09-14T18:17:43.779259] [INFO ] [REMOTE ] GNW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:17:43.783036] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T18:17:43.789014] [INFO ] [REMOTE ] GNL: Full fetch complete (51621 records). [2025-09-14T18:17:43.789143] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-09-14T18:17:44.165098] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-09-14T18:17:44.165225] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-09-14T18:17:44.166228] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-09-14T18:17:44.166297] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-09-14T18:17:44.167500] [DEBUG] [LOCAL ] GNL: Trimmed 51621 records to 35163 (keeping 150 days of data) [2025-09-14T18:17:44.368605] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-14T18:17:44.407183] [DEBUG] [LOCAL ] GNL: Primary data saved (35163 records). [2025-09-14T18:17:44.407436] [INFO ] [MAIN ] GNL: Full history saved. [2025-09-14T18:17:44.407575] [INFO ] [MAIN ] Update Progress: 950/2370 symbols completed. GNL took 30.0s. Estimated remaining: 2h 30m 17s. Rate: 9.4 symbols/min [2025-09-14T18:17:44.561851] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-09-14T18:17:44.583861] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:17:44.605576] [DEBUG] [LOCAL ] GOF: Loaded 18884 existing records from primary storage. [2025-09-14T18:17:44.605808] [INFO ] [MAIN ] GOF: Loaded 18884 existing records. [2025-09-14T18:17:44.781222] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:17:44.781543] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-09-14T18:17:44.781688] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-09-14T18:17:44.782301] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-09-14T18:17:44.782364] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-09-14T18:17:45.130813] [INFO ] [REMOTE ] GOF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:17:45.358837] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-09-14T18:17:46.158833] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-09-14T18:17:46.425674] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T18:17:46.853243] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:17:46.858844] [INFO ] [REMOTE ] GNRC: Full fetch complete (49278 records). [2025-09-14T18:17:46.859046] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-09-14T18:17:46.964727] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-09-14T18:17:47.284732] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-09-14T18:17:47.284971] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-09-14T18:17:47.286152] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-09-14T18:17:47.286354] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-09-14T18:17:47.311325] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-14T18:17:47.320889] [DEBUG] [LOCAL ] GNRC: Trimmed 49278 records to 33818 (keeping 150 days of data) [2025-09-14T18:17:47.570448] [DEBUG] [LOCAL ] GNRC: Primary data saved (33818 records). [2025-09-14T18:17:47.570730] [INFO ] [MAIN ] GNRC: Full history saved. [2025-09-14T18:17:47.570908] [INFO ] [MAIN ] Update Progress: 951/2370 symbols completed. GNRC took 29.9s. Estimated remaining: 2h 30m 6s. Rate: 9.5 symbols/min [2025-09-14T18:17:47.744536] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:17:47.763149] [DEBUG] [LOCAL ] GOLF: Loaded 13308 existing records from primary storage. [2025-09-14T18:17:47.762594] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-09-14T18:17:47.763859] [INFO ] [MAIN ] GOLF: Loaded 13308 existing records. [2025-09-14T18:17:47.953500] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:17:47.953892] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-09-14T18:17:47.953962] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-09-14T18:17:47.954505] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-09-14T18:17:47.954577] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-09-14T18:17:48.343436] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:17:48.558871] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-09-14T18:17:48.897265] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T18:17:49.358793] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-09-14T18:17:49.776481] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-14T18:17:49.812633] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-14T18:17:50.158914] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-06. [2025-09-14T18:17:50.749994] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-14T18:17:50.943715] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T18:17:50.958781] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-09-14T18:17:51.758905] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-07. [2025-09-14T18:17:52.558915] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-09-14T18:17:52.634045] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-14T18:17:52.872620] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-14T18:17:53.358855] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-09-14T18:17:54.158890] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-08. [2025-09-14T18:17:54.383888] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T18:17:54.958911] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-09-14T18:17:55.020934] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-14T18:17:55.084894] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T18:17:55.758854] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-09-14T18:17:56.234635] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-14T18:17:56.558894] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-09-14T18:17:57.100792] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-14T18:17:57.358834] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-09-14T18:17:58.139714] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T18:17:58.158803] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-09-14T18:17:58.958905] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-09-14T18:17:59.156541] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-14T18:17:59.607635] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-14T18:17:59.758873] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-09-14T18:18:00.429323] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-14T18:18:00.558816] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-09-14T18:18:00.840493] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T18:18:01.358843] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-09. [2025-09-14T18:18:02.158883] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-09-14T18:18:02.202757] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-14T18:18:02.204181] [INFO ] [REMOTE ] GNTY: Full fetch complete (7304 records). [2025-09-14T18:18:02.204279] [DEBUG] [VALIDATOR ] GNTY: Validating primary data. [2025-09-14T18:18:02.564779] [DEBUG] [VALIDATOR ] GNTY: All expected trading days are present. [2025-09-14T18:18:02.564889] [DEBUG] [VALIDATOR ] GNTY: Primary data validation passed. [2025-09-14T18:18:02.565092] [INFO ] [MAIN ] GNTY: Fetched primary data is valid. [2025-09-14T18:18:02.565145] [DEBUG] [LOCAL ] GNTY: Saving primary data. [2025-09-14T18:18:02.565586] [DEBUG] [LOCAL ] GNTY: Trimmed 7304 records to 5735 (keeping 150 days of data) [2025-09-14T18:18:02.600374] [DEBUG] [LOCAL ] GNTY: Primary data saved (5735 records). [2025-09-14T18:18:02.600499] [INFO ] [MAIN ] GNTY: Full history saved. [2025-09-14T18:18:02.600605] [INFO ] [MAIN ] Update Progress: 952/2370 symbols completed. GNTY took 26.5s. Estimated remaining: 2h 30m 13s. Rate: 9.4 symbols/min [2025-09-14T18:18:02.770976] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:18:02.796309] [DEBUG] [LOCAL ] GOOS: Loaded 20817 existing records from primary storage. [2025-09-14T18:18:02.796525] [INFO ] [MAIN ] GOOS: Loaded 20817 existing records. [2025-09-14T18:18:02.959700] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-09-14T18:18:02.989029] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:18:02.990594] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-09-14T18:18:02.990724] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-09-14T18:18:03.000132] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-09-14T18:18:03.014571] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-09-14T18:18:03.016607] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-14T18:18:03.374968] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:18:03.758829] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-09-14T18:18:04.138669] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-14T18:18:04.558833] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-09-14T18:18:05.358845] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-09-14T18:18:05.440613] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-14T18:18:05.530411] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-14T18:18:05.535147] [INFO ] [REMOTE ] GOF: Full fetch complete (46822 records). [2025-09-14T18:18:05.535277] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-09-14T18:18:05.918434] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-09-14T18:18:05.918559] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-09-14T18:18:05.919388] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-09-14T18:18:05.919463] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-09-14T18:18:05.920524] [DEBUG] [LOCAL ] GOF: Trimmed 46822 records to 31610 (keeping 150 days of data) [2025-09-14T18:18:06.120430] [DEBUG] [LOCAL ] GOF: Primary data saved (31610 records). [2025-09-14T18:18:06.120620] [INFO ] [MAIN ] GOF: Full history saved. [2025-09-14T18:18:06.120746] [INFO ] [MAIN ] Update Progress: 953/2370 symbols completed. GOF took 21.7s. Estimated remaining: 2h 30m 2s. Rate: 9.4 symbols/min [2025-09-14T18:18:06.165692] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-09-14T18:18:06.300865] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:18:06.327335] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T18:18:06.340206] [DEBUG] [LOCAL ] GOTU: Loaded 15910 existing records from primary storage. [2025-09-14T18:18:06.340367] [INFO ] [MAIN ] GOTU: Loaded 15910 existing records. [2025-09-14T18:18:06.524679] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:18:06.524978] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-09-14T18:18:06.525060] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-09-14T18:18:06.525636] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-09-14T18:18:06.525739] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-09-14T18:18:06.888158] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:18:06.958827] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-09-14T18:18:07.012751] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-14T18:18:07.543739] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T18:18:07.546895] [INFO ] [REMOTE ] GOLF: Full fetch complete (35799 records). [2025-09-14T18:18:07.546997] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-09-14T18:18:07.767663] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-09-14T18:18:07.931732] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-09-14T18:18:07.932081] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-09-14T18:18:07.932796] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-09-14T18:18:07.932946] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-09-14T18:18:07.944362] [DEBUG] [LOCAL ] GOLF: Trimmed 35799 records to 23261 (keeping 150 days of data) [2025-09-14T18:18:07.963872] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-14T18:18:08.126712] [DEBUG] [LOCAL ] GOLF: Primary data saved (23261 records). [2025-09-14T18:18:08.126906] [INFO ] [MAIN ] GOLF: Full history saved. [2025-09-14T18:18:08.127017] [INFO ] [MAIN ] Update Progress: 954/2370 symbols completed. GOLF took 20.6s. Estimated remaining: 2h 29m 49s. Rate: 9.5 symbols/min [2025-09-14T18:18:08.308323] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:18:08.331269] [DEBUG] [LOCAL ] GPC: Loaded 20178 existing records from primary storage. [2025-09-14T18:18:08.331509] [INFO ] [MAIN ] GPC: Loaded 20178 existing records. [2025-09-14T18:18:08.523354] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:18:08.523634] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-09-14T18:18:08.523714] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-09-14T18:18:08.524339] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-09-14T18:18:08.524402] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-09-14T18:18:08.567624] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-09-14T18:18:08.883745] [INFO ] [REMOTE ] GPC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:18:09.358823] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-09-14T18:18:09.836525] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-14T18:18:09.888464] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T18:18:09.894110] [INFO ] [REMOTE ] GNW: Full fetch complete (55716 records). [2025-09-14T18:18:09.894255] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-09-14T18:18:10.169071] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-09-14T18:18:10.304773] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-09-14T18:18:10.304916] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-09-14T18:18:10.305851] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-09-14T18:18:10.305914] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-09-14T18:18:10.307185] [DEBUG] [LOCAL ] GNW: Trimmed 55716 records to 38622 (keeping 150 days of data) [2025-09-14T18:18:10.540696] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-14T18:18:10.581451] [DEBUG] [LOCAL ] GNW: Primary data saved (38622 records). [2025-09-14T18:18:10.581624] [INFO ] [MAIN ] GNW: Full history saved. [2025-09-14T18:18:10.581742] [INFO ] [MAIN ] Update Progress: 955/2370 symbols completed. GNW took 27.6s. Estimated remaining: 2h 29m 37s. Rate: 9.5 symbols/min [2025-09-14T18:18:10.756126] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:18:10.764808] [DEBUG] [LOCAL ] GPI: Loaded 6671 existing records from primary storage. [2025-09-14T18:18:10.764965] [INFO ] [MAIN ] GPI: Loaded 6671 existing records. [2025-09-14T18:18:10.946830] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:18:10.947571] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-09-14T18:18:10.947656] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-09-14T18:18:10.948038] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-09-14T18:18:10.948103] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-09-14T18:18:10.963975] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-09-14T18:18:11.320092] [INFO ] [REMOTE ] GPI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:18:11.347528] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T18:18:11.758837] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-09-14T18:18:12.558839] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-09-14T18:18:12.696703] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-14T18:18:12.941246] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-14T18:18:13.358878] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-09-14T18:18:13.624353] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T18:18:14.158879] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-09-14T18:18:14.926890] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T18:18:14.958796] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-09-14T18:18:15.077168] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-14T18:18:15.758833] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-09-14T18:18:16.532500] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T18:18:16.558791] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-09-14T18:18:17.192554] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T18:18:17.358829] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-09-14T18:18:18.043619] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T18:18:18.158802] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-09-14T18:18:18.958863] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-09-14T18:18:19.455049] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-14T18:18:19.674007] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-14T18:18:19.758850] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-09-14T18:18:20.440195] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T18:18:20.558864] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-09-14T18:18:21.165242] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-14T18:18:21.358932] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-09-14T18:18:22.162968] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-09-14T18:18:22.167846] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T18:18:22.200618] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-14T18:18:22.958855] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-09-14T18:18:23.199039] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-14T18:18:23.758851] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-09-14T18:18:24.376672] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-14T18:18:24.380807] [INFO ] [REMOTE ] GOTU: Full fetch complete (43933 records). [2025-09-14T18:18:24.380924] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-09-14T18:18:24.566844] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-09-14T18:18:24.770828] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-09-14T18:18:24.770972] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-09-14T18:18:24.771845] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-09-14T18:18:24.771942] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-09-14T18:18:24.773150] [DEBUG] [LOCAL ] GOTU: Trimmed 43933 records to 28001 (keeping 150 days of data) [2025-09-14T18:18:24.930560] [DEBUG] [LOCAL ] GOTU: Primary data saved (28001 records). [2025-09-14T18:18:24.930765] [INFO ] [MAIN ] GOTU: Full history saved. [2025-09-14T18:18:24.930871] [INFO ] [MAIN ] Update Progress: 956/2370 symbols completed. GOTU took 18.8s. Estimated remaining: 2h 29m 43s. Rate: 9.4 symbols/min [2025-09-14T18:18:25.100097] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:18:25.104427] [DEBUG] [LOCAL ] GPJA: Loaded 2241 existing records from primary storage. [2025-09-14T18:18:25.104715] [INFO ] [MAIN ] GPJA: Loaded 2241 existing records. [2025-09-14T18:18:25.248181] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-14T18:18:25.320165] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:18:25.320951] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-09-14T18:18:25.321041] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-09-14T18:18:25.321371] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-09-14T18:18:25.321438] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-09-14T18:18:25.367746] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-09-14T18:18:25.699569] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:18:25.710459] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-14T18:18:26.158851] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-09-14T18:18:26.958851] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-09-14T18:18:27.076566] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-14T18:18:27.165662] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T18:18:27.617139] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-14T18:18:27.758838] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-09-14T18:18:28.301357] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-14T18:18:28.558837] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-09-14T18:18:29.358853] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-09-14T18:18:30.158866] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-09-14T18:18:30.404533] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-14T18:18:30.449466] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-14T18:18:30.818238] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-14T18:18:30.958828] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-09-14T18:18:31.541070] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-14T18:18:31.758887] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-09-14T18:18:32.558835] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-09-14T18:18:32.885737] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-14T18:18:33.358836] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-09-14T18:18:33.617632] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-14T18:18:34.042191] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-14T18:18:34.158838] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-09-14T18:18:34.731894] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-14T18:18:34.958833] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-09-14T18:18:35.524011] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-14T18:18:35.758842] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-09-14T18:18:36.558836] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-09-14T18:18:37.175953] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T18:18:37.177185] [INFO ] [REMOTE ] GPJA: Full fetch complete (4311 records). [2025-09-14T18:18:37.177275] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-09-14T18:18:37.364416] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-09-14T18:18:37.535203] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-09-14T18:18:37.535393] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-09-14T18:18:37.535593] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-09-14T18:18:37.535790] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-09-14T18:18:37.536337] [DEBUG] [LOCAL ] GPJA: Trimmed 4311 records to 3110 (keeping 150 days of data) [2025-09-14T18:18:37.582614] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-14T18:18:37.583465] [DEBUG] [LOCAL ] GPJA: Primary data saved (3110 records). [2025-09-14T18:18:37.593208] [INFO ] [MAIN ] GPJA: Full history saved. [2025-09-14T18:18:37.593604] [INFO ] [MAIN ] Update Progress: 957/2370 symbols completed. GPJA took 12.7s. Estimated remaining: 2h 29m 46s. Rate: 9.4 symbols/min [2025-09-14T18:18:37.712482] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-14T18:18:37.714863] [INFO ] [REMOTE ] GPI: Full fetch complete (16096 records). [2025-09-14T18:18:37.714956] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-09-14T18:18:38.084411] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-09-14T18:18:38.084539] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-09-14T18:18:38.084972] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-09-14T18:18:38.085046] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-09-14T18:18:38.088804] [DEBUG] [LOCAL ] GPI: Trimmed 16096 records to 10289 (keeping 150 days of data) [2025-09-14T18:18:38.155159] [DEBUG] [LOCAL ] GPI: Primary data saved (10289 records). [2025-09-14T18:18:38.155352] [INFO ] [MAIN ] GPI: Full history saved. [2025-09-14T18:18:38.155476] [INFO ] [MAIN ] Update Progress: 958/2370 symbols completed. GPI took 27.6s. Estimated remaining: 2h 29m 31s. Rate: 9.4 symbols/min [2025-09-14T18:18:38.158786] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-09-14T18:18:38.958943] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-09-14T18:18:39.007350] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-14T18:18:39.014148] [INFO ] [REMOTE ] GPC: Full fetch complete (51324 records). [2025-09-14T18:18:39.014436] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-09-14T18:18:39.390278] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-09-14T18:18:39.390401] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-09-14T18:18:39.391335] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-09-14T18:18:39.391408] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-09-14T18:18:39.392934] [DEBUG] [LOCAL ] GPC: Trimmed 51324 records to 34452 (keeping 150 days of data) [2025-09-14T18:18:39.649135] [DEBUG] [LOCAL ] GPC: Primary data saved (34452 records). [2025-09-14T18:18:39.649450] [INFO ] [MAIN ] GPC: Full history saved. [2025-09-14T18:18:39.649763] [INFO ] [MAIN ] Update Progress: 959/2370 symbols completed. GPC took 31.5s. Estimated remaining: 2h 29m 17s. Rate: 9.5 symbols/min [2025-09-14T18:18:40.457689] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-14T18:18:40.463298] [INFO ] [REMOTE ] GOOS: Full fetch complete (50184 records). [2025-09-14T18:18:40.463756] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-09-14T18:18:40.870951] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-09-14T18:18:40.871077] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-09-14T18:18:40.871837] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-09-14T18:18:40.871897] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-09-14T18:18:40.872952] [DEBUG] [LOCAL ] GOOS: Trimmed 50184 records to 34330 (keeping 150 days of data) [2025-09-14T18:18:41.087355] [DEBUG] [LOCAL ] GOOS: Primary data saved (34330 records). [2025-09-14T18:18:41.087533] [INFO ] [MAIN ] GOOS: Full history saved. [2025-09-14T18:18:41.087632] [INFO ] [MAIN ] Update Progress: 960/2370 symbols completed. GOOS took 38.5s. Estimated remaining: 2h 29m 4s. Rate: 9.5 symbols/min [2025-09-14T18:18:41.846629] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:18:41.847628] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:18:41.888958] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:18:41.870586] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:18:41.905203] [DEBUG] [LOCAL ] GPMT: Loaded 10455 existing records from primary storage. [2025-09-14T18:18:41.905455] [INFO ] [MAIN ] GPMT: Loaded 10455 existing records. [2025-09-14T18:18:41.988149] [DEBUG] [LOCAL ] GPOR: Loaded 10676 existing records from primary storage. [2025-09-14T18:18:42.015012] [INFO ] [MAIN ] GPOR: Loaded 10676 existing records. [2025-09-14T18:18:42.122485] [DEBUG] [LOCAL ] GPK: Loaded 23693 existing records from primary storage. [2025-09-14T18:18:42.179686] [DEBUG] [LOCAL ] GPN: Loaded 23125 existing records from primary storage. [2025-09-14T18:18:42.202452] [INFO ] [MAIN ] GPK: Loaded 23693 existing records. [2025-09-14T18:18:42.232124] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:18:42.237590] [INFO ] [MAIN ] GPN: Loaded 23125 existing records. [2025-09-14T18:18:42.312125] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-09-14T18:18:42.396753] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-09-14T18:18:42.510447] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:18:42.536450] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-09-14T18:18:42.605031] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-09-14T18:18:42.605825] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-09-14T18:18:42.740551] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-09-14T18:18:42.756140] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:18:42.794622] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:18:42.817971] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-09-14T18:18:42.810788] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-09-14T18:18:42.821750] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-09-14T18:18:42.821669] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-09-14T18:18:42.821987] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-09-14T18:18:42.821916] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-09-14T18:18:42.848244] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-09-14T18:18:42.862807] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-09-14T18:18:42.871864] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-09-14T18:18:43.032065] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-09-14T18:18:43.440555] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:18:43.463998] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-09-14T18:18:44.146413] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:18:44.175701] [INFO ] [REMOTE ] GPN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:18:44.202430] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-09-14T18:18:44.207821] [INFO ] [REMOTE ] GPK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:18:44.208342] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-09-14T18:18:44.210850] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-09-14T18:18:44.888170] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-14T18:18:44.893517] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-09-14T18:18:45.408885] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-14T18:18:45.413784] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-09-14T18:18:45.957501] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T18:18:45.967574] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-09-14T18:18:46.069468] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T18:18:46.079988] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-09-14T18:18:46.093888] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-14T18:18:46.158776] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-09-14T18:18:46.668501] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-14T18:18:46.958847] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-09-14T18:18:47.595245] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-14T18:18:47.655923] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-14T18:18:47.732713] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-14T18:18:47.758869] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-09-14T18:18:47.800444] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-14T18:18:48.558836] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-09-14T18:18:48.818929] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-14T18:18:49.358847] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-09-14T18:18:50.158864] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-09-14T18:18:50.561965] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-14T18:18:50.613101] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-14T18:18:50.958857] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-09-14T18:18:51.758895] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-09-14T18:18:51.984109] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-14T18:18:52.012119] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-14T18:18:52.558836] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-09-14T18:18:52.786097] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T18:18:53.358842] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-09-14T18:18:54.158797] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-09-14T18:18:54.405834] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T18:18:54.532068] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-14T18:18:54.958897] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-09-14T18:18:55.278355] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T18:18:55.758898] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-09-14T18:18:56.558789] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-09-14T18:18:56.820160] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T18:18:56.965700] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T18:18:57.107379] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T18:18:57.109564] [INFO ] [REMOTE ] GPMT: Full fetch complete (29299 records). [2025-09-14T18:18:57.109689] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-09-14T18:18:57.364038] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-09-14T18:18:57.479730] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-09-14T18:18:57.479867] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-09-14T18:18:57.480507] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-09-14T18:18:57.480570] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-09-14T18:18:57.481800] [DEBUG] [LOCAL ] GPMT: Trimmed 29299 records to 20904 (keeping 150 days of data) [2025-09-14T18:18:57.600371] [DEBUG] [LOCAL ] GPMT: Primary data saved (20904 records). [2025-09-14T18:18:57.600544] [INFO ] [MAIN ] GPMT: Full history saved. [2025-09-14T18:18:57.600707] [INFO ] [MAIN ] Update Progress: 961/2370 symbols completed. GPMT took 16.5s. Estimated remaining: 2h 29m 12s. Rate: 9.4 symbols/min [2025-09-14T18:18:57.770752] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:18:57.787054] [DEBUG] [LOCAL ] GPRK: Loaded 15961 existing records from primary storage. [2025-09-14T18:18:57.787217] [INFO ] [MAIN ] GPRK: Loaded 15961 existing records. [2025-09-14T18:18:57.970240] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:18:57.970556] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-09-14T18:18:57.970619] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-09-14T18:18:57.971138] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-09-14T18:18:57.971212] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-09-14T18:18:58.164050] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-09-14T18:18:58.346694] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:18:58.958834] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-09-14T18:18:59.222354] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-14T18:18:59.758867] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-09-14T18:19:00.048923] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-14T18:19:00.118443] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-14T18:19:00.558871] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-09-14T18:19:01.358859] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-09-14T18:19:01.919416] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-14T18:19:01.963372] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-14T18:19:02.158903] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-09-14T18:19:02.731551] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-14T18:19:02.958830] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-09-14T18:19:03.758806] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-09-14T18:19:04.037207] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-14T18:19:04.057171] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-14T18:19:04.060260] [INFO ] [REMOTE ] GPOR: Full fetch complete (24915 records). [2025-09-14T18:19:04.060363] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-09-14T18:19:04.445370] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-09-14T18:19:04.445538] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-09-14T18:19:04.446217] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-09-14T18:19:04.446284] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-09-14T18:19:04.447191] [DEBUG] [LOCAL ] GPOR: Trimmed 24915 records to 16535 (keeping 150 days of data) [2025-09-14T18:19:04.546441] [DEBUG] [LOCAL ] GPOR: Primary data saved (16535 records). [2025-09-14T18:19:04.546625] [INFO ] [MAIN ] GPOR: Full history saved. [2025-09-14T18:19:04.546761] [INFO ] [MAIN ] Update Progress: 962/2370 symbols completed. GPOR took 23.5s. Estimated remaining: 2h 29m 7s. Rate: 9.4 symbols/min [2025-09-14T18:19:04.567080] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-09-14T18:19:04.718091] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:19:04.730508] [DEBUG] [LOCAL ] GRBK: Loaded 11546 existing records from primary storage. [2025-09-14T18:19:04.730687] [INFO ] [MAIN ] GRBK: Loaded 11546 existing records. [2025-09-14T18:19:04.918402] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:19:04.918886] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-09-14T18:19:04.918981] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-09-14T18:19:04.919510] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-09-14T18:19:04.919582] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-09-14T18:19:05.289209] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:19:05.341931] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-14T18:19:05.358782] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-09-14T18:19:06.158898] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-09-14T18:19:06.527390] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-14T18:19:06.808911] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T18:19:06.958924] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-09-14T18:19:07.635690] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:19:07.641302] [INFO ] [REMOTE ] GPK: Full fetch complete (57062 records). [2025-09-14T18:19:07.641485] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-09-14T18:19:07.761956] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-09-14T18:19:08.098910] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-09-14T18:19:08.099740] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-09-14T18:19:08.102461] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-09-14T18:19:08.100902] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T18:19:08.111421] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-09-14T18:19:08.113973] [DEBUG] [LOCAL ] GPK: Trimmed 57062 records to 39725 (keeping 150 days of data) [2025-09-14T18:19:08.398383] [DEBUG] [LOCAL ] GPK: Primary data saved (39725 records). [2025-09-14T18:19:08.398635] [INFO ] [MAIN ] GPK: Full history saved. [2025-09-14T18:19:08.398792] [INFO ] [MAIN ] Update Progress: 963/2370 symbols completed. GPK took 27.3s. Estimated remaining: 2h 28m 57s. Rate: 9.4 symbols/min [2025-09-14T18:19:08.565218] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-09-14T18:19:08.601128] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:19:08.607947] [DEBUG] [LOCAL ] GRC: Loaded 3842 existing records from primary storage. [2025-09-14T18:19:08.608168] [INFO ] [MAIN ] GRC: Loaded 3842 existing records. [2025-09-14T18:19:08.815242] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:19:08.815622] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-09-14T18:19:08.815723] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-09-14T18:19:08.816067] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-09-14T18:19:08.816139] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-09-14T18:19:09.181532] [INFO ] [REMOTE ] GRC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:19:09.325769] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-14T18:19:09.358773] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-09-14T18:19:09.979518] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-14T18:19:10.158830] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-09-14T18:19:10.782756] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-14T18:19:10.958838] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-09-14T18:19:11.758827] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-09-14T18:19:11.806341] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-14T18:19:12.050443] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-14T18:19:12.255452] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T18:19:12.261075] [INFO ] [REMOTE ] GPN: Full fetch complete (56626 records). [2025-09-14T18:19:12.261220] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-09-14T18:19:12.564032] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-09-14T18:19:12.698915] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-09-14T18:19:12.699119] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-09-14T18:19:12.700244] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-09-14T18:19:12.700321] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-09-14T18:19:12.702136] [DEBUG] [LOCAL ] GPN: Trimmed 56626 records to 39199 (keeping 150 days of data) [2025-09-14T18:19:12.980906] [DEBUG] [LOCAL ] GPN: Primary data saved (39199 records). [2025-09-14T18:19:12.981116] [INFO ] [MAIN ] GPN: Full history saved. [2025-09-14T18:19:12.981230] [INFO ] [MAIN ] Update Progress: 964/2370 symbols completed. GPN took 31.9s. Estimated remaining: 2h 28m 48s. Rate: 9.4 symbols/min [2025-09-14T18:19:13.153248] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:19:13.164205] [DEBUG] [LOCAL ] GRDN: Loaded 9421 existing records from primary storage. [2025-09-14T18:19:13.164393] [INFO ] [MAIN ] GRDN: Loaded 9421 existing records. [2025-09-14T18:19:13.343895] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:19:13.344197] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-09-14T18:19:13.344258] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-09-14T18:19:13.344701] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-09-14T18:19:13.344791] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-09-14T18:19:13.365960] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-09-14T18:19:13.709836] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:19:14.158863] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-09-14T18:19:14.203930] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T18:19:14.325468] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-14T18:19:14.958809] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-09-14T18:19:14.999991] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-14T18:19:15.758882] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-09-14T18:19:16.354531] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-14T18:19:16.558842] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-09-14T18:19:16.667324] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-14T18:19:17.358871] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-09-14T18:19:17.874186] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-14T18:19:18.158830] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-09-14T18:19:18.682492] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-14T18:19:18.686328] [INFO ] [REMOTE ] GPRK: Full fetch complete (42553 records). [2025-09-14T18:19:18.686460] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-09-14T18:19:18.963928] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-09-14T18:19:19.057654] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-09-14T18:19:19.057767] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-09-14T18:19:19.058453] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-09-14T18:19:19.058509] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-09-14T18:19:19.059734] [DEBUG] [LOCAL ] GPRK: Trimmed 42553 records to 28993 (keeping 150 days of data) [2025-09-14T18:19:19.244253] [DEBUG] [LOCAL ] GPRK: Primary data saved (28993 records). [2025-09-14T18:19:19.244435] [INFO ] [MAIN ] GPRK: Full history saved. [2025-09-14T18:19:19.244573] [INFO ] [MAIN ] Update Progress: 965/2370 symbols completed. GPRK took 21.6s. Estimated remaining: 2h 28m 41s. Rate: 9.4 symbols/min [2025-09-14T18:19:19.411220] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:19:19.429199] [DEBUG] [LOCAL ] GRMN: Loaded 18214 existing records from primary storage. [2025-09-14T18:19:19.429428] [INFO ] [MAIN ] GRMN: Loaded 18214 existing records. [2025-09-14T18:19:19.605523] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:19:19.605838] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-09-14T18:19:19.605913] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-09-14T18:19:19.606562] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-09-14T18:19:19.606628] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-09-14T18:19:19.728022] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-14T18:19:19.760161] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-09-14T18:19:20.007371] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:19:20.018246] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T18:19:20.558814] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-09-14T18:19:20.792061] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-14T18:19:21.358892] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-09-14T18:19:21.910069] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T18:19:22.158800] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-09-14T18:19:22.424632] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-14T18:19:22.427668] [INFO ] [REMOTE ] GRBK: Full fetch complete (30193 records). [2025-09-14T18:19:22.427767] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-09-14T18:19:22.699886] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-14T18:19:22.811048] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-09-14T18:19:22.811154] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-09-14T18:19:22.811754] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-09-14T18:19:22.811811] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-09-14T18:19:22.812575] [DEBUG] [LOCAL ] GRBK: Trimmed 30193 records to 19882 (keeping 150 days of data) [2025-09-14T18:19:22.936172] [DEBUG] [LOCAL ] GRBK: Primary data saved (19882 records). [2025-09-14T18:19:22.936397] [INFO ] [MAIN ] GRBK: Full history saved. [2025-09-14T18:19:22.936509] [INFO ] [MAIN ] Update Progress: 966/2370 symbols completed. GRBK took 18.4s. Estimated remaining: 2h 28m 31s. Rate: 9.5 symbols/min [2025-09-14T18:19:22.966670] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-09-14T18:19:23.113917] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:19:23.135184] [DEBUG] [LOCAL ] GRND: Loaded 22280 existing records from primary storage. [2025-09-14T18:19:23.135417] [INFO ] [MAIN ] GRND: Loaded 22280 existing records. [2025-09-14T18:19:23.325726] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:19:23.326020] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-09-14T18:19:23.326082] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-09-14T18:19:23.326795] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-09-14T18:19:23.326867] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-09-14T18:19:23.687251] [INFO ] [REMOTE ] GRND: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:19:23.758836] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-09-14T18:19:24.213607] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T18:19:24.558849] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-09-14T18:19:24.664699] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-14T18:19:25.358864] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-09-14T18:19:26.061224] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-14T18:19:26.152338] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T18:19:26.161185] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-09-14T18:19:26.652336] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-14T18:19:26.958832] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-09-14T18:19:27.758836] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-09-14T18:19:28.102433] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-14T18:19:28.353172] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-14T18:19:28.558868] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-09-14T18:19:29.358857] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-09-14T18:19:29.401284] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-14T18:19:30.158872] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-09-14T18:19:30.394618] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-14T18:19:30.958876] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-09-14T18:19:31.058624] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-14T18:19:31.758837] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-09-14T18:19:31.836249] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-14T18:19:32.558943] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-09-14T18:19:33.358875] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-09-14T18:19:33.419429] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T18:19:33.664811] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T18:19:34.104018] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T18:19:34.105411] [INFO ] [REMOTE ] GRC: Full fetch complete (9660 records). [2025-09-14T18:19:34.105498] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-09-14T18:19:34.168994] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-09-14T18:19:34.519715] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-09-14T18:19:34.519875] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-09-14T18:19:34.520349] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-09-14T18:19:34.520443] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-09-14T18:19:34.521117] [DEBUG] [LOCAL ] GRC: Trimmed 9660 records to 6363 (keeping 150 days of data) [2025-09-14T18:19:34.560408] [DEBUG] [LOCAL ] GRC: Primary data saved (6363 records). [2025-09-14T18:19:34.560591] [INFO ] [MAIN ] GRC: Full history saved. [2025-09-14T18:19:34.560763] [INFO ] [MAIN ] Update Progress: 967/2370 symbols completed. GRC took 26.2s. Estimated remaining: 2h 28m 33s. Rate: 9.4 symbols/min [2025-09-14T18:19:34.749430] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:19:34.765238] [DEBUG] [LOCAL ] GRNT: Loaded 15624 existing records from primary storage. [2025-09-14T18:19:34.765420] [INFO ] [MAIN ] GRNT: Loaded 15624 existing records. [2025-09-14T18:19:34.947577] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:19:34.947912] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-09-14T18:19:34.947972] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-09-14T18:19:34.948475] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-09-14T18:19:34.948548] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-09-14T18:19:34.969529] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-09-14T18:19:35.309538] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:19:35.758842] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-09-14T18:19:36.006012] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T18:19:36.332492] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-14T18:19:36.558834] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-09-14T18:19:36.768442] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-14T18:19:37.358816] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-09-14T18:19:37.603233] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-14T18:19:37.606370] [INFO ] [REMOTE ] GRDN: Full fetch complete (19367 records). [2025-09-14T18:19:37.606458] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-09-14T18:19:37.966685] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-09-14T18:19:37.966801] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-09-14T18:19:37.967265] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-09-14T18:19:37.967319] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-09-14T18:19:37.968175] [DEBUG] [LOCAL ] GRDN: Trimmed 19367 records to 15117 (keeping 150 days of data) [2025-09-14T18:19:38.056334] [DEBUG] [LOCAL ] GRDN: Primary data saved (15117 records). [2025-09-14T18:19:38.056512] [INFO ] [MAIN ] GRDN: Full history saved. [2025-09-14T18:19:38.056627] [INFO ] [MAIN ] Update Progress: 968/2370 symbols completed. GRDN took 25.1s. Estimated remaining: 2h 28m 22s. Rate: 9.4 symbols/min [2025-09-14T18:19:38.163927] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-09-14T18:19:38.228416] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:19:38.234573] [DEBUG] [LOCAL ] GROV: Loaded 4485 existing records from primary storage. [2025-09-14T18:19:38.234722] [INFO ] [MAIN ] GROV: Loaded 4485 existing records. [2025-09-14T18:19:38.411023] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:19:38.411335] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-09-14T18:19:38.411402] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-09-14T18:19:38.411715] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-09-14T18:19:38.411777] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-09-14T18:19:38.775020] [INFO ] [REMOTE ] GROV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:19:38.799049] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-14T18:19:38.958842] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-09-14T18:19:39.089572] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T18:19:39.758842] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-09-14T18:19:40.534158] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-14T18:19:40.558864] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-09-14T18:19:40.836205] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-14T18:19:41.358820] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-09-14T18:19:41.501886] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-14T18:19:42.158881] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-09-14T18:19:42.958800] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-09-14T18:19:43.032232] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-14T18:19:43.069910] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-14T18:19:43.760033] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-09-14T18:19:43.762952] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-14T18:19:44.558797] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-09-14T18:19:44.624673] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-14T18:19:45.358844] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-09-14T18:19:45.397036] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-14T18:19:46.042850] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:19:46.047550] [INFO ] [REMOTE ] GRMN: Full fetch complete (45792 records). [2025-09-14T18:19:46.047710] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-09-14T18:19:46.163979] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-09-14T18:19:46.422387] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-09-14T18:19:46.422507] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-09-14T18:19:46.423279] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-09-14T18:19:46.423354] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-09-14T18:19:46.424454] [DEBUG] [LOCAL ] GRMN: Trimmed 45792 records to 30492 (keeping 150 days of data) [2025-09-14T18:19:46.648265] [DEBUG] [LOCAL ] GRMN: Primary data saved (30492 records). [2025-09-14T18:19:46.648518] [INFO ] [MAIN ] GRMN: Full history saved. [2025-09-14T18:19:46.648796] [INFO ] [MAIN ] Update Progress: 969/2370 symbols completed. GRMN took 27.4s. Estimated remaining: 2h 28m 19s. Rate: 9.4 symbols/min [2025-09-14T18:19:46.826690] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:19:46.835096] [DEBUG] [LOCAL ] GRX: Loaded 2224 existing records from primary storage. [2025-09-14T18:19:46.835255] [INFO ] [MAIN ] GRX: Loaded 2224 existing records. [2025-09-14T18:19:46.963977] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-09-14T18:19:47.017683] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:19:47.018350] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-09-14T18:19:47.018434] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-09-14T18:19:47.018791] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-09-14T18:19:47.018864] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-09-14T18:19:47.130493] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T18:19:47.389807] [INFO ] [REMOTE ] GRX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:19:47.758831] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-09-14T18:19:48.558891] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-09-14T18:19:48.778004] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-14T18:19:48.855355] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-14T18:19:49.358877] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-09-14T18:19:50.139362] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T18:19:50.158775] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-09-14T18:19:50.731410] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-14T18:19:50.958854] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-09-14T18:19:51.233552] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T18:19:51.491807] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-14T18:19:51.758852] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-09-14T18:19:52.558826] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-09-14T18:19:53.138189] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-14T18:19:53.358863] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-09-14T18:19:53.497505] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-14T18:19:54.158838] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-09-14T18:19:54.772696] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-14T18:19:54.866026] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T18:19:54.958864] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-09-14T18:19:55.615012] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-14T18:19:55.758841] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-09-14T18:19:56.469028] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-14T18:19:56.558893] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-09-14T18:19:57.109773] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T18:19:57.111000] [INFO ] [REMOTE ] GROV: Full fetch complete (10121 records). [2025-09-14T18:19:57.111092] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-09-14T18:19:57.364038] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-09-14T18:19:57.485672] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-09-14T18:19:57.485800] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-09-14T18:19:57.486154] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-09-14T18:19:57.486219] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-09-14T18:19:57.486805] [DEBUG] [LOCAL ] GROV: Trimmed 10121 records to 6894 (keeping 150 days of data) [2025-09-14T18:19:57.529216] [DEBUG] [LOCAL ] GROV: Primary data saved (6894 records). [2025-09-14T18:19:57.529412] [INFO ] [MAIN ] GROV: Full history saved. [2025-09-14T18:19:57.529549] [INFO ] [MAIN ] Update Progress: 970/2370 symbols completed. GROV took 19.5s. Estimated remaining: 2h 28m 19s. Rate: 9.4 symbols/min [2025-09-14T18:19:57.704159] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:19:57.758869] [DEBUG] [LOCAL ] GS: Loaded 39082 existing records from primary storage. [2025-09-14T18:19:57.759063] [INFO ] [MAIN ] GS: Loaded 39082 existing records. [2025-09-14T18:19:57.937667] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:19:57.937956] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-09-14T18:19:57.938016] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-09-14T18:19:57.939892] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-09-14T18:19:57.939966] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-09-14T18:19:58.167933] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-09-14T18:19:58.222840] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-14T18:19:58.301106] [INFO ] [REMOTE ] GS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:19:58.958946] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-09-14T18:19:59.507484] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T18:19:59.682801] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-14T18:19:59.758909] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-09-14T18:20:00.339512] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-14T18:20:00.558880] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-09-14T18:20:01.358868] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-09-14T18:20:02.041005] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-14T18:20:02.158892] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-09-14T18:20:02.958850] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-09-14T18:20:03.124022] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-14T18:20:03.129393] [INFO ] [REMOTE ] GRND: Full fetch complete (54272 records). [2025-09-14T18:20:03.129577] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-09-14T18:20:03.515655] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-09-14T18:20:03.515831] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-09-14T18:20:03.516611] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-09-14T18:20:03.516789] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-09-14T18:20:03.518258] [DEBUG] [LOCAL ] GRND: Trimmed 54272 records to 37643 (keeping 150 days of data) [2025-09-14T18:20:03.617184] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:20:03.647316] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T18:20:03.645141] [INFO ] [REMOTE ] GRX: Full fetch complete (4463 records). [2025-09-14T18:20:03.657072] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-09-14T18:20:03.763662] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-09-14T18:20:04.037690] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-09-14T18:20:04.038574] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-09-14T18:20:04.039001] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-09-14T18:20:04.039413] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-09-14T18:20:04.041257] [DEBUG] [LOCAL ] GRX: Trimmed 4463 records to 3275 (keeping 150 days of data) [2025-09-14T18:20:04.068868] [DEBUG] [LOCAL ] GRX: Primary data saved (3275 records). [2025-09-14T18:20:04.069930] [INFO ] [MAIN ] GRX: Full history saved. [2025-09-14T18:20:04.070940] [INFO ] [MAIN ] Update Progress: 971/2370 symbols completed. GRX took 17.4s. Estimated remaining: 2h 28m 13s. Rate: 9.4 symbols/min [2025-09-14T18:20:04.329893] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:20:04.392463] [DEBUG] [LOCAL ] GSBD: Loaded 16667 existing records from primary storage. [2025-09-14T18:20:04.394292] [INFO ] [MAIN ] GSBD: Loaded 16667 existing records. [2025-09-14T18:20:04.562020] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-09-14T18:20:04.589104] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:20:04.591393] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-09-14T18:20:04.593719] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-09-14T18:20:04.596304] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-09-14T18:20:04.597929] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-09-14T18:20:04.660499] [DEBUG] [LOCAL ] GRND: Primary data saved (37643 records). [2025-09-14T18:20:04.690974] [INFO ] [MAIN ] GRND: Full history saved. [2025-09-14T18:20:04.706522] [INFO ] [MAIN ] Update Progress: 972/2370 symbols completed. GRND took 41.8s. Estimated remaining: 2h 27m 58s. Rate: 9.4 symbols/min [2025-09-14T18:20:05.085658] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:20:05.171539] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:20:05.219180] [DEBUG] [LOCAL ] GSK: Loaded 23924 existing records from primary storage. [2025-09-14T18:20:05.219825] [INFO ] [MAIN ] GSK: Loaded 23924 existing records. [2025-09-14T18:20:05.220876] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T18:20:05.371789] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-09-14T18:20:05.408547] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:20:05.408732] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-09-14T18:20:05.408794] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-09-14T18:20:05.409581] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-09-14T18:20:05.409669] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-09-14T18:20:05.756158] [INFO ] [REMOTE ] GSK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:20:05.919072] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T18:20:05.922935] [INFO ] [REMOTE ] GRNT: Full fetch complete (36585 records). [2025-09-14T18:20:05.923039] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-09-14T18:20:06.168247] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-09-14T18:20:06.301400] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-09-14T18:20:06.301546] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-09-14T18:20:06.302303] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-09-14T18:20:06.302464] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-09-14T18:20:06.303410] [DEBUG] [LOCAL ] GRNT: Trimmed 36585 records to 25252 (keeping 150 days of data) [2025-09-14T18:20:06.430881] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-14T18:20:06.500570] [DEBUG] [LOCAL ] GRNT: Primary data saved (25252 records). [2025-09-14T18:20:06.500773] [INFO ] [MAIN ] GRNT: Full history saved. [2025-09-14T18:20:06.500877] [INFO ] [MAIN ] Update Progress: 973/2370 symbols completed. GRNT took 31.9s. Estimated remaining: 2h 27m 46s. Rate: 9.5 symbols/min [2025-09-14T18:20:06.684518] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:20:06.702040] [DEBUG] [LOCAL ] GSL: Loaded 14801 existing records from primary storage. [2025-09-14T18:20:06.702286] [INFO ] [MAIN ] GSL: Loaded 14801 existing records. [2025-09-14T18:20:06.879223] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:20:06.879563] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-09-14T18:20:06.879629] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-09-14T18:20:06.880234] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-09-14T18:20:06.880300] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-09-14T18:20:06.964150] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-09-14T18:20:07.241606] [INFO ] [REMOTE ] GSL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:20:07.762991] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-09-14T18:20:07.767778] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-14T18:20:07.988934] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-14T18:20:08.558830] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-09-14T18:20:09.358787] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-09-14T18:20:09.753598] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-14T18:20:10.163938] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-09-14T18:20:10.178189] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-14T18:20:10.391800] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-14T18:20:10.958896] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-09-14T18:20:11.222150] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-14T18:20:11.758841] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-09-14T18:20:12.558860] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-09-14T18:20:12.683381] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-14T18:20:13.191295] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-14T18:20:13.358838] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-09-14T18:20:14.158862] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-09-14T18:20:14.332869] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T18:20:14.958857] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-09-14T18:20:15.416510] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-14T18:20:15.462946] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-14T18:20:15.758887] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-09-14T18:20:16.545596] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-14T18:20:16.558830] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-09-14T18:20:16.695350] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-14T18:20:16.700755] [INFO ] [REMOTE ] GS: Full fetch complete (56956 records). [2025-09-14T18:20:16.700891] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-09-14T18:20:17.086423] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-09-14T18:20:17.086568] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-09-14T18:20:17.087403] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-09-14T18:20:17.087487] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-09-14T18:20:17.088883] [DEBUG] [LOCAL ] GS: Trimmed 56956 records to 39082 (keeping 150 days of data) [2025-09-14T18:20:17.347860] [DEBUG] [LOCAL ] GS: Primary data saved (39082 records). [2025-09-14T18:20:17.348052] [INFO ] [MAIN ] GS: Full history saved. [2025-09-14T18:20:17.348166] [INFO ] [MAIN ] Update Progress: 974/2370 symbols completed. GS took 19.8s. Estimated remaining: 2h 27m 46s. Rate: 9.4 symbols/min [2025-09-14T18:20:17.369153] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-09-14T18:20:17.522480] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:20:17.545340] [DEBUG] [LOCAL ] GTES: Loaded 22423 existing records from primary storage. [2025-09-14T18:20:17.545580] [INFO ] [MAIN ] GTES: Loaded 22423 existing records. [2025-09-14T18:20:17.718671] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:20:17.718964] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-09-14T18:20:17.719025] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-09-14T18:20:17.719725] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-09-14T18:20:17.719789] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-09-14T18:20:18.085721] [INFO ] [REMOTE ] GTES: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:20:18.158848] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-09-14T18:20:18.619698] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-14T18:20:18.958866] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-09-14T18:20:19.005795] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-14T18:20:19.758911] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-09-14T18:20:20.013523] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-14T18:20:20.422063] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T18:20:20.558841] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-09-14T18:20:21.358869] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-09-14T18:20:21.400030] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T18:20:22.165637] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-09-14T18:20:22.191612] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-14T18:20:22.906131] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T18:20:22.958798] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-09-14T18:20:23.758846] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-09-14T18:20:24.390232] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-14T18:20:24.424757] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T18:20:24.558894] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-09-14T18:20:25.331374] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T18:20:25.358779] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-09-14T18:20:26.158813] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-09-14T18:20:26.636991] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-14T18:20:26.826827] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-14T18:20:26.958843] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-09-14T18:20:27.408917] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T18:20:27.758827] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-09-14T18:20:28.466762] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-14T18:20:28.558804] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-09-14T18:20:29.140048] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-14T18:20:29.145790] [INFO ] [REMOTE ] GSK: Full fetch complete (58180 records). [2025-09-14T18:20:29.145960] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-09-14T18:20:29.366518] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-09-14T18:20:29.534985] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-09-14T18:20:29.535167] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-09-14T18:20:29.536266] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-09-14T18:20:29.536428] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-09-14T18:20:29.546989] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-14T18:20:29.551742] [INFO ] [REMOTE ] GSBD: Full fetch complete (42555 records). [2025-09-14T18:20:29.551908] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-09-14T18:20:29.551993] [DEBUG] [LOCAL ] GSK: Trimmed 58180 records to 40276 (keeping 150 days of data) [2025-09-14T18:20:30.047388] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-09-14T18:20:30.049863] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-09-14T18:20:30.052523] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-09-14T18:20:30.053108] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-09-14T18:20:30.057442] [DEBUG] [LOCAL ] GSBD: Trimmed 42555 records to 28373 (keeping 150 days of data) [2025-09-14T18:20:30.160503] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-09-14T18:20:30.375679] [DEBUG] [LOCAL ] GSBD: Primary data saved (28373 records). [2025-09-14T18:20:30.389017] [INFO ] [MAIN ] GSBD: Full history saved. [2025-09-14T18:20:30.391279] [INFO ] [MAIN ] Update Progress: 975/2370 symbols completed. GSBD took 26.3s. Estimated remaining: 2h 27m 49s. Rate: 9.4 symbols/min [2025-09-14T18:20:30.391057] [DEBUG] [LOCAL ] GSK: Primary data saved (40276 records). [2025-09-14T18:20:30.391458] [INFO ] [MAIN ] GSK: Full history saved. [2025-09-14T18:20:30.437411] [INFO ] [MAIN ] Update Progress: 976/2370 symbols completed. GSK took 25.7s. Estimated remaining: 2h 27m 34s. Rate: 9.4 symbols/min [2025-09-14T18:20:30.751207] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:20:30.753156] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:20:30.787074] [DEBUG] [LOCAL ] GTN: Loaded 20463 existing records from primary storage. [2025-09-14T18:20:30.787513] [DEBUG] [LOCAL ] GTLS: Loaded 20550 existing records from primary storage. [2025-09-14T18:20:30.787856] [INFO ] [MAIN ] GTN: Loaded 20463 existing records. [2025-09-14T18:20:30.787933] [INFO ] [MAIN ] GTLS: Loaded 20550 existing records. [2025-09-14T18:20:31.147566] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:20:31.170847] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-09-14T18:20:31.170673] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:20:31.171201] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-09-14T18:20:31.171604] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-09-14T18:20:31.171921] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-09-14T18:20:31.172363] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-09-14T18:20:31.172551] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-09-14T18:20:31.183807] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-09-14T18:20:31.209899] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-09-14T18:20:31.692465] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-14T18:20:31.842530] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-09-14T18:20:31.906797] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-14T18:20:31.899596] [INFO ] [REMOTE ] GTN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:20:31.980851] [INFO ] [REMOTE ] GSL: Full fetch complete (36995 records). [2025-09-14T18:20:31.981211] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-09-14T18:20:31.984456] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:20:31.985688] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-09-14T18:20:32.369020] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-09-14T18:20:32.369205] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-09-14T18:20:32.369932] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-09-14T18:20:32.370014] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-09-14T18:20:32.370986] [DEBUG] [LOCAL ] GSL: Trimmed 36995 records to 24791 (keeping 150 days of data) [2025-09-14T18:20:32.527881] [DEBUG] [LOCAL ] GSL: Primary data saved (24791 records). [2025-09-14T18:20:32.528057] [INFO ] [MAIN ] GSL: Full history saved. [2025-09-14T18:20:32.528163] [INFO ] [MAIN ] Update Progress: 977/2370 symbols completed. GSL took 26.0s. Estimated remaining: 2h 27m 21s. Rate: 9.5 symbols/min [2025-09-14T18:20:32.571172] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-09-14T18:20:32.698252] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:20:32.712257] [DEBUG] [LOCAL ] GTY: Loaded 13213 existing records from primary storage. [2025-09-14T18:20:32.712425] [INFO ] [MAIN ] GTY: Loaded 13213 existing records. [2025-09-14T18:20:32.925856] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:20:32.926174] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-09-14T18:20:32.926236] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-09-14T18:20:32.926787] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-09-14T18:20:32.926851] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-09-14T18:20:33.289852] [INFO ] [REMOTE ] GTY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:20:33.358791] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-09-14T18:20:33.526275] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T18:20:33.698184] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T18:20:33.903902] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T18:20:34.158853] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-09-14T18:20:34.751452] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T18:20:34.958831] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-09-14T18:20:35.758861] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-09-14T18:20:35.989716] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T18:20:36.340505] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-14T18:20:36.558815] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-09-14T18:20:37.364519] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-09-14T18:20:37.370193] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T18:20:37.890789] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-14T18:20:38.158820] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-09-14T18:20:38.958845] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-09-14T18:20:39.216863] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T18:20:39.642872] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-14T18:20:39.758844] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-09-14T18:20:40.387335] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-14T18:20:40.558898] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-09-14T18:20:40.884862] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-14T18:20:41.358825] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-09-14T18:20:42.164015] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-09-14T18:20:42.184876] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T18:20:42.809507] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-14T18:20:42.958837] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-09-14T18:20:43.707917] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-14T18:20:43.758780] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-09-14T18:20:44.248538] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-14T18:20:44.253870] [INFO ] [REMOTE ] GTES: Full fetch complete (55342 records). [2025-09-14T18:20:44.253998] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-09-14T18:20:44.564108] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-09-14T18:20:44.642593] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-09-14T18:20:44.642758] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-09-14T18:20:44.643871] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-09-14T18:20:44.644029] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-09-14T18:20:44.645613] [DEBUG] [LOCAL ] GTES: Trimmed 55342 records to 37744 (keeping 150 days of data) [2025-09-14T18:20:44.760012] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T18:20:44.908112] [DEBUG] [LOCAL ] GTES: Primary data saved (37744 records). [2025-09-14T18:20:44.908296] [INFO ] [MAIN ] GTES: Full history saved. [2025-09-14T18:20:44.908401] [INFO ] [MAIN ] Update Progress: 978/2370 symbols completed. GTES took 27.6s. Estimated remaining: 2h 27m 23s. Rate: 9.4 symbols/min [2025-09-14T18:20:45.076491] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:20:45.084357] [DEBUG] [LOCAL ] GUG: Loaded 5626 existing records from primary storage. [2025-09-14T18:20:45.084489] [INFO ] [MAIN ] GUG: Loaded 5626 existing records. [2025-09-14T18:20:45.265492] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:20:45.265799] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-09-14T18:20:45.265866] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-09-14T18:20:45.266316] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-09-14T18:20:45.266377] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-09-14T18:20:45.364826] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-09-14T18:20:45.625196] [INFO ] [REMOTE ] GUG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:20:46.158853] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-09-14T18:20:46.370426] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-14T18:20:46.673334] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-14T18:20:46.958877] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-09-14T18:20:47.758830] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-09-14T18:20:47.945101] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T18:20:48.351530] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-14T18:20:48.558857] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-09-14T18:20:48.936012] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-14T18:20:49.358894] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-09-14T18:20:50.035543] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-14T18:20:50.158879] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-09-14T18:20:50.856013] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T18:20:50.958847] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-09-14T18:20:51.050078] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T18:20:51.758842] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-09-14T18:20:52.255266] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-14T18:20:52.360221] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-14T18:20:52.558859] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-09-14T18:20:53.358934] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-09-14T18:20:53.564582] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-14T18:20:54.158878] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-09-14T18:20:54.936878] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-14T18:20:54.941762] [INFO ] [REMOTE ] GTN: Full fetch complete (49928 records). [2025-09-14T18:20:54.941883] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-09-14T18:20:54.964066] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-09-14T18:20:55.334121] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-09-14T18:20:55.334230] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-09-14T18:20:55.334989] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-09-14T18:20:55.335048] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-09-14T18:20:55.336120] [DEBUG] [LOCAL ] GTN: Trimmed 49928 records to 33979 (keeping 150 days of data) [2025-09-14T18:20:55.435485] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T18:20:55.441864] [INFO ] [REMOTE ] GTY: Full fetch complete (32895 records). [2025-09-14T18:20:55.446676] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-09-14T18:20:55.764309] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-09-14T18:20:55.842360] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-09-14T18:20:55.843270] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-09-14T18:20:55.847357] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-09-14T18:20:55.904082] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-09-14T18:20:55.909045] [DEBUG] [LOCAL ] GTY: Trimmed 32895 records to 22048 (keeping 150 days of data) [2025-09-14T18:20:56.051179] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T18:20:56.084787] [DEBUG] [LOCAL ] GTN: Primary data saved (33979 records). [2025-09-14T18:20:56.088256] [INFO ] [MAIN ] GTN: Full history saved. [2025-09-14T18:20:56.091347] [INFO ] [MAIN ] Update Progress: 979/2370 symbols completed. GTN took 25.6s. Estimated remaining: 2h 27m 24s. Rate: 9.4 symbols/min [2025-09-14T18:20:56.171247] [DEBUG] [LOCAL ] GTY: Primary data saved (22048 records). [2025-09-14T18:20:56.181947] [INFO ] [MAIN ] GTY: Full history saved. [2025-09-14T18:20:56.200275] [INFO ] [MAIN ] Update Progress: 980/2370 symbols completed. GTY took 23.7s. Estimated remaining: 2h 27m 9s. Rate: 9.4 symbols/min [2025-09-14T18:20:56.375725] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:20:56.450190] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:20:56.454346] [DEBUG] [LOCAL ] GUT: Loaded 7369 existing records from primary storage. [2025-09-14T18:20:56.454819] [INFO ] [MAIN ] GUT: Loaded 7369 existing records. [2025-09-14T18:20:56.562990] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-09-14T18:20:56.634926] [DEBUG] [LOCAL ] GVA: Loaded 14022 existing records from primary storage. [2025-09-14T18:20:56.651338] [INFO ] [MAIN ] GVA: Loaded 14022 existing records. [2025-09-14T18:20:56.654669] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:20:56.701032] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-09-14T18:20:56.759806] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-09-14T18:20:56.775434] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-09-14T18:20:56.792008] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T18:20:56.792086] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-09-14T18:20:56.870441] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:20:56.954092] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-09-14T18:20:56.955308] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-09-14T18:20:56.994976] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-09-14T18:20:57.032620] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-09-14T18:20:57.366773] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-09-14T18:20:57.370481] [INFO ] [REMOTE ] GUT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:20:57.568674] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-14T18:20:57.588286] [INFO ] [REMOTE ] GVA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:20:57.593851] [INFO ] [REMOTE ] GTLS: Full fetch complete (46477 records). [2025-09-14T18:20:57.593986] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-09-14T18:20:57.965943] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-09-14T18:20:57.966051] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-09-14T18:20:57.966767] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-09-14T18:20:57.966826] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-09-14T18:20:57.967846] [DEBUG] [LOCAL ] GTLS: Trimmed 46477 records to 32460 (keeping 150 days of data) [2025-09-14T18:20:58.160509] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-09-14T18:20:58.185841] [DEBUG] [LOCAL ] GTLS: Primary data saved (32460 records). [2025-09-14T18:20:58.185995] [INFO ] [MAIN ] GTLS: Full history saved. [2025-09-14T18:20:58.186107] [INFO ] [MAIN ] Update Progress: 981/2370 symbols completed. GTLS took 27.8s. Estimated remaining: 2h 26m 56s. Rate: 9.5 symbols/min [2025-09-14T18:20:58.369726] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:20:58.380104] [DEBUG] [LOCAL ] GWH: Loaded 8345 existing records from primary storage. [2025-09-14T18:20:58.380316] [INFO ] [MAIN ] GWH: Loaded 8345 existing records. [2025-09-14T18:20:58.559223] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:20:58.559462] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-09-14T18:20:58.559521] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-09-14T18:20:58.559899] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-09-14T18:20:58.559961] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-09-14T18:20:58.715247] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T18:20:58.953238] [INFO ] [REMOTE ] GWH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:20:58.958788] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-09-14T18:20:59.612702] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T18:20:59.758834] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-09-14T18:20:59.872580] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T18:21:00.558839] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-09-14T18:21:01.358891] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-09-14T18:21:01.795735] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-14T18:21:02.158859] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-09-14T18:21:02.263972] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T18:21:02.958825] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-09-14T18:21:03.758866] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-09-14T18:21:03.998525] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-09-14T18:21:04.558852] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-09-14T18:21:04.734261] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-14T18:21:04.858759] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-14T18:21:05.178077] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-14T18:21:05.219837] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (3.06 seconds). [2025-09-14T18:21:05.358876] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-09-14T18:21:06.158894] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-09-14T18:21:06.944387] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-14T18:21:06.958791] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-09-14T18:21:07.365962] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T18:21:07.758879] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-09-14T18:21:08.338056] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-14T18:21:08.558825] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-09-14T18:21:08.769064] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-14T18:21:09.294572] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T18:21:09.296434] [INFO ] [REMOTE ] GUG: Full fetch complete (13529 records). [2025-09-14T18:21:09.296522] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-09-14T18:21:09.364001] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-09-14T18:21:09.673846] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-09-14T18:21:09.673963] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-09-14T18:21:09.674279] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-09-14T18:21:09.674332] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-09-14T18:21:09.674915] [DEBUG] [LOCAL ] GUG: Trimmed 13529 records to 9060 (keeping 150 days of data) [2025-09-14T18:21:09.731636] [DEBUG] [LOCAL ] GUG: Primary data saved (9060 records). [2025-09-14T18:21:09.731830] [INFO ] [MAIN ] GUG: Full history saved. [2025-09-14T18:21:09.731948] [INFO ] [MAIN ] Update Progress: 982/2370 symbols completed. GUG took 24.8s. Estimated remaining: 2h 26m 57s. Rate: 9.4 symbols/min [2025-09-14T18:21:09.907765] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:21:09.926532] [DEBUG] [LOCAL ] GWRE: Loaded 17831 existing records from primary storage. [2025-09-14T18:21:09.926731] [INFO ] [MAIN ] GWRE: Loaded 17831 existing records. [2025-09-14T18:21:10.102272] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:21:10.102507] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-09-14T18:21:10.102566] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-09-14T18:21:10.103141] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-09-14T18:21:10.103205] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-09-14T18:21:10.165405] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-09-14T18:21:10.459082] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:21:10.468791] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-14T18:21:10.958910] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-09-14T18:21:11.097419] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-14T18:21:11.758880] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-09-14T18:21:12.563914] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-09-14T18:21:12.577753] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-14T18:21:13.305764] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T18:21:13.358868] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-09-14T18:21:13.397015] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T18:21:14.158870] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-09-14T18:21:14.958812] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-09-14T18:21:15.351634] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-14T18:21:15.541524] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-14T18:21:15.758828] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-09-14T18:21:16.558909] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-09-14T18:21:16.645210] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T18:21:17.358816] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-09-14T18:21:17.702297] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T18:21:18.073613] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-14T18:21:18.158828] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-09-14T18:21:18.213947] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-14T18:21:18.771206] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T18:21:18.774479] [INFO ] [REMOTE ] GVA: Full fetch complete (37284 records). [2025-09-14T18:21:18.774594] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-09-14T18:21:18.964058] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-09-14T18:21:19.152249] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-09-14T18:21:19.152355] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-09-14T18:21:19.153028] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-09-14T18:21:19.153095] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-09-14T18:21:19.154034] [DEBUG] [LOCAL ] GVA: Trimmed 37284 records to 24401 (keeping 150 days of data) [2025-09-14T18:21:19.306257] [DEBUG] [LOCAL ] GVA: Primary data saved (24401 records). [2025-09-14T18:21:19.306440] [INFO ] [MAIN ] GVA: Full history saved. [2025-09-14T18:21:19.306581] [INFO ] [MAIN ] Update Progress: 983/2370 symbols completed. GVA took 23.1s. Estimated remaining: 2h 26m 55s. Rate: 9.4 symbols/min [2025-09-14T18:21:19.475340] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:21:19.486134] [DEBUG] [LOCAL ] GWW: Loaded 9228 existing records from primary storage. [2025-09-14T18:21:19.486277] [INFO ] [MAIN ] GWW: Loaded 9228 existing records. [2025-09-14T18:21:19.667559] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:21:19.667861] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-09-14T18:21:19.667934] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-09-14T18:21:19.668324] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-09-14T18:21:19.668384] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-09-14T18:21:19.768246] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-09-14T18:21:19.935394] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-14T18:21:19.961623] [INFO ] [REMOTE ] GUT: Full fetch complete (16905 records). [2025-09-14T18:21:19.962216] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-09-14T18:21:20.172405] [INFO ] [REMOTE ] GWW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:21:20.415890] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-09-14T18:21:20.416014] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-09-14T18:21:20.416587] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-09-14T18:21:20.416678] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-09-14T18:21:20.417306] [DEBUG] [LOCAL ] GUT: Trimmed 16905 records to 11603 (keeping 150 days of data) [2025-09-14T18:21:20.486049] [DEBUG] [LOCAL ] GUT: Primary data saved (11603 records). [2025-09-14T18:21:20.486250] [INFO ] [MAIN ] GUT: Full history saved. [2025-09-14T18:21:20.486414] [INFO ] [MAIN ] Update Progress: 984/2370 symbols completed. GUT took 24.4s. Estimated remaining: 2h 26m 42s. Rate: 9.4 symbols/min [2025-09-14T18:21:20.563971] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-09-14T18:21:20.691129] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:21:20.711409] [DEBUG] [LOCAL ] GXO: Loaded 20413 existing records from primary storage. [2025-09-14T18:21:20.711578] [INFO ] [MAIN ] GXO: Loaded 20413 existing records. [2025-09-14T18:21:20.886507] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:21:20.886814] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-09-14T18:21:20.886892] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-09-14T18:21:20.887494] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-09-14T18:21:20.887570] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-09-14T18:21:21.238796] [INFO ] [REMOTE ] GXO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:21:21.255394] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-14T18:21:21.358816] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-09-14T18:21:22.158874] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-09-14T18:21:22.271015] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-14T18:21:22.316042] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-14T18:21:22.958857] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-09-14T18:21:23.395344] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T18:21:23.611080] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:21:23.612909] [INFO ] [REMOTE ] GWH: Full fetch complete (16184 records). [2025-09-14T18:21:23.613010] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-09-14T18:21:23.767424] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-09-14T18:21:23.994601] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-09-14T18:21:23.994737] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-09-14T18:21:23.995175] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-09-14T18:21:23.995244] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-09-14T18:21:23.995880] [DEBUG] [LOCAL ] GWH: Trimmed 16184 records to 12881 (keeping 150 days of data) [2025-09-14T18:21:24.068692] [DEBUG] [LOCAL ] GWH: Primary data saved (12881 records). [2025-09-14T18:21:24.068880] [INFO ] [MAIN ] GWH: Full history saved. [2025-09-14T18:21:24.068998] [INFO ] [MAIN ] Update Progress: 985/2370 symbols completed. GWH took 25.9s. Estimated remaining: 2h 26m 31s. Rate: 9.5 symbols/min [2025-09-14T18:21:24.243443] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:21:24.246151] [DEBUG] [LOCAL ] GYLD: Loaded 828 existing records from primary storage. [2025-09-14T18:21:24.246250] [INFO ] [MAIN ] GYLD: Loaded 828 existing records. [2025-09-14T18:21:24.421420] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:21:24.421712] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-09-14T18:21:24.421770] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-09-14T18:21:24.421975] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-09-14T18:21:24.422033] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-09-14T18:21:24.565842] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-09-14T18:21:24.780215] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:21:25.138871] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-14T18:21:25.358821] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-09-14T18:21:26.158858] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-09-14T18:21:26.306557] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T18:21:26.368523] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-14T18:21:26.706574] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-14T18:21:26.958843] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-09-14T18:21:27.758830] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-09-14T18:21:28.205028] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T18:21:28.558849] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-09-14T18:21:29.362047] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-09-14T18:21:29.368816] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T18:21:29.613109] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-14T18:21:30.158844] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-09-14T18:21:30.968076] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-09-14T18:21:30.973277] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T18:21:31.468326] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-14T18:21:31.758832] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-09-14T18:21:32.003840] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-14T18:21:32.558831] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-09-14T18:21:33.355968] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-14T18:21:33.363793] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-09-14T18:21:33.708886] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-14T18:21:33.746937] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-14T18:21:34.158830] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-09-14T18:21:34.821678] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:21:34.826188] [INFO ] [REMOTE ] GWRE: Full fetch complete (45372 records). [2025-09-14T18:21:34.826302] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-09-14T18:21:34.970095] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-09-14T18:21:35.210130] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-09-14T18:21:35.210282] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-09-14T18:21:35.211166] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-09-14T18:21:35.211243] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-09-14T18:21:35.212462] [DEBUG] [LOCAL ] GWRE: Trimmed 45372 records to 30251 (keeping 150 days of data) [2025-09-14T18:21:35.404963] [DEBUG] [LOCAL ] GWRE: Primary data saved (30251 records). [2025-09-14T18:21:35.405147] [INFO ] [MAIN ] GWRE: Full history saved. [2025-09-14T18:21:35.405254] [INFO ] [MAIN ] Update Progress: 986/2370 symbols completed. GWRE took 25.7s. Estimated remaining: 2h 26m 32s. Rate: 9.4 symbols/min [2025-09-14T18:21:35.578877] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:21:35.599274] [DEBUG] [LOCAL ] H: Loaded 19974 existing records from primary storage. [2025-09-14T18:21:35.599438] [INFO ] [MAIN ] H: Loaded 19974 existing records. [2025-09-14T18:21:35.773963] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-09-14T18:21:35.779254] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:21:35.780345] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-09-14T18:21:35.780413] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-09-14T18:21:35.781104] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-09-14T18:21:35.781183] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-09-14T18:21:36.154986] [INFO ] [REMOTE ] H: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:21:36.230568] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-14T18:21:36.558821] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-09-14T18:21:36.818264] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T18:21:37.358848] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-09-14T18:21:37.741741] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T18:21:38.158848] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-09-14T18:21:38.582715] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-14T18:21:38.958821] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-09-14T18:21:39.073576] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T18:21:39.441635] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-14T18:21:39.758835] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-09-14T18:21:40.251023] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-14T18:21:40.558865] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-09-14T18:21:41.358847] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-09-14T18:21:41.923961] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-14T18:21:42.158873] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-09-14T18:21:42.958894] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-09-14T18:21:43.150440] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T18:21:43.400973] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T18:21:43.403436] [INFO ] [REMOTE ] GWW: Full fetch complete (21607 records). [2025-09-14T18:21:43.403547] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-09-14T18:21:43.763049] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-09-14T18:21:43.774115] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-09-14T18:21:43.774270] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-09-14T18:21:43.774825] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-09-14T18:21:43.774893] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-09-14T18:21:43.790789] [DEBUG] [LOCAL ] GWW: Trimmed 21607 records to 14121 (keeping 150 days of data) [2025-09-14T18:21:43.814819] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T18:21:43.916039] [DEBUG] [LOCAL ] GWW: Primary data saved (14121 records). [2025-09-14T18:21:43.916196] [INFO ] [MAIN ] GWW: Full history saved. [2025-09-14T18:21:43.916336] [INFO ] [MAIN ] Update Progress: 987/2370 symbols completed. GWW took 24.6s. Estimated remaining: 2h 26m 29s. Rate: 9.4 symbols/min [2025-09-14T18:21:44.083577] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:21:44.101047] [DEBUG] [LOCAL ] HAE: Loaded 17418 existing records from primary storage. [2025-09-14T18:21:44.101202] [INFO ] [MAIN ] HAE: Loaded 17418 existing records. [2025-09-14T18:21:44.275691] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:21:44.275967] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-09-14T18:21:44.276042] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-09-14T18:21:44.276586] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-09-14T18:21:44.276674] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-09-14T18:21:44.563425] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-09-14T18:21:44.657771] [INFO ] [REMOTE ] HAE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:21:45.072455] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T18:21:45.073423] [INFO ] [REMOTE ] GYLD: Full fetch complete (1632 records). [2025-09-14T18:21:45.073524] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-09-14T18:21:45.361439] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-09-14T18:21:45.457803] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-09-14T18:21:45.457948] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-09-14T18:21:45.458077] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-09-14T18:21:45.458472] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-09-14T18:21:45.459124] [DEBUG] [LOCAL ] GYLD: Trimmed 1632 records to 1127 (keeping 150 days of data) [2025-09-14T18:21:45.469590] [DEBUG] [LOCAL ] GYLD: Primary data saved (1127 records). [2025-09-14T18:21:45.469854] [INFO ] [MAIN ] GYLD: Full history saved. [2025-09-14T18:21:45.470053] [INFO ] [MAIN ] Update Progress: 988/2370 symbols completed. GYLD took 21.4s. Estimated remaining: 2h 26m 16s. Rate: 9.4 symbols/min [2025-09-14T18:21:45.741072] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:21:45.803771] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-14T18:21:45.843367] [DEBUG] [LOCAL ] HAFN: Loaded 18589 existing records from primary storage. [2025-09-14T18:21:45.845113] [INFO ] [MAIN ] HAFN: Loaded 18589 existing records. [2025-09-14T18:21:46.126933] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:21:46.128890] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-09-14T18:21:46.128989] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-09-14T18:21:46.129749] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-09-14T18:21:46.131163] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-09-14T18:21:46.168016] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-09-14T18:21:46.624466] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:21:46.958899] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-09-14T18:21:47.087233] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T18:21:47.758916] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-09-14T18:21:47.918541] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-14T18:21:48.558862] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-09-14T18:21:48.598997] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T18:21:49.358870] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-09-14T18:21:49.408452] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-14T18:21:50.106495] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T18:21:50.158777] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-09-14T18:21:50.948596] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T18:21:50.958777] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-09-14T18:21:51.758907] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-09-14T18:21:51.981361] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T18:21:52.435493] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T18:21:52.558811] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-09-14T18:21:53.002878] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-14T18:21:53.358848] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-09-14T18:21:53.898763] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-14T18:21:54.158861] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-09-14T18:21:54.897285] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T18:21:54.958859] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-09-14T18:21:55.671238] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T18:21:55.758855] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-09-14T18:21:56.422003] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:21:56.426614] [INFO ] [REMOTE ] H: Full fetch complete (49058 records). [2025-09-14T18:21:56.426757] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-09-14T18:21:56.568939] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-09-14T18:21:56.808805] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-09-14T18:21:56.808925] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-09-14T18:21:56.809708] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-09-14T18:21:56.809774] [DEBUG] [LOCAL ] H: Saving primary data. [2025-09-14T18:21:56.810819] [DEBUG] [LOCAL ] H: Trimmed 49058 records to 33612 (keeping 150 days of data) [2025-09-14T18:21:56.934392] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-14T18:21:57.076912] [DEBUG] [LOCAL ] H: Primary data saved (33612 records). [2025-09-14T18:21:57.077096] [INFO ] [MAIN ] H: Full history saved. [2025-09-14T18:21:57.077237] [INFO ] [MAIN ] Update Progress: 989/2370 symbols completed. H took 21.7s. Estimated remaining: 2h 26m 17s. Rate: 9.4 symbols/min [2025-09-14T18:21:57.250970] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:21:57.274293] [DEBUG] [LOCAL ] HAL: Loaded 24078 existing records from primary storage. [2025-09-14T18:21:57.274470] [INFO ] [MAIN ] HAL: Loaded 24078 existing records. [2025-09-14T18:21:57.364237] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-09-14T18:21:57.453103] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:21:57.453359] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-09-14T18:21:57.453419] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-09-14T18:21:57.454151] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-09-14T18:21:57.454216] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-09-14T18:21:57.807668] [INFO ] [REMOTE ] HAL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:21:58.113001] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-14T18:21:58.158848] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-09-14T18:21:58.925307] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-14T18:21:58.958782] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-09-14T18:21:59.694816] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T18:21:59.758813] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-09-14T18:22:00.558864] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-09-14T18:22:00.710544] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T18:22:01.320458] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T18:22:01.358792] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-09-14T18:22:02.042173] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:22:02.051106] [INFO ] [REMOTE ] HAE: Full fetch complete (43964 records). [2025-09-14T18:22:02.051343] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-09-14T18:22:02.163988] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-09-14T18:22:02.424067] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-09-14T18:22:02.424175] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-09-14T18:22:02.424918] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-09-14T18:22:02.424991] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-09-14T18:22:02.426023] [DEBUG] [LOCAL ] HAE: Trimmed 43964 records to 28379 (keeping 150 days of data) [2025-09-14T18:22:02.597832] [DEBUG] [LOCAL ] HAE: Primary data saved (28379 records). [2025-09-14T18:22:02.598004] [INFO ] [MAIN ] HAE: Full history saved. [2025-09-14T18:22:02.598152] [INFO ] [MAIN ] Update Progress: 990/2370 symbols completed. HAE took 18.7s. Estimated remaining: 2h 26m 9s. Rate: 9.4 symbols/min [2025-09-14T18:22:02.767735] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:22:02.810468] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-14T18:22:02.829202] [DEBUG] [LOCAL ] HASI: Loaded 21285 existing records from primary storage. [2025-09-14T18:22:02.829369] [INFO ] [MAIN ] HASI: Loaded 21285 existing records. [2025-09-14T18:22:02.972778] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-09-14T18:22:03.012141] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:22:03.012419] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-09-14T18:22:03.012482] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-09-14T18:22:03.013160] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-09-14T18:22:03.013226] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-09-14T18:22:03.365629] [INFO ] [REMOTE ] HASI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:22:03.758894] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-09-14T18:22:03.920137] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T18:22:04.062766] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-14T18:22:04.068288] [INFO ] [REMOTE ] GXO: Full fetch complete (52543 records). [2025-09-14T18:22:04.068414] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-09-14T18:22:04.462780] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-09-14T18:22:04.462908] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-09-14T18:22:04.463684] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-09-14T18:22:04.463742] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-09-14T18:22:04.464999] [DEBUG] [LOCAL ] GXO: Trimmed 52543 records to 34988 (keeping 150 days of data) [2025-09-14T18:22:04.560598] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-09-14T18:22:04.702385] [DEBUG] [LOCAL ] GXO: Primary data saved (34988 records). [2025-09-14T18:22:04.702576] [INFO ] [MAIN ] GXO: Full history saved. [2025-09-14T18:22:04.702722] [INFO ] [MAIN ] Update Progress: 991/2370 symbols completed. GXO took 44.2s. Estimated remaining: 2h 25m 57s. Rate: 9.4 symbols/min [2025-09-14T18:22:04.881726] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:22:04.906560] [DEBUG] [LOCAL ] HAYW: Loaded 21960 existing records from primary storage. [2025-09-14T18:22:04.906780] [INFO ] [MAIN ] HAYW: Loaded 21960 existing records. [2025-09-14T18:22:05.092946] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:22:05.093307] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-09-14T18:22:05.093496] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-09-14T18:22:05.094218] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-09-14T18:22:05.094290] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-09-14T18:22:05.389577] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-09-14T18:22:05.499202] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-09-14T18:22:05.546010] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:22:05.964245] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-14T18:22:06.158839] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-09-14T18:22:06.958870] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-09-14T18:22:07.160260] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T18:22:07.467710] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-14T18:22:07.758846] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-09-14T18:22:08.558885] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-09-14T18:22:09.047807] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-14T18:22:09.358865] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-09-14T18:22:09.590321] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-14T18:22:10.158841] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-09-14T18:22:10.284195] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T18:22:10.685764] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-14T18:22:10.690428] [INFO ] [REMOTE ] HAFN: Full fetch complete (48471 records). [2025-09-14T18:22:10.690584] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-09-14T18:22:10.963950] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-09-14T18:22:11.106739] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-09-14T18:22:11.106863] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-09-14T18:22:11.107672] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-09-14T18:22:11.107750] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-09-14T18:22:11.109312] [DEBUG] [LOCAL ] HAFN: Trimmed 48471 records to 32231 (keeping 150 days of data) [2025-09-14T18:22:11.305411] [DEBUG] [LOCAL ] HAFN: Primary data saved (32231 records). [2025-09-14T18:22:11.305625] [INFO ] [MAIN ] HAFN: Full history saved. [2025-09-14T18:22:11.305779] [INFO ] [MAIN ] Update Progress: 992/2370 symbols completed. HAFN took 25.8s. Estimated remaining: 2h 25m 51s. Rate: 9.4 symbols/min [2025-09-14T18:22:11.472667] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:22:11.477213] [DEBUG] [LOCAL ] HBB: Loaded 2448 existing records from primary storage. [2025-09-14T18:22:11.477331] [INFO ] [MAIN ] HBB: Loaded 2448 existing records. [2025-09-14T18:22:11.659127] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:22:11.659431] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-09-14T18:22:11.659494] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-09-14T18:22:11.659800] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-09-14T18:22:11.659862] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-09-14T18:22:11.765057] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-09-14T18:22:12.036685] [INFO ] [REMOTE ] HBB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:22:12.068436] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T18:22:12.558910] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-09-14T18:22:12.800727] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-14T18:22:13.358932] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-09-14T18:22:13.992840] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-14T18:22:14.158844] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-09-14T18:22:14.253658] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T18:22:14.588976] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-14T18:22:14.958886] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-09-14T18:22:15.103338] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-14T18:22:15.758862] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-09-14T18:22:16.558855] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-09-14T18:22:16.620849] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-14T18:22:17.358839] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-09-14T18:22:17.501579] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T18:22:18.158933] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-09-14T18:22:18.729561] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-14T18:22:18.798593] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T18:22:18.943228] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-14T18:22:18.958785] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-09-14T18:22:19.608269] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:22:19.615268] [INFO ] [REMOTE ] HASI: Full fetch complete (51428 records). [2025-09-14T18:22:19.615450] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-09-14T18:22:19.765108] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-09-14T18:22:20.015112] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-09-14T18:22:20.015237] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-09-14T18:22:20.016154] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-09-14T18:22:20.016220] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-09-14T18:22:20.017359] [DEBUG] [LOCAL ] HASI: Trimmed 51428 records to 35913 (keeping 150 days of data) [2025-09-14T18:22:20.256595] [DEBUG] [LOCAL ] HASI: Primary data saved (35913 records). [2025-09-14T18:22:20.256783] [INFO ] [MAIN ] HASI: Full history saved. [2025-09-14T18:22:20.256880] [INFO ] [MAIN ] Update Progress: 993/2370 symbols completed. HASI took 17.7s. Estimated remaining: 2h 25m 48s. Rate: 9.4 symbols/min [2025-09-14T18:22:20.434850] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:22:20.457862] [DEBUG] [LOCAL ] HBI: Loaded 23612 existing records from primary storage. [2025-09-14T18:22:20.458040] [INFO ] [MAIN ] HBI: Loaded 23612 existing records. [2025-09-14T18:22:20.561298] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-09-14T18:22:20.641073] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:22:20.641308] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-09-14T18:22:20.641369] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-09-14T18:22:20.642109] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-09-14T18:22:20.642175] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-09-14T18:22:20.988531] [INFO ] [REMOTE ] HBI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:22:21.358841] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-09-14T18:22:22.027188] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-14T18:22:22.069350] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T18:22:22.158829] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-09-14T18:22:22.820576] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T18:22:22.958836] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-09-14T18:22:23.758905] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-09-14T18:22:23.833993] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-14T18:22:23.882456] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T18:22:24.558837] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-09-14T18:22:25.358873] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-09-14T18:22:25.607160] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-14T18:22:25.813608] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T18:22:26.158855] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-09-14T18:22:26.947758] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-14T18:22:26.958771] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-09-14T18:22:27.038554] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-14T18:22:27.549722] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-14T18:22:27.758880] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-09-14T18:22:28.558879] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-09-14T18:22:29.271621] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-14T18:22:29.358820] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-09-14T18:22:29.414675] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T18:22:30.029580] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:22:30.035010] [INFO ] [REMOTE ] HAYW: Full fetch complete (53022 records). [2025-09-14T18:22:30.035122] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-09-14T18:22:30.164075] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-09-14T18:22:30.435046] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-09-14T18:22:30.435161] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-09-14T18:22:30.436036] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-09-14T18:22:30.436102] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-09-14T18:22:30.437328] [DEBUG] [LOCAL ] HAYW: Trimmed 53022 records to 36396 (keeping 150 days of data) [2025-09-14T18:22:30.659825] [DEBUG] [LOCAL ] HAYW: Primary data saved (36396 records). [2025-09-14T18:22:30.660002] [INFO ] [MAIN ] HAYW: Full history saved. [2025-09-14T18:22:30.660104] [INFO ] [MAIN ] Update Progress: 994/2370 symbols completed. HAYW took 26.0s. Estimated remaining: 2h 25m 47s. Rate: 9.4 symbols/min [2025-09-14T18:22:30.832445] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:22:30.854830] [DEBUG] [LOCAL ] HBM: Loaded 23717 existing records from primary storage. [2025-09-14T18:22:30.854999] [INFO ] [MAIN ] HBM: Loaded 23717 existing records. [2025-09-14T18:22:30.968975] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-09-14T18:22:31.042316] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:22:31.042797] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-09-14T18:22:31.043039] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-09-14T18:22:31.058053] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-14T18:22:31.058122] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-09-14T18:22:31.058369] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-09-14T18:22:31.135027] [INFO ] [REMOTE ] HAL: Full fetch complete (58397 records). [2025-09-14T18:22:31.167514] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-09-14T18:22:31.723708] [INFO ] [REMOTE ] HBM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:22:31.767004] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-09-14T18:22:31.819636] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-09-14T18:22:31.819962] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-09-14T18:22:31.820937] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-09-14T18:22:31.826807] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-09-14T18:22:31.827865] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-14T18:22:31.831612] [DEBUG] [LOCAL ] HAL: Trimmed 58397 records to 40458 (keeping 150 days of data) [2025-09-14T18:22:32.099494] [DEBUG] [LOCAL ] HAL: Primary data saved (40458 records). [2025-09-14T18:22:32.099677] [INFO ] [MAIN ] HAL: Full history saved. [2025-09-14T18:22:32.099780] [INFO ] [MAIN ] Update Progress: 995/2370 symbols completed. HAL took 35.0s. Estimated remaining: 2h 25m 34s. Rate: 9.4 symbols/min [2025-09-14T18:22:32.268285] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:22:32.288859] [DEBUG] [LOCAL ] HCA: Loaded 21104 existing records from primary storage. [2025-09-14T18:22:32.289036] [INFO ] [MAIN ] HCA: Loaded 21104 existing records. [2025-09-14T18:22:32.472796] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:22:32.473269] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-09-14T18:22:32.473331] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-09-14T18:22:32.474023] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-09-14T18:22:32.474084] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-09-14T18:22:32.563963] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-09-14T18:22:32.830552] [INFO ] [REMOTE ] HCA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:22:33.089421] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T18:22:33.090415] [INFO ] [REMOTE ] HBB: Full fetch complete (7591 records). [2025-09-14T18:22:33.090501] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-09-14T18:22:33.366071] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-09-14T18:22:33.457875] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-09-14T18:22:33.458093] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-09-14T18:22:33.458315] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-09-14T18:22:33.458384] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-09-14T18:22:33.459183] [DEBUG] [LOCAL ] HBB: Trimmed 7591 records to 4952 (keeping 150 days of data) [2025-09-14T18:22:33.515388] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T18:22:33.528863] [DEBUG] [LOCAL ] HBB: Primary data saved (4952 records). [2025-09-14T18:22:33.528962] [INFO ] [MAIN ] HBB: Full history saved. [2025-09-14T18:22:33.529065] [INFO ] [MAIN ] Update Progress: 996/2370 symbols completed. HBB took 22.2s. Estimated remaining: 2h 25m 21s. Rate: 9.5 symbols/min [2025-09-14T18:22:33.697917] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:22:33.717342] [DEBUG] [LOCAL ] HCC: Loaded 20233 existing records from primary storage. [2025-09-14T18:22:33.717495] [INFO ] [MAIN ] HCC: Loaded 20233 existing records. [2025-09-14T18:22:33.898073] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:22:33.898354] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-09-14T18:22:33.898415] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-09-14T18:22:33.899124] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-09-14T18:22:33.899190] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-09-14T18:22:34.169436] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-09-14T18:22:34.261818] [INFO ] [REMOTE ] HCC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:22:34.958832] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-09-14T18:22:35.151906] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T18:22:35.758827] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-09-14T18:22:36.120850] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-14T18:22:36.209416] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-14T18:22:36.558826] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-09-14T18:22:37.358837] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-09-14T18:22:37.652996] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-14T18:22:38.158881] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-09-14T18:22:38.549232] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-14T18:22:38.944526] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T18:22:38.958784] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-09-14T18:22:39.670803] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T18:22:39.758837] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-09-14T18:22:40.558860] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-09-14T18:22:40.773258] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T18:22:41.358842] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-09-14T18:22:41.633359] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T18:22:42.158848] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-09-14T18:22:42.378331] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T18:22:42.958865] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-09-14T18:22:43.037245] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-14T18:22:43.758827] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-09-14T18:22:43.861806] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T18:22:44.563886] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-09-14T18:22:44.578764] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-14T18:22:45.364883] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-09-14T18:22:45.379675] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-14T18:22:45.987042] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T18:22:46.158837] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-09-14T18:22:46.803683] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-14T18:22:46.958893] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-09-14T18:22:47.711606] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T18:22:47.758837] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-09-14T18:22:48.558839] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-09-14T18:22:48.734779] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-14T18:22:49.358813] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-09-14T18:22:49.453421] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T18:22:50.158830] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-09-14T18:22:50.413320] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-14T18:22:50.565185] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T18:22:50.570201] [INFO ] [REMOTE ] HCA: Full fetch complete (51838 records). [2025-09-14T18:22:50.570343] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-09-14T18:22:50.951953] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-09-14T18:22:50.952093] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-09-14T18:22:50.953046] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-09-14T18:22:50.953242] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-09-14T18:22:50.954928] [DEBUG] [LOCAL ] HCA: Trimmed 51838 records to 35505 (keeping 150 days of data) [2025-09-14T18:22:51.016418] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-09-14T18:22:51.090149] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T18:22:51.235540] [DEBUG] [LOCAL ] HCA: Primary data saved (35505 records). [2025-09-14T18:22:51.235780] [INFO ] [MAIN ] HCA: Full history saved. [2025-09-14T18:22:51.235911] [INFO ] [MAIN ] Update Progress: 997/2370 symbols completed. HCA took 19.1s. Estimated remaining: 2h 25m 30s. Rate: 9.4 symbols/min [2025-09-14T18:22:51.758847] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-09-14T18:22:52.558890] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-09-14T18:22:52.861829] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-14T18:22:53.182160] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-14T18:22:53.208833] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:22:53.213433] [INFO ] [REMOTE ] HCC: Full fetch complete (49518 records). [2025-09-14T18:22:53.213548] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-09-14T18:22:53.367546] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-09-14T18:22:53.596149] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-09-14T18:22:53.596287] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-09-14T18:22:53.597118] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-09-14T18:22:53.597182] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-09-14T18:22:53.598772] [DEBUG] [LOCAL ] HCC: Trimmed 49518 records to 34006 (keeping 150 days of data) [2025-09-14T18:22:53.811820] [DEBUG] [LOCAL ] HCC: Primary data saved (34006 records). [2025-09-14T18:22:53.812001] [INFO ] [MAIN ] HCC: Full history saved. [2025-09-14T18:22:53.812106] [INFO ] [MAIN ] Update Progress: 998/2370 symbols completed. HCC took 20.3s. Estimated remaining: 2h 25m 19s. Rate: 9.4 symbols/min [2025-09-14T18:22:54.158845] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-09-14T18:22:54.823173] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:22:54.828664] [INFO ] [REMOTE ] HBI: Full fetch complete (57719 records). [2025-09-14T18:22:54.828827] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-09-14T18:22:55.216516] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-09-14T18:22:55.216870] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-09-14T18:22:55.217853] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-09-14T18:22:55.217988] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-09-14T18:22:55.219502] [DEBUG] [LOCAL ] HBI: Trimmed 57719 records to 39850 (keeping 150 days of data) [2025-09-14T18:22:55.332531] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-14T18:22:55.346724] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-09-14T18:22:55.485721] [DEBUG] [LOCAL ] HBI: Primary data saved (39850 records). [2025-09-14T18:22:55.485898] [INFO ] [MAIN ] HBI: Full history saved. [2025-09-14T18:22:55.486013] [INFO ] [MAIN ] Update Progress: 999/2370 symbols completed. HBI took 35.2s. Estimated remaining: 2h 25m 6s. Rate: 9.4 symbols/min [2025-09-14T18:22:57.005480] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-14T18:22:57.011279] [INFO ] [REMOTE ] HBM: Full fetch complete (57550 records). [2025-09-14T18:22:57.011474] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-09-14T18:22:57.398028] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-09-14T18:22:57.398165] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-09-14T18:22:57.399019] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-09-14T18:22:57.399093] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-09-14T18:22:57.400320] [DEBUG] [LOCAL ] HBM: Trimmed 57550 records to 39770 (keeping 150 days of data) [2025-09-14T18:22:57.692468] [DEBUG] [LOCAL ] HBM: Primary data saved (39770 records). [2025-09-14T18:22:57.692713] [INFO ] [MAIN ] HBM: Full history saved. [2025-09-14T18:22:57.692883] [INFO ] [MAIN ] Update Progress: 1000/2370 symbols completed. HBM took 27.0s. Estimated remaining: 2h 24m 54s. Rate: 9.5 symbols/min [2025-09-14T18:22:58.441415] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:22:58.635971] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:22:58.588246] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:22:58.682375] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:22:58.683099] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-09-14T18:22:58.684066] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-09-14T18:22:58.690092] [DEBUG] [LOCAL ] HCI: Loaded 6530 existing records from primary storage. [2025-09-14T18:22:58.690503] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-09-14T18:22:58.690944] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-14T18:22:58.691077] [INFO ] [MAIN ] HCI: Loaded 6530 existing records. [2025-09-14T18:22:58.691225] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-14T18:22:58.755217] [DEBUG] [LOCAL ] HCXY: Removed from QA tracker. [2025-09-14T18:22:58.806008] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-09-14T18:22:58.900552] [DEBUG] [LOCAL ] HDB: Loaded 22844 existing records from primary storage. [2025-09-14T18:22:58.986174] [DEBUG] [LOCAL ] HD: Loaded 24024 existing records from primary storage. [2025-09-14T18:22:58.955841] [INFO ] [MAIN ] HDB: Loaded 22844 existing records. [2025-09-14T18:22:59.097432] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:22:59.111029] [INFO ] [MAIN ] HD: Loaded 24024 existing records. [2025-09-14T18:22:59.257127] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-09-14T18:22:59.351609] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-09-14T18:22:59.489375] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-09-14T18:22:59.545682] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-09-14T18:22:59.601886] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:22:59.650310] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-09-14T18:22:59.719155] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:22:59.802397] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-09-14T18:22:59.826248] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-09-14T18:22:59.841529] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:22:59.852019] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-09-14T18:22:59.884776] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-09-14T18:22:59.916197] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-09-14T18:22:59.926200] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-09-14T18:22:59.962140] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-09-14T18:22:59.962222] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-09-14T18:23:00.211454] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-14T18:23:00.276621] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-09-14T18:23:00.381362] [INFO ] [REMOTE ] HCI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:23:00.408768] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-09-14T18:23:00.726155] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-14T18:23:00.809776] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-09-14T18:23:00.813913] [INFO ] [REMOTE ] HDB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:23:00.832373] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-09-14T18:23:00.836108] [INFO ] [REMOTE ] HD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:23:00.837395] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-09-14T18:23:01.036170] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-09-14T18:23:01.037096] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-09-14T18:23:01.242989] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.21 seconds). [2025-09-14T18:23:01.358828] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-09-14T18:23:04.915414] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (3.56 seconds). [2025-09-14T18:23:04.916382] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-09-14T18:23:05.219291] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-14T18:23:05.220252] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-09-14T18:23:05.288098] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (4.46 seconds). [2025-09-14T18:23:05.298123] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-09-14T18:23:05.481508] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (5.07 seconds). [2025-09-14T18:23:05.484358] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-09-14T18:23:05.672017] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-14T18:23:05.673081] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-14T18:23:05.895773] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-09-14T18:23:05.896526] [INFO ] [REMOTE ] HCXY: Full fetch complete (388 records). [2025-09-14T18:23:05.896615] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-09-14T18:23:05.897045] [FATAL] [VALIDATOR ] HCXY: Data is stale - most recent date (2025-09-11) is before last completed trading day (2025-09-12). Symbol may be delisted or halted. [2025-09-14T18:23:05.897122] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:23:05.897198] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:23:05.897268] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-14T18:23:05.897347] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-14T18:23:05.897404] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-14T18:23:05.897486] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-09-14T18:23:05.897579] [INFO ] [MAIN ] Update Progress: 1001/2370 symbols completed. HCXY took 8.2s. Estimated remaining: 2h 24m 50s. Rate: 9.5 symbols/min [2025-09-14T18:23:06.079081] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:23:06.115374] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T18:23:06.141270] [DEBUG] [LOCAL ] HE: Loaded 21983 existing records from primary storage. [2025-09-14T18:23:06.141540] [INFO ] [MAIN ] HE: Loaded 21983 existing records. [2025-09-14T18:23:06.163887] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-09-14T18:23:06.328882] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:23:06.329288] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-09-14T18:23:06.329368] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-09-14T18:23:06.343938] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-09-14T18:23:06.367072] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-09-14T18:23:06.458179] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (5.62 seconds). [2025-09-14T18:23:06.717491] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-14T18:23:06.779900] [INFO ] [REMOTE ] HE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:23:06.958853] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-09-14T18:23:07.145362] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-14T18:23:07.758837] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-09-14T18:23:08.558886] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-09-14T18:23:08.852246] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-14T18:23:08.904697] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-14T18:23:09.358824] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-09-14T18:23:09.557106] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-14T18:23:10.087628] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-14T18:23:10.158870] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-09-14T18:23:10.958841] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-09-14T18:23:11.086475] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-14T18:23:11.758808] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-09-14T18:23:12.103956] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-14T18:23:12.558896] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-09-14T18:23:12.620821] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T18:23:13.358884] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-09-14T18:23:13.583506] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-14T18:23:14.158830] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-09-14T18:23:14.282001] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-14T18:23:14.963910] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-09-14T18:23:14.993881] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-14T18:23:15.758853] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-09-14T18:23:16.558836] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-09-14T18:23:16.895892] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T18:23:16.918491] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T18:23:17.358944] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-09-14T18:23:17.361713] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-14T18:23:18.158877] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-09-14T18:23:18.290430] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T18:23:18.878585] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T18:23:18.884031] [INFO ] [REMOTE ] HDB: Full fetch complete (56493 records). [2025-09-14T18:23:18.884179] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-09-14T18:23:18.963901] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-09-14T18:23:19.276035] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-09-14T18:23:19.276151] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-09-14T18:23:19.277051] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-09-14T18:23:19.277120] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-09-14T18:23:19.278352] [DEBUG] [LOCAL ] HDB: Trimmed 56493 records to 38803 (keeping 150 days of data) [2025-09-14T18:23:19.531328] [DEBUG] [LOCAL ] HDB: Primary data saved (38803 records). [2025-09-14T18:23:19.531541] [INFO ] [MAIN ] HDB: Full history saved. [2025-09-14T18:23:19.531687] [INFO ] [MAIN ] Update Progress: 1002/2370 symbols completed. HDB took 21.8s. Estimated remaining: 2h 24m 54s. Rate: 9.4 symbols/min [2025-09-14T18:23:19.723128] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:23:19.738331] [DEBUG] [LOCAL ] HEI: Loaded 13360 existing records from primary storage. [2025-09-14T18:23:19.738500] [INFO ] [MAIN ] HEI: Loaded 13360 existing records. [2025-09-14T18:23:19.768711] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-09-14T18:23:19.921478] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:23:19.921778] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-09-14T18:23:19.921855] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-09-14T18:23:19.922312] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-09-14T18:23:19.922375] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-09-14T18:23:20.241782] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-14T18:23:20.322062] [INFO ] [REMOTE ] HEI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:23:20.558832] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-09-14T18:23:21.358838] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-09-14T18:23:21.630670] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-14T18:23:21.632545] [INFO ] [REMOTE ] HCI: Full fetch complete (14889 records). [2025-09-14T18:23:21.632632] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-09-14T18:23:21.956945] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-14T18:23:22.043933] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-09-14T18:23:22.044192] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-09-14T18:23:22.044613] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-09-14T18:23:22.044759] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-09-14T18:23:22.045580] [DEBUG] [LOCAL ] HCI: Trimmed 14889 records to 10468 (keeping 150 days of data) [2025-09-14T18:23:22.121352] [DEBUG] [LOCAL ] HCI: Primary data saved (10468 records). [2025-09-14T18:23:22.121829] [INFO ] [MAIN ] HCI: Full history saved. [2025-09-14T18:23:22.122067] [INFO ] [MAIN ] Update Progress: 1003/2370 symbols completed. HCI took 24.4s. Estimated remaining: 2h 24m 42s. Rate: 9.4 symbols/min [2025-09-14T18:23:22.164119] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-09-14T18:23:22.312700] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T18:23:22.339541] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:23:22.344684] [DEBUG] [LOCAL ] HEQ: Loaded 2530 existing records from primary storage. [2025-09-14T18:23:22.344785] [INFO ] [MAIN ] HEQ: Loaded 2530 existing records. [2025-09-14T18:23:22.525484] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:23:22.525796] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-09-14T18:23:22.525861] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-09-14T18:23:22.526112] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-09-14T18:23:22.526170] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-09-14T18:23:22.879094] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:23:22.958846] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-09-14T18:23:23.601877] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-14T18:23:23.674539] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T18:23:23.758900] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-09-14T18:23:24.558838] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-09-14T18:23:24.794380] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-14T18:23:24.994827] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-14T18:23:25.358828] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-09-14T18:23:26.158876] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-09-14T18:23:26.950908] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T18:23:26.959027] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-09-14T18:23:27.758829] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-09-14T18:23:27.814857] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T18:23:28.305049] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T18:23:28.314895] [INFO ] [REMOTE ] HD: Full fetch complete (58166 records). [2025-09-14T18:23:28.315080] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-09-14T18:23:28.492836] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-14T18:23:28.564265] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-09-14T18:23:28.728980] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-09-14T18:23:28.729095] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-09-14T18:23:28.730133] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-09-14T18:23:28.730200] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-09-14T18:23:28.731482] [DEBUG] [LOCAL ] HD: Trimmed 58166 records to 40285 (keeping 150 days of data) [2025-09-14T18:23:28.995326] [DEBUG] [LOCAL ] HD: Primary data saved (40285 records). [2025-09-14T18:23:28.995481] [INFO ] [MAIN ] HD: Full history saved. [2025-09-14T18:23:28.995621] [INFO ] [MAIN ] Update Progress: 1004/2370 symbols completed. HD took 31.3s. Estimated remaining: 2h 24m 37s. Rate: 9.4 symbols/min [2025-09-14T18:23:29.103991] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-14T18:23:29.175420] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:23:29.198855] [DEBUG] [LOCAL ] HESM: Loaded 22408 existing records from primary storage. [2025-09-14T18:23:29.199027] [INFO ] [MAIN ] HESM: Loaded 22408 existing records. [2025-09-14T18:23:29.367941] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-09-14T18:23:29.389278] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:23:29.390760] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-09-14T18:23:29.390830] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-09-14T18:23:29.391610] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-09-14T18:23:29.391715] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-09-14T18:23:29.748962] [INFO ] [REMOTE ] HESM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:23:30.158897] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-09-14T18:23:30.960534] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-09-14T18:23:30.962573] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-14T18:23:31.092365] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-14T18:23:31.758888] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-09-14T18:23:32.558830] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-09-14T18:23:32.731126] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T18:23:32.931219] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-14T18:23:33.253444] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-14T18:23:33.358829] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-09-14T18:23:34.158855] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-09-14T18:23:34.958909] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-09-14T18:23:35.158822] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-14T18:23:35.532859] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T18:23:35.758905] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-09-14T18:23:36.424677] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T18:23:36.558889] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-09-14T18:23:37.073197] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T18:23:37.079569] [INFO ] [REMOTE ] HE: Full fetch complete (53956 records). [2025-09-14T18:23:37.079962] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-09-14T18:23:37.139209] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-14T18:23:37.366229] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-09-14T18:23:37.514659] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-09-14T18:23:37.514798] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-09-14T18:23:37.515654] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-09-14T18:23:37.515721] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-09-14T18:23:37.517084] [DEBUG] [LOCAL ] HE: Trimmed 53956 records to 36684 (keeping 150 days of data) [2025-09-14T18:23:37.755117] [DEBUG] [LOCAL ] HE: Primary data saved (36684 records). [2025-09-14T18:23:37.755401] [INFO ] [MAIN ] HE: Full history saved. [2025-09-14T18:23:37.755569] [INFO ] [MAIN ] Update Progress: 1005/2370 symbols completed. HE took 31.9s. Estimated remaining: 2h 24m 34s. Rate: 9.4 symbols/min [2025-09-14T18:23:37.956086] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:23:37.958911] [DEBUG] [LOCAL ] HF: Loaded 93 existing records from primary storage. [2025-09-14T18:23:37.959064] [INFO ] [MAIN ] HF: Loaded 93 existing records. [2025-09-14T18:23:38.155770] [WARN ] [MAIN ] HF: Insufficient historical data. Have data from 2025-06-17, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:23:38.156110] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-09-14T18:23:38.156175] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-14T18:23:38.156444] [DEBUG] [LOCAL ] HF: Deleted primary data file. [2025-09-14T18:23:38.157067] [DEBUG] [LOCAL ] HF: Removed from QA tracker. [2025-09-14T18:23:38.157140] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-09-14T18:23:38.169476] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-09-14T18:23:38.546843] [INFO ] [REMOTE ] HF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:23:38.958842] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-09-14T18:23:39.124550] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-14T18:23:39.613050] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-14T18:23:39.637347] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T18:23:39.758780] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-09-14T18:23:40.558820] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-09-14T18:23:41.018007] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-14T18:23:41.021383] [INFO ] [REMOTE ] HEI: Full fetch complete (36458 records). [2025-09-14T18:23:41.021556] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-09-14T18:23:41.367830] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-09-14T18:23:41.423027] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-09-14T18:23:41.423158] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-09-14T18:23:41.424366] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-09-14T18:23:41.424444] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-09-14T18:23:41.426346] [DEBUG] [LOCAL ] HEI: Trimmed 36458 records to 23960 (keeping 150 days of data) [2025-09-14T18:23:41.599352] [DEBUG] [LOCAL ] HEI: Primary data saved (23960 records). [2025-09-14T18:23:41.599533] [INFO ] [MAIN ] HEI: Full history saved. [2025-09-14T18:23:41.599683] [INFO ] [MAIN ] Update Progress: 1006/2370 symbols completed. HEI took 22.1s. Estimated remaining: 2h 24m 24s. Rate: 9.4 symbols/min [2025-09-14T18:23:41.783465] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:23:41.786260] [DEBUG] [LOCAL ] HFND: Loaded 583 existing records from primary storage. [2025-09-14T18:23:41.786351] [INFO ] [MAIN ] HFND: Loaded 583 existing records. [2025-09-14T18:23:41.869678] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-14T18:23:41.984026] [WARN ] [MAIN ] HFND: Insufficient historical data. Have data from 2025-06-17, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:23:41.984373] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-09-14T18:23:41.984456] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-14T18:23:41.984834] [DEBUG] [LOCAL ] HFND: Deleted primary data file. [2025-09-14T18:23:41.984913] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-09-14T18:23:42.170800] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-09-14T18:23:42.364599] [INFO ] [REMOTE ] HFND: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:23:42.397502] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T18:23:42.577173] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-14T18:23:42.958819] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-09-14T18:23:43.244138] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-09-14T18:23:43.758837] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-09-14T18:23:44.558872] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-09-14T18:23:45.001262] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-14T18:23:45.358807] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-09-14T18:23:45.456763] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-14T18:23:45.649949] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-14T18:23:46.158852] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-09-14T18:23:46.435694] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-14T18:23:46.958878] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-09-14T18:23:47.266290] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-14T18:23:47.758846] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-09-14T18:23:48.558841] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-09-14T18:23:48.829863] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-09-14T18:23:49.358849] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-09-14T18:23:49.621206] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T18:23:50.151010] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-14T18:23:50.158784] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-09-14T18:23:50.612354] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-14T18:23:50.958907] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-09-14T18:23:51.758882] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-09-14T18:23:52.393987] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-14T18:23:52.558841] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-09-14T18:23:52.653877] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T18:23:53.190710] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T18:23:53.192227] [INFO ] [REMOTE ] HEQ: Full fetch complete (6465 records). [2025-09-14T18:23:53.192332] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-09-14T18:23:53.384360] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-09-14T18:23:53.567420] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-09-14T18:23:53.567524] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-09-14T18:23:53.567759] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-09-14T18:23:53.567820] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-09-14T18:23:53.568236] [DEBUG] [LOCAL ] HEQ: Trimmed 6465 records to 4247 (keeping 150 days of data) [2025-09-14T18:23:53.598201] [DEBUG] [LOCAL ] HEQ: Primary data saved (4247 records). [2025-09-14T18:23:53.598304] [INFO ] [MAIN ] HEQ: Full history saved. [2025-09-14T18:23:53.598444] [INFO ] [MAIN ] Update Progress: 1007/2370 symbols completed. HEQ took 31.5s. Estimated remaining: 2h 24m 25s. Rate: 9.4 symbols/min [2025-09-14T18:23:53.699321] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-14T18:23:53.705474] [INFO ] [REMOTE ] HF: Full fetch complete (294 records). [2025-09-14T18:23:53.721030] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-09-14T18:23:53.849437] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:23:53.968362] [DEBUG] [LOCAL ] HFRO: Loaded 8015 existing records from primary storage. [2025-09-14T18:23:53.964897] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 102 unique days, need 150 days [2025-09-14T18:23:53.968557] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:23:53.968518] [INFO ] [MAIN ] HFRO: Loaded 8015 existing records. [2025-09-14T18:23:53.968727] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:23:54.010615] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-14T18:23:54.047551] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-14T18:23:54.068269] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-09-14T18:23:54.068596] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-09-14T18:23:54.089341] [INFO ] [MAIN ] Update Progress: 1008/2370 symbols completed. HF took 16.3s. Estimated remaining: 2h 24m 11s. Rate: 9.4 symbols/min [2025-09-14T18:23:54.144874] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:23:54.164595] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-09-14T18:23:54.187229] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-09-14T18:23:54.221534] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-09-14T18:23:54.255654] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-09-14T18:23:54.271261] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-09-14T18:23:54.384550] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:23:54.519824] [DEBUG] [LOCAL ] HGER: Loaded 6615 existing records from primary storage. [2025-09-14T18:23:54.570136] [INFO ] [MAIN ] HGER: Loaded 6615 existing records. [2025-09-14T18:23:54.753486] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-14T18:23:54.864237] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:23:54.886245] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:23:54.886698] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-09-14T18:23:54.886762] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-09-14T18:23:54.887169] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-09-14T18:23:54.887235] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-09-14T18:23:54.963923] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-09-14T18:23:55.247679] [INFO ] [REMOTE ] HGER: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:23:55.412121] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-14T18:23:55.758922] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-09-14T18:23:56.558808] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-09-14T18:23:56.851391] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T18:23:57.179699] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-14T18:23:57.358849] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-09-14T18:23:58.158859] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-09-14T18:23:58.178939] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T18:23:58.958855] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-09-14T18:23:59.277088] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T18:23:59.335380] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-14T18:23:59.758858] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-09-14T18:24:00.558841] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-09-14T18:24:00.636083] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-14T18:24:01.358864] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-09-14T18:24:02.158856] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-09-14T18:24:02.400301] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-14T18:24:02.406137] [INFO ] [REMOTE ] HESM: Full fetch complete (52468 records). [2025-09-14T18:24:02.406289] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-09-14T18:24:02.779750] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-09-14T18:24:02.779865] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-09-14T18:24:02.780618] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-09-14T18:24:02.780687] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-09-14T18:24:02.781738] [DEBUG] [LOCAL ] HESM: Trimmed 52468 records to 36270 (keeping 150 days of data) [2025-09-14T18:24:02.975991] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-09-14T18:24:03.042129] [DEBUG] [LOCAL ] HESM: Primary data saved (36270 records). [2025-09-14T18:24:03.042313] [INFO ] [MAIN ] HESM: Full history saved. [2025-09-14T18:24:03.042451] [INFO ] [MAIN ] Update Progress: 1009/2370 symbols completed. HESM took 34.0s. Estimated remaining: 2h 24m 8s. Rate: 9.4 symbols/min [2025-09-14T18:24:03.209087] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:24:03.215527] [DEBUG] [LOCAL ] HGLB: Loaded 4108 existing records from primary storage. [2025-09-14T18:24:03.215670] [INFO ] [MAIN ] HGLB: Loaded 4108 existing records. [2025-09-14T18:24:03.389738] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:24:03.389994] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-09-14T18:24:03.390053] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-09-14T18:24:03.390368] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-09-14T18:24:03.390429] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-09-14T18:24:03.756726] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:24:03.768551] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-09-14T18:24:03.770017] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-14T18:24:04.426878] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-14T18:24:04.558856] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-09-14T18:24:04.729980] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-09-14T18:24:04.739847] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-14T18:24:05.036883] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-14T18:24:05.358850] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-09-14T18:24:06.158835] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-09-14T18:24:06.190765] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T18:24:06.958866] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-14T18:24:07.170191] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-14T18:24:07.380604] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-14T18:24:07.381468] [INFO ] [REMOTE ] HFND: Full fetch complete (1354 records). [2025-09-14T18:24:07.381557] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-09-14T18:24:07.556233] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-14T18:24:07.556469] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:24:07.556523] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:24:07.556569] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-14T18:24:07.556674] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-14T18:24:07.556729] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-09-14T18:24:07.556807] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-09-14T18:24:07.556896] [INFO ] [MAIN ] Update Progress: 1010/2370 symbols completed. HFND took 26.0s. Estimated remaining: 2h 23m 59s. Rate: 9.4 symbols/min [2025-09-14T18:24:07.723943] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:24:07.732912] [DEBUG] [LOCAL ] HGTY: Loaded 6852 existing records from primary storage. [2025-09-14T18:24:07.733043] [INFO ] [MAIN ] HGTY: Loaded 6852 existing records. [2025-09-14T18:24:07.763913] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-09-14T18:24:07.911067] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:24:07.911387] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-09-14T18:24:07.911465] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-09-14T18:24:07.911812] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-09-14T18:24:07.911889] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-09-14T18:24:08.260386] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:24:08.558833] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-09-14T18:24:08.763974] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-14T18:24:09.358883] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-09-14T18:24:09.389592] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T18:24:10.157479] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-14T18:24:10.159521] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-09-14T18:24:10.958824] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-09-14T18:24:11.122829] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-14T18:24:11.678741] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-14T18:24:11.758836] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-09-14T18:24:12.558836] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-09-14T18:24:12.592957] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-14T18:24:13.327109] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-14T18:24:13.358826] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-09-14T18:24:14.158846] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-09-14T18:24:14.187846] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-14T18:24:14.958899] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-09-14T18:24:15.702479] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T18:24:15.758819] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-09-14T18:24:16.558782] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-09-14T18:24:16.868693] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T18:24:16.976202] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-14T18:24:17.358818] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-09-14T18:24:17.516480] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-14T18:24:18.158837] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-09-14T18:24:18.235880] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-14T18:24:18.805745] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-14T18:24:18.958820] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-09-14T18:24:19.758832] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-09-14T18:24:19.807274] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-14T18:24:20.558831] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-09-14T18:24:20.721228] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-14T18:24:21.358825] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-09-14T18:24:21.485690] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-14T18:24:22.158818] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-09-14T18:24:22.199121] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-14T18:24:22.200952] [INFO ] [REMOTE ] HGLB: Full fetch complete (10828 records). [2025-09-14T18:24:22.201037] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-09-14T18:24:22.569137] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-09-14T18:24:22.569242] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-09-14T18:24:22.569782] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-09-14T18:24:22.569837] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-09-14T18:24:22.570344] [DEBUG] [LOCAL ] HGLB: Trimmed 10828 records to 6627 (keeping 150 days of data) [2025-09-14T18:24:22.611115] [DEBUG] [LOCAL ] HGLB: Primary data saved (6627 records). [2025-09-14T18:24:22.611303] [INFO ] [MAIN ] HGLB: Full history saved. [2025-09-14T18:24:22.611473] [INFO ] [MAIN ] Update Progress: 1011/2370 symbols completed. HGLB took 19.6s. Estimated remaining: 2h 24m 5s. Rate: 9.4 symbols/min [2025-09-14T18:24:22.781330] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:24:22.803098] [DEBUG] [LOCAL ] HGV: Loaded 21132 existing records from primary storage. [2025-09-14T18:24:22.803266] [INFO ] [MAIN ] HGV: Loaded 21132 existing records. [2025-09-14T18:24:22.973898] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-09-14T18:24:22.979857] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:24:22.980992] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-09-14T18:24:22.981077] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-09-14T18:24:22.981893] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-09-14T18:24:22.981979] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-09-14T18:24:23.144583] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-14T18:24:23.186996] [INFO ] [REMOTE ] HGER: Full fetch complete (12819 records). [2025-09-14T18:24:23.266581] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-09-14T18:24:23.488737] [INFO ] [REMOTE ] HGV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:24:23.740670] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-09-14T18:24:23.740781] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-09-14T18:24:23.741109] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-09-14T18:24:23.741160] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-09-14T18:24:23.741763] [DEBUG] [LOCAL ] HGER: Trimmed 12819 records to 10025 (keeping 150 days of data) [2025-09-14T18:24:23.771951] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-09-14T18:24:23.812837] [DEBUG] [LOCAL ] HGER: Primary data saved (10025 records). [2025-09-14T18:24:23.813139] [INFO ] [MAIN ] HGER: Full history saved. [2025-09-14T18:24:23.813266] [INFO ] [MAIN ] Update Progress: 1012/2370 symbols completed. HGER took 29.7s. Estimated remaining: 2h 23m 51s. Rate: 9.4 symbols/min [2025-09-14T18:24:23.981149] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:24:24.002687] [DEBUG] [LOCAL ] HHH: Loaded 15296 existing records from primary storage. [2025-09-14T18:24:24.002945] [INFO ] [MAIN ] HHH: Loaded 15296 existing records. [2025-09-14T18:24:24.208352] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:24:24.208869] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-09-14T18:24:24.209003] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-09-14T18:24:24.214784] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-09-14T18:24:24.223039] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-09-14T18:24:24.223527] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T18:24:24.566026] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-09-14T18:24:24.607072] [INFO ] [REMOTE ] HHH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:24:24.786563] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-14T18:24:24.789284] [INFO ] [REMOTE ] HGTY: Full fetch complete (12935 records). [2025-09-14T18:24:24.789377] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-09-14T18:24:25.157113] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-09-14T18:24:25.157216] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-09-14T18:24:25.157560] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-09-14T18:24:25.157614] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-09-14T18:24:25.158133] [DEBUG] [LOCAL ] HGTY: Trimmed 12935 records to 9766 (keeping 150 days of data) [2025-09-14T18:24:25.220000] [DEBUG] [LOCAL ] HGTY: Primary data saved (9766 records). [2025-09-14T18:24:25.220153] [INFO ] [MAIN ] HGTY: Full history saved. [2025-09-14T18:24:25.220250] [INFO ] [MAIN ] Update Progress: 1013/2370 symbols completed. HGTY took 17.7s. Estimated remaining: 2h 23m 38s. Rate: 9.4 symbols/min [2025-09-14T18:24:25.365955] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-09-14T18:24:25.427840] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:24:25.442720] [DEBUG] [LOCAL ] HI: Loaded 12765 existing records from primary storage. [2025-09-14T18:24:25.442943] [INFO ] [MAIN ] HI: Loaded 12765 existing records. [2025-09-14T18:24:25.643340] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-07-01, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:24:25.643590] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-09-14T18:24:25.644030] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-09-14T18:24:25.644501] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-09-14T18:24:25.644563] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-09-14T18:24:25.998116] [INFO ] [REMOTE ] HI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:24:26.092028] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T18:24:26.158779] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-09-14T18:24:26.326493] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-14T18:24:26.329076] [INFO ] [REMOTE ] HFRO: Full fetch complete (19763 records). [2025-09-14T18:24:26.329165] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-09-14T18:24:26.695064] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-09-14T18:24:26.695174] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-09-14T18:24:26.695632] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-09-14T18:24:26.695706] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-09-14T18:24:26.696396] [DEBUG] [LOCAL ] HFRO: Trimmed 19763 records to 12029 (keeping 150 days of data) [2025-09-14T18:24:26.770167] [DEBUG] [LOCAL ] HFRO: Primary data saved (12029 records). [2025-09-14T18:24:26.770348] [INFO ] [MAIN ] HFRO: Full history saved. [2025-09-14T18:24:26.770457] [INFO ] [MAIN ] Update Progress: 1014/2370 symbols completed. HFRO took 33.2s. Estimated remaining: 2h 23m 25s. Rate: 9.5 symbols/min [2025-09-14T18:24:26.957045] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:24:26.958783] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-09-14T18:24:26.980997] [DEBUG] [LOCAL ] HIG: Loaded 22883 existing records from primary storage. [2025-09-14T18:24:26.981150] [INFO ] [MAIN ] HIG: Loaded 22883 existing records. [2025-09-14T18:24:27.169372] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:24:27.169607] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-09-14T18:24:27.169685] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-09-14T18:24:27.170375] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-09-14T18:24:27.170439] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-09-14T18:24:27.525755] [INFO ] [REMOTE ] HIG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:24:27.763878] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-09-14T18:24:27.780473] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-14T18:24:28.297887] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T18:24:28.558826] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-09-14T18:24:29.358825] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-09-14T18:24:30.158807] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-09-14T18:24:30.189885] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-14T18:24:30.598925] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-14T18:24:30.958864] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-09-14T18:24:31.241601] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T18:24:31.272270] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-14T18:24:31.758842] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-09-14T18:24:31.925460] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-14T18:24:32.558829] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-09-14T18:24:33.358835] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-09-14T18:24:33.502469] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-14T18:24:33.698430] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T18:24:34.158834] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-09-14T18:24:34.945223] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T18:24:34.958785] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-09-14T18:24:35.704729] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T18:24:35.758777] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-09-14T18:24:36.558832] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-09-14T18:24:36.957272] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-14T18:24:37.358827] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-09-14T18:24:37.483782] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T18:24:37.869291] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-14T18:24:38.158829] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-09-14T18:24:38.478006] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T18:24:38.958829] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-09-14T18:24:39.758829] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-09-14T18:24:39.792524] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T18:24:40.558835] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-09-14T18:24:40.674722] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-14T18:24:41.218497] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T18:24:41.358841] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-09-14T18:24:42.158869] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-09-14T18:24:42.423195] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T18:24:42.856486] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T18:24:42.861547] [INFO ] [REMOTE ] HGV: Full fetch complete (50985 records). [2025-09-14T18:24:42.861811] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-09-14T18:24:42.964009] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-09-14T18:24:43.183340] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T18:24:43.294030] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-09-14T18:24:43.294161] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-09-14T18:24:43.295001] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-09-14T18:24:43.295067] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-09-14T18:24:43.296349] [DEBUG] [LOCAL ] HGV: Trimmed 50985 records to 35452 (keeping 150 days of data) [2025-09-14T18:24:43.520396] [DEBUG] [LOCAL ] HGV: Primary data saved (35452 records). [2025-09-14T18:24:43.520570] [INFO ] [MAIN ] HGV: Full history saved. [2025-09-14T18:24:43.520716] [INFO ] [MAIN ] Update Progress: 1015/2370 symbols completed. HGV took 20.9s. Estimated remaining: 2h 23m 33s. Rate: 9.4 symbols/min [2025-09-14T18:24:43.688739] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:24:43.702944] [DEBUG] [LOCAL ] HII: Loaded 13986 existing records from primary storage. [2025-09-14T18:24:43.703098] [INFO ] [MAIN ] HII: Loaded 13986 existing records. [2025-09-14T18:24:43.765125] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-09-14T18:24:43.889367] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:24:43.889677] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-09-14T18:24:43.889739] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-09-14T18:24:43.890269] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-09-14T18:24:43.890332] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-09-14T18:24:44.296830] [INFO ] [REMOTE ] HII: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:24:44.567204] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-09-14T18:24:44.598127] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-14T18:24:44.971482] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T18:24:45.358815] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-09-14T18:24:46.016065] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T18:24:46.158842] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-09-14T18:24:46.891206] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-14T18:24:46.958840] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-09-14T18:24:47.758890] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-09-14T18:24:47.992152] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T18:24:48.291593] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-14T18:24:48.295176] [INFO ] [REMOTE ] HHH: Full fetch complete (35842 records). [2025-09-14T18:24:48.295266] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-09-14T18:24:48.568490] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-09-14T18:24:48.665429] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-09-14T18:24:48.665548] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-09-14T18:24:48.666176] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-09-14T18:24:48.666232] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-09-14T18:24:48.667125] [DEBUG] [LOCAL ] HHH: Trimmed 35842 records to 25705 (keeping 150 days of data) [2025-09-14T18:24:48.822288] [DEBUG] [LOCAL ] HHH: Primary data saved (25705 records). [2025-09-14T18:24:48.822462] [INFO ] [MAIN ] HHH: Full history saved. [2025-09-14T18:24:48.822561] [INFO ] [MAIN ] Update Progress: 1016/2370 symbols completed. HHH took 25.0s. Estimated remaining: 2h 23m 25s. Rate: 9.4 symbols/min [2025-09-14T18:24:48.991978] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:24:49.015740] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T18:24:49.039957] [DEBUG] [LOCAL ] HIMS: Loaded 24177 existing records from primary storage. [2025-09-14T18:24:49.040110] [INFO ] [MAIN ] HIMS: Loaded 24177 existing records. [2025-09-14T18:24:49.213624] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:24:49.213890] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-09-14T18:24:49.213950] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-09-14T18:24:49.214672] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-09-14T18:24:49.214735] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-09-14T18:24:49.364034] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-09-14T18:24:49.569070] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:24:50.158862] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-09-14T18:24:50.505301] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T18:24:50.523063] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-14T18:24:50.526433] [INFO ] [REMOTE ] HI: Full fetch complete (38174 records). [2025-09-14T18:24:50.526538] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-09-14T18:24:50.897127] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-09-14T18:24:50.897233] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-09-14T18:24:50.897885] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-09-14T18:24:50.897941] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-09-14T18:24:50.898806] [DEBUG] [LOCAL ] HI: Trimmed 38174 records to 26236 (keeping 150 days of data) [2025-09-14T18:24:50.964877] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-09-14T18:24:51.072178] [DEBUG] [LOCAL ] HI: Primary data saved (26236 records). [2025-09-14T18:24:51.072332] [INFO ] [MAIN ] HI: Full history saved. [2025-09-14T18:24:51.072434] [INFO ] [MAIN ] Update Progress: 1017/2370 symbols completed. HI took 25.9s. Estimated remaining: 2h 23m 13s. Rate: 9.4 symbols/min [2025-09-14T18:24:51.242181] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:24:51.253433] [DEBUG] [LOCAL ] HIO: Loaded 10218 existing records from primary storage. [2025-09-14T18:24:51.253592] [INFO ] [MAIN ] HIO: Loaded 10218 existing records. [2025-09-14T18:24:51.431348] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:24:51.431790] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-09-14T18:24:51.431863] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-09-14T18:24:51.432377] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-09-14T18:24:51.441806] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-09-14T18:24:51.541418] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-14T18:24:51.763986] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-09-14T18:24:51.833584] [INFO ] [REMOTE ] HIO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:24:52.461181] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T18:24:52.558851] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-09-14T18:24:53.358843] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-09-14T18:24:53.895669] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-14T18:24:54.158833] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-09-14T18:24:54.397586] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-09-14T18:24:54.958862] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-09-14T18:24:55.096934] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T18:24:55.466699] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-14T18:24:55.758853] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-09-14T18:24:56.220751] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T18:24:56.558867] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-09-14T18:24:57.358839] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-09-14T18:24:58.028463] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-14T18:24:58.158849] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-09-14T18:24:58.347083] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T18:24:58.388376] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-14T18:24:58.958835] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-09-14T18:24:59.758883] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-09-14T18:25:00.488765] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T18:25:00.528583] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-14T18:25:00.558815] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-09-14T18:25:00.865674] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-14T18:25:01.358865] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-09-14T18:25:02.041141] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:25:02.047996] [INFO ] [REMOTE ] HIG: Full fetch complete (55525 records). [2025-09-14T18:25:02.048256] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-09-14T18:25:02.163948] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-09-14T18:25:02.436999] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-09-14T18:25:02.437124] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-09-14T18:25:02.437964] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-09-14T18:25:02.438027] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-09-14T18:25:02.439349] [DEBUG] [LOCAL ] HIG: Trimmed 55525 records to 38704 (keeping 150 days of data) [2025-09-14T18:25:02.709286] [DEBUG] [LOCAL ] HIG: Primary data saved (38704 records). [2025-09-14T18:25:02.709602] [INFO ] [MAIN ] HIG: Full history saved. [2025-09-14T18:25:02.709722] [INFO ] [MAIN ] Update Progress: 1018/2370 symbols completed. HIG took 35.9s. Estimated remaining: 2h 23m 14s. Rate: 9.4 symbols/min [2025-09-14T18:25:02.879990] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:25:02.891296] [DEBUG] [LOCAL ] HIPO: Loaded 9567 existing records from primary storage. [2025-09-14T18:25:02.891451] [INFO ] [MAIN ] HIPO: Loaded 9567 existing records. [2025-09-14T18:25:02.966364] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-09-14T18:25:03.073277] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:25:03.073567] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-09-14T18:25:03.073627] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-09-14T18:25:03.074050] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-09-14T18:25:03.074110] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-09-14T18:25:03.435288] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:25:03.449071] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T18:25:03.488479] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.93 seconds). [2025-09-14T18:25:03.758830] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-09-14T18:25:04.542844] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-14T18:25:04.558798] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-09-14T18:25:05.200552] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T18:25:05.204010] [INFO ] [REMOTE ] HII: Full fetch complete (39889 records). [2025-09-14T18:25:05.204164] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-09-14T18:25:05.368821] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-09-14T18:25:05.586943] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-09-14T18:25:05.587052] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-09-14T18:25:05.587727] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-09-14T18:25:05.587785] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-09-14T18:25:05.588611] [DEBUG] [LOCAL ] HII: Trimmed 39889 records to 24776 (keeping 150 days of data) [2025-09-14T18:25:05.750631] [DEBUG] [LOCAL ] HII: Primary data saved (24776 records). [2025-09-14T18:25:05.750808] [INFO ] [MAIN ] HII: Full history saved. [2025-09-14T18:25:05.750919] [INFO ] [MAIN ] Update Progress: 1019/2370 symbols completed. HII took 22.2s. Estimated remaining: 2h 23m 3s. Rate: 9.4 symbols/min [2025-09-14T18:25:05.922615] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:25:05.943725] [DEBUG] [LOCAL ] HIW: Loaded 19950 existing records from primary storage. [2025-09-14T18:25:05.943957] [INFO ] [MAIN ] HIW: Loaded 19950 existing records. [2025-09-14T18:25:06.130478] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:25:06.131386] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-09-14T18:25:06.131450] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-09-14T18:25:06.132327] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-09-14T18:25:06.132391] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-09-14T18:25:06.163947] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-09-14T18:25:06.494637] [INFO ] [REMOTE ] HIW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:25:06.532452] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.77 seconds). [2025-09-14T18:25:06.576213] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-14T18:25:06.958889] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-09-14T18:25:07.077817] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-14T18:25:07.758868] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-09-14T18:25:08.168593] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-14T18:25:08.558803] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-09-14T18:25:08.939840] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T18:25:09.358816] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-09-14T18:25:10.135782] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T18:25:10.158790] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-09-14T18:25:10.958861] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-09-14T18:25:11.758819] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-09-14T18:25:11.809354] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-14T18:25:12.143206] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-14T18:25:12.270204] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-09-14T18:25:12.558851] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-09-14T18:25:12.974795] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-14T18:25:12.981722] [INFO ] [REMOTE ] HIO: Full fetch complete (27112 records). [2025-09-14T18:25:12.981872] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-09-14T18:25:13.364789] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-09-14T18:25:13.366537] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-09-14T18:25:13.367503] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-09-14T18:25:13.368174] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-09-14T18:25:13.368240] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-09-14T18:25:13.369070] [DEBUG] [LOCAL ] HIO: Trimmed 27112 records to 16072 (keeping 150 days of data) [2025-09-14T18:25:13.464028] [DEBUG] [LOCAL ] HIO: Primary data saved (16072 records). [2025-09-14T18:25:13.464201] [INFO ] [MAIN ] HIO: Full history saved. [2025-09-14T18:25:13.464299] [INFO ] [MAIN ] Update Progress: 1020/2370 symbols completed. HIO took 22.4s. Estimated remaining: 2h 22m 59s. Rate: 9.4 symbols/min [2025-09-14T18:25:13.636976] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:25:13.647781] [DEBUG] [LOCAL ] HIX: Loaded 8971 existing records from primary storage. [2025-09-14T18:25:13.647969] [INFO ] [MAIN ] HIX: Loaded 8971 existing records. [2025-09-14T18:25:13.837142] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:25:13.837436] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-09-14T18:25:13.837498] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-09-14T18:25:13.837896] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-09-14T18:25:13.837956] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-09-14T18:25:14.164017] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-09-14T18:25:14.201028] [INFO ] [REMOTE ] HIX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:25:14.515560] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-14T18:25:14.965953] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-09-14T18:25:14.988764] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-14T18:25:15.758852] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-09-14T18:25:15.912714] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T18:25:16.038501] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T18:25:16.463721] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T18:25:16.469546] [INFO ] [REMOTE ] HIMS: Full fetch complete (58497 records). [2025-09-14T18:25:16.469776] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-09-14T18:25:16.567148] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-09-14T18:25:16.853290] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-09-14T18:25:16.853403] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-09-14T18:25:16.854222] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-09-14T18:25:16.854280] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-09-14T18:25:16.855509] [DEBUG] [LOCAL ] HIMS: Trimmed 58497 records to 40557 (keeping 150 days of data) [2025-09-14T18:25:17.123961] [DEBUG] [LOCAL ] HIMS: Primary data saved (40557 records). [2025-09-14T18:25:17.124148] [INFO ] [MAIN ] HIMS: Full history saved. [2025-09-14T18:25:17.124275] [INFO ] [MAIN ] Update Progress: 1021/2370 symbols completed. HIMS took 28.3s. Estimated remaining: 2h 22m 49s. Rate: 9.4 symbols/min [2025-09-14T18:25:17.330732] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:25:17.341025] [DEBUG] [LOCAL ] HKD: Loaded 8004 existing records from primary storage. [2025-09-14T18:25:17.341192] [INFO ] [MAIN ] HKD: Loaded 8004 existing records. [2025-09-14T18:25:17.363909] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-09-14T18:25:17.528918] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:25:17.529166] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-09-14T18:25:17.529227] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-09-14T18:25:17.529536] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-09-14T18:25:17.529598] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-09-14T18:25:17.892523] [INFO ] [REMOTE ] HKD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:25:18.158841] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-09-14T18:25:18.251547] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-14T18:25:18.702330] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-14T18:25:18.958848] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-09-14T18:25:19.461835] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-14T18:25:19.758840] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-09-14T18:25:20.039504] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-14T18:25:20.558792] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-09-14T18:25:20.576540] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T18:25:21.358793] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-09-14T18:25:21.680787] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T18:25:22.158874] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-09-14T18:25:22.637154] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T18:25:22.958828] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-09-14T18:25:23.279865] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-14T18:25:23.758872] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-09-14T18:25:24.460299] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-14T18:25:24.558822] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-09-14T18:25:24.839198] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-14T18:25:25.358822] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-09-14T18:25:26.023808] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T18:25:26.158793] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-09-14T18:25:26.429125] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-14T18:25:26.958835] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-09-14T18:25:27.758802] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-09-14T18:25:27.821355] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T18:25:28.133819] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-14T18:25:28.558809] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-09-14T18:25:28.707451] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-14T18:25:28.710344] [INFO ] [REMOTE ] HIPO: Full fetch complete (24406 records). [2025-09-14T18:25:28.710449] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-09-14T18:25:29.097902] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-09-14T18:25:29.098060] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-09-14T18:25:29.098758] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-09-14T18:25:29.098834] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-09-14T18:25:29.099875] [DEBUG] [LOCAL ] HIPO: Trimmed 24406 records to 16864 (keeping 150 days of data) [2025-09-14T18:25:29.210365] [DEBUG] [LOCAL ] HIPO: Primary data saved (16864 records). [2025-09-14T18:25:29.210580] [INFO ] [MAIN ] HIPO: Full history saved. [2025-09-14T18:25:29.210740] [INFO ] [MAIN ] Update Progress: 1022/2370 symbols completed. HIPO took 26.5s. Estimated remaining: 2h 22m 50s. Rate: 9.4 symbols/min [2025-09-14T18:25:29.365280] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-09-14T18:25:29.390861] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:25:29.416133] [DEBUG] [LOCAL ] HL: Loaded 24047 existing records from primary storage. [2025-09-14T18:25:29.416311] [INFO ] [MAIN ] HL: Loaded 24047 existing records. [2025-09-14T18:25:29.604905] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:25:29.605979] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-14T18:25:29.606150] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-09-14T18:25:29.610116] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-09-14T18:25:29.611089] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-09-14T18:25:29.611154] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-09-14T18:25:29.986312] [INFO ] [REMOTE ] HL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:25:30.042145] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:25:30.047373] [INFO ] [REMOTE ] HIW: Full fetch complete (48924 records). [2025-09-14T18:25:30.047530] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-09-14T18:25:30.163868] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-09-14T18:25:30.421141] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-09-14T18:25:30.421279] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-09-14T18:25:30.422118] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-09-14T18:25:30.422188] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-09-14T18:25:30.423507] [DEBUG] [LOCAL ] HIW: Trimmed 48924 records to 33336 (keeping 150 days of data) [2025-09-14T18:25:30.645936] [DEBUG] [LOCAL ] HIW: Primary data saved (33336 records). [2025-09-14T18:25:30.646120] [INFO ] [MAIN ] HIW: Full history saved. [2025-09-14T18:25:30.646237] [INFO ] [MAIN ] Update Progress: 1023/2370 symbols completed. HIW took 24.9s. Estimated remaining: 2h 22m 37s. Rate: 9.4 symbols/min [2025-09-14T18:25:30.816566] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:25:30.837597] [DEBUG] [LOCAL ] HLF: Loaded 21911 existing records from primary storage. [2025-09-14T18:25:30.837801] [INFO ] [MAIN ] HLF: Loaded 21911 existing records. [2025-09-14T18:25:30.964022] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-09-14T18:25:31.015470] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:25:31.015801] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-09-14T18:25:31.015864] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-09-14T18:25:31.016394] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-09-14T18:25:31.016454] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-09-14T18:25:31.371209] [INFO ] [REMOTE ] HLF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:25:31.501720] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-14T18:25:31.758852] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-09-14T18:25:32.558850] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-09-14T18:25:32.847772] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T18:25:33.207165] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-14T18:25:33.358798] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-09-14T18:25:33.735139] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-14T18:25:34.158844] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-09-14T18:25:34.952484] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T18:25:34.962565] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-09-14T18:25:35.758810] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-09-14T18:25:36.105681] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T18:25:36.143454] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-14T18:25:36.558841] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-09-14T18:25:36.668539] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-14T18:25:37.358872] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-09-14T18:25:38.158833] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-09-14T18:25:38.235823] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T18:25:38.240379] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T18:25:38.241170] [INFO ] [REMOTE ] HKD: Full fetch complete (20173 records). [2025-09-14T18:25:38.251987] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-09-14T18:25:38.620419] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-09-14T18:25:38.620524] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-09-14T18:25:38.620981] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-09-14T18:25:38.621036] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-09-14T18:25:38.621706] [DEBUG] [LOCAL ] HKD: Trimmed 20173 records to 13529 (keeping 150 days of data) [2025-09-14T18:25:38.699498] [DEBUG] [LOCAL ] HKD: Primary data saved (13529 records). [2025-09-14T18:25:38.699689] [INFO ] [MAIN ] HKD: Full history saved. [2025-09-14T18:25:38.699856] [INFO ] [MAIN ] Update Progress: 1024/2370 symbols completed. HKD took 21.6s. Estimated remaining: 2h 22m 33s. Rate: 9.4 symbols/min [2025-09-14T18:25:38.870143] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:25:38.889213] [DEBUG] [LOCAL ] HLI: Loaded 13869 existing records from primary storage. [2025-09-14T18:25:38.889397] [INFO ] [MAIN ] HLI: Loaded 13869 existing records. [2025-09-14T18:25:38.965678] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-09-14T18:25:39.069373] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:25:39.069624] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-09-14T18:25:39.069713] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-09-14T18:25:39.070251] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-09-14T18:25:39.070311] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-09-14T18:25:39.418952] [INFO ] [REMOTE ] HLI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:25:39.758798] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-09-14T18:25:40.250829] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-14T18:25:40.558886] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-09-14T18:25:41.089683] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T18:25:41.190312] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-14T18:25:41.358841] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-09-14T18:25:42.158833] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-09-14T18:25:42.255954] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-14T18:25:42.258236] [INFO ] [REMOTE ] HIX: Full fetch complete (21797 records). [2025-09-14T18:25:42.258357] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-09-14T18:25:42.618770] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-09-14T18:25:42.618905] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-09-14T18:25:42.619543] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-09-14T18:25:42.619676] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-09-14T18:25:42.620543] [DEBUG] [LOCAL ] HIX: Trimmed 21797 records to 15096 (keeping 150 days of data) [2025-09-14T18:25:42.709790] [DEBUG] [LOCAL ] HIX: Primary data saved (15096 records). [2025-09-14T18:25:42.710287] [INFO ] [MAIN ] HIX: Full history saved. [2025-09-14T18:25:42.710449] [INFO ] [MAIN ] Update Progress: 1025/2370 symbols completed. HIX took 29.2s. Estimated remaining: 2h 22m 24s. Rate: 9.4 symbols/min [2025-09-14T18:25:42.943201] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:25:42.950271] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-14T18:25:42.962576] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-09-14T18:25:42.982564] [DEBUG] [LOCAL ] HLIO: Loaded 13223 existing records from primary storage. [2025-09-14T18:25:42.982759] [INFO ] [MAIN ] HLIO: Loaded 13223 existing records. [2025-09-14T18:25:43.159490] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:25:43.159783] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-09-14T18:25:43.159847] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-09-14T18:25:43.160253] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-09-14T18:25:43.160312] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-09-14T18:25:43.551159] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:25:43.594416] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-14T18:25:43.758820] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-09-14T18:25:44.558818] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-09-14T18:25:44.922869] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-14T18:25:45.249754] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-14T18:25:45.358826] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-09-14T18:25:46.158884] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-09-14T18:25:46.354037] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T18:25:46.449865] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T18:25:46.958849] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-09-14T18:25:47.463333] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-14T18:25:47.758793] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-09-14T18:25:48.139287] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-14T18:25:48.558890] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-09-14T18:25:49.307622] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T18:25:49.358786] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-09-14T18:25:50.158873] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-09-14T18:25:50.744209] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-14T18:25:50.958871] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-09-14T18:25:51.028417] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-14T18:25:51.435831] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-14T18:25:51.758930] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-09-14T18:25:51.957682] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-14T18:25:52.558840] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-09-14T18:25:53.103573] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T18:25:53.358832] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-09-14T18:25:54.158898] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-09-14T18:25:54.382090] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-14T18:25:54.958847] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-09-14T18:25:55.403558] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-14T18:25:55.522992] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-14T18:25:55.758916] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-09-14T18:25:56.349186] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T18:25:56.558869] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-09-14T18:25:57.056026] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-14T18:25:57.061450] [INFO ] [REMOTE ] HLF: Full fetch complete (53517 records). [2025-09-14T18:25:57.061691] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-09-14T18:25:57.306023] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T18:25:57.364180] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-09-14T18:25:57.379724] [INFO ] [REMOTE ] HLI: Full fetch complete (34116 records). [2025-09-14T18:25:57.381147] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-09-14T18:25:57.590725] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-09-14T18:25:57.591276] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-09-14T18:25:57.603443] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-09-14T18:25:57.608728] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-09-14T18:25:57.681706] [DEBUG] [LOCAL ] HLF: Trimmed 53517 records to 36855 (keeping 150 days of data) [2025-09-14T18:25:57.985940] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-09-14T18:25:57.986755] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-09-14T18:25:57.989275] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-09-14T18:25:57.990335] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-09-14T18:25:57.994542] [DEBUG] [LOCAL ] HLI: Trimmed 34116 records to 22943 (keeping 150 days of data) [2025-09-14T18:25:58.159710] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-09-14T18:25:58.233414] [DEBUG] [LOCAL ] HLI: Primary data saved (22943 records). [2025-09-14T18:25:58.233909] [INFO ] [MAIN ] HLI: Full history saved. [2025-09-14T18:25:58.234027] [INFO ] [MAIN ] Update Progress: 1026/2370 symbols completed. HLI took 19.5s. Estimated remaining: 2h 22m 29s. Rate: 9.4 symbols/min [2025-09-14T18:25:58.425791] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:25:58.447221] [DEBUG] [LOCAL ] HLLY: Loaded 15167 existing records from primary storage. [2025-09-14T18:25:58.447717] [INFO ] [MAIN ] HLLY: Loaded 15167 existing records. [2025-09-14T18:25:58.580493] [DEBUG] [LOCAL ] HLF: Primary data saved (36855 records). [2025-09-14T18:25:58.609320] [INFO ] [MAIN ] HLF: Full history saved. [2025-09-14T18:25:58.611684] [INFO ] [MAIN ] Update Progress: 1027/2370 symbols completed. HLF took 28.0s. Estimated remaining: 2h 22m 15s. Rate: 9.4 symbols/min [2025-09-14T18:25:58.682253] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:25:58.719629] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-09-14T18:25:58.741112] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-09-14T18:25:58.747082] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-09-14T18:25:58.796544] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-09-14T18:25:58.814991] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:25:59.117086] [DEBUG] [LOCAL ] HLN: Loaded 23751 existing records from primary storage. [2025-09-14T18:25:59.129254] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T18:25:59.129378] [INFO ] [MAIN ] HLN: Loaded 23751 existing records. [2025-09-14T18:25:59.286930] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-09-14T18:25:59.290372] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:25:59.403819] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:25:59.404091] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-09-14T18:25:59.404167] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-09-14T18:25:59.404870] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-09-14T18:25:59.404946] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-09-14T18:25:59.762948] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-09-14T18:25:59.766816] [INFO ] [REMOTE ] HLN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:25:59.989846] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-14T18:25:59.995664] [INFO ] [REMOTE ] HL: Full fetch complete (58347 records). [2025-09-14T18:25:59.995835] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-09-14T18:26:00.403696] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-09-14T18:26:00.403840] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-09-14T18:26:00.404884] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-09-14T18:26:00.404949] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-09-14T18:26:00.406437] [DEBUG] [LOCAL ] HL: Trimmed 58347 records to 40416 (keeping 150 days of data) [2025-09-14T18:26:00.591795] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-09-14T18:26:00.674727] [DEBUG] [LOCAL ] HL: Primary data saved (40416 records). [2025-09-14T18:26:00.674887] [INFO ] [MAIN ] HL: Full history saved. [2025-09-14T18:26:00.675005] [INFO ] [MAIN ] Update Progress: 1028/2370 symbols completed. HL took 31.5s. Estimated remaining: 2h 22m 3s. Rate: 9.4 symbols/min [2025-09-14T18:26:00.897868] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:26:00.920485] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-14T18:26:00.948523] [DEBUG] [LOCAL ] HLT: Loaded 22305 existing records from primary storage. [2025-09-14T18:26:00.948795] [INFO ] [MAIN ] HLT: Loaded 22305 existing records. [2025-09-14T18:26:01.093843] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T18:26:01.162116] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:26:01.162468] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-09-14T18:26:01.162539] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-09-14T18:26:01.163252] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-09-14T18:26:01.163321] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-09-14T18:26:01.368545] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-09-14T18:26:01.568220] [INFO ] [REMOTE ] HLT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:26:02.158903] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-09-14T18:26:02.533534] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-14T18:26:02.742744] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T18:26:02.958874] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-09-14T18:26:03.013403] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-14T18:26:03.758914] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-09-14T18:26:04.362621] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-14T18:26:04.558899] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-09-14T18:26:04.840571] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-14T18:26:05.358821] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-09-14T18:26:06.058718] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-14T18:26:06.118097] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-14T18:26:06.158797] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-09-14T18:26:06.958877] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-09-14T18:26:07.230239] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-14T18:26:07.758858] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-09-14T18:26:07.849898] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-14T18:26:08.558856] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-09-14T18:26:09.358848] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-09-14T18:26:09.440110] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-14T18:26:09.755418] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-14T18:26:10.158790] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-09-14T18:26:10.552568] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T18:26:10.958901] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-09-14T18:26:11.758840] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-09-14T18:26:11.986722] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-14T18:26:12.357832] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-14T18:26:12.437698] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-14T18:26:12.558870] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-09-14T18:26:13.358766] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-09-14T18:26:14.092681] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-14T18:26:14.158827] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-09-14T18:26:14.958805] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-09-14T18:26:14.992759] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T18:26:15.212177] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-14T18:26:15.215317] [INFO ] [REMOTE ] HLIO: Full fetch complete (29650 records). [2025-09-14T18:26:15.215425] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-09-14T18:26:15.593096] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-09-14T18:26:15.593244] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-09-14T18:26:15.593905] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-09-14T18:26:15.593966] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-09-14T18:26:15.595444] [DEBUG] [LOCAL ] HLIO: Trimmed 29650 records to 22033 (keeping 150 days of data) [2025-09-14T18:26:15.736287] [DEBUG] [LOCAL ] HLIO: Primary data saved (22033 records). [2025-09-14T18:26:15.736468] [INFO ] [MAIN ] HLIO: Full history saved. [2025-09-14T18:26:15.736598] [INFO ] [MAIN ] Update Progress: 1029/2370 symbols completed. HLIO took 33.0s. Estimated remaining: 2h 22m 8s. Rate: 9.4 symbols/min [2025-09-14T18:26:15.765665] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-09-14T18:26:15.912863] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:26:15.944436] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T18:26:15.970595] [DEBUG] [LOCAL ] HLX: Loaded 21455 existing records from primary storage. [2025-09-14T18:26:15.970800] [INFO ] [MAIN ] HLX: Loaded 21455 existing records. [2025-09-14T18:26:16.166927] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:26:16.167192] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-09-14T18:26:16.167256] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-09-14T18:26:16.167893] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-09-14T18:26:16.167966] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-09-14T18:26:16.517835] [INFO ] [REMOTE ] HLX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:26:16.558848] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-09-14T18:26:17.222633] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:26:17.227685] [INFO ] [REMOTE ] HLT: Full fetch complete (55252 records). [2025-09-14T18:26:17.227818] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-09-14T18:26:17.367722] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-09-14T18:26:17.608075] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-09-14T18:26:17.608200] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-09-14T18:26:17.609149] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-09-14T18:26:17.609255] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-09-14T18:26:17.611192] [DEBUG] [LOCAL ] HLT: Trimmed 55252 records to 37911 (keeping 150 days of data) [2025-09-14T18:26:17.752862] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-14T18:26:17.920333] [DEBUG] [LOCAL ] HLT: Primary data saved (37911 records). [2025-09-14T18:26:17.920534] [INFO ] [MAIN ] HLT: Full history saved. [2025-09-14T18:26:17.920700] [INFO ] [MAIN ] Update Progress: 1030/2370 symbols completed. HLT took 17.2s. Estimated remaining: 2h 21m 56s. Rate: 9.4 symbols/min [2025-09-14T18:26:18.102416] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:26:18.125329] [DEBUG] [LOCAL ] HMC: Loaded 20902 existing records from primary storage. [2025-09-14T18:26:18.125563] [INFO ] [MAIN ] HMC: Loaded 20902 existing records. [2025-09-14T18:26:18.164054] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-09-14T18:26:18.316822] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:26:18.317074] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-09-14T18:26:18.317136] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-09-14T18:26:18.318236] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-09-14T18:26:18.318327] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-09-14T18:26:18.675173] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-14T18:26:18.719961] [INFO ] [REMOTE ] HMC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:26:18.720247] [INFO ] [REMOTE ] HLLY: Full fetch complete (34726 records). [2025-09-14T18:26:18.720898] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-09-14T18:26:18.965298] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-09-14T18:26:19.087470] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-09-14T18:26:19.087581] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-09-14T18:26:19.088289] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-09-14T18:26:19.088345] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-09-14T18:26:19.089290] [DEBUG] [LOCAL ] HLLY: Trimmed 34726 records to 24903 (keeping 150 days of data) [2025-09-14T18:26:19.237600] [DEBUG] [LOCAL ] HLLY: Primary data saved (24903 records). [2025-09-14T18:26:19.237783] [INFO ] [MAIN ] HLLY: Full history saved. [2025-09-14T18:26:19.237933] [INFO ] [MAIN ] Update Progress: 1031/2370 symbols completed. HLLY took 21.0s. Estimated remaining: 2h 21m 44s. Rate: 9.4 symbols/min [2025-09-14T18:26:19.405273] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:26:19.416664] [DEBUG] [LOCAL ] HMN: Loaded 10117 existing records from primary storage. [2025-09-14T18:26:19.416807] [INFO ] [MAIN ] HMN: Loaded 10117 existing records. [2025-09-14T18:26:19.596076] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:26:19.596382] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-09-14T18:26:19.596443] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-09-14T18:26:19.596843] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-09-14T18:26:19.596903] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-09-14T18:26:19.766865] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-09-14T18:26:19.951470] [INFO ] [REMOTE ] HMN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:26:20.012394] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T18:26:20.014475] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-14T18:26:20.558873] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-09-14T18:26:21.358864] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-09-14T18:26:21.437045] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T18:26:22.158832] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-09-14T18:26:22.335954] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-14T18:26:22.492592] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-14T18:26:22.958836] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-09-14T18:26:23.711431] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T18:26:23.758787] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-09-14T18:26:23.860563] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-14T18:26:24.558829] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-09-14T18:26:25.358867] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-09-14T18:26:25.442275] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T18:26:25.467960] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-14T18:26:25.869847] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-14T18:26:26.158885] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-09-14T18:26:26.958831] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-09-14T18:26:27.601946] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-14T18:26:27.609257] [INFO ] [REMOTE ] HLN: Full fetch complete (57691 records). [2025-09-14T18:26:27.609571] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-09-14T18:26:27.775338] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-09-14T18:26:28.017287] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-09-14T18:26:28.017408] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-09-14T18:26:28.018331] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-09-14T18:26:28.018392] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-09-14T18:26:28.019694] [DEBUG] [LOCAL ] HLN: Trimmed 57691 records to 39960 (keeping 150 days of data) [2025-09-14T18:26:28.292025] [DEBUG] [LOCAL ] HLN: Primary data saved (39960 records). [2025-09-14T18:26:28.292224] [INFO ] [MAIN ] HLN: Full history saved. [2025-09-14T18:26:28.292368] [INFO ] [MAIN ] Update Progress: 1032/2370 symbols completed. HLN took 29.7s. Estimated remaining: 2h 21m 41s. Rate: 9.4 symbols/min [2025-09-14T18:26:28.469721] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:26:28.500559] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T18:26:28.529875] [DEBUG] [LOCAL ] HMY: Loaded 23638 existing records from primary storage. [2025-09-14T18:26:28.530050] [INFO ] [MAIN ] HMY: Loaded 23638 existing records. [2025-09-14T18:26:28.564015] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-09-14T18:26:28.719016] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:26:28.719470] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-09-14T18:26:28.719682] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-09-14T18:26:28.726175] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-09-14T18:26:28.735153] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-09-14T18:26:28.736360] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-14T18:26:29.100698] [INFO ] [REMOTE ] HMY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:26:29.358834] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-09-14T18:26:29.473145] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-14T18:26:30.158832] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-09-14T18:26:30.958806] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-09-14T18:26:31.312001] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-14T18:26:31.398736] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-14T18:26:31.470441] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-14T18:26:31.758848] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-09-14T18:26:32.558828] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-09-14T18:26:33.358840] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-09-14T18:26:33.941844] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-14T18:26:34.158794] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-09-14T18:26:34.227766] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-14T18:26:34.629540] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-14T18:26:34.958837] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-09-14T18:26:35.758795] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-09-14T18:26:35.868813] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T18:26:36.114556] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-14T18:26:36.558882] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-09-14T18:26:37.269190] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-14T18:26:37.358827] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-09-14T18:26:37.566684] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T18:26:38.163873] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-09-14T18:26:38.182433] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T18:26:38.958822] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-09-14T18:26:39.173248] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T18:26:39.657545] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T18:26:39.662356] [INFO ] [REMOTE ] HMC: Full fetch complete (51330 records). [2025-09-14T18:26:39.662496] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-09-14T18:26:39.764243] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-09-14T18:26:40.041172] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-09-14T18:26:40.041298] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-09-14T18:26:40.042215] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-09-14T18:26:40.042295] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-09-14T18:26:40.043550] [DEBUG] [LOCAL ] HMC: Trimmed 51330 records to 34740 (keeping 150 days of data) [2025-09-14T18:26:40.247587] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-14T18:26:40.256326] [INFO ] [REMOTE ] HLX: Full fetch complete (52312 records). [2025-09-14T18:26:40.257888] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-09-14T18:26:40.532966] [DEBUG] [LOCAL ] HMC: Primary data saved (34740 records). [2025-09-14T18:26:40.560574] [INFO ] [MAIN ] HMC: Full history saved. [2025-09-14T18:26:40.567793] [INFO ] [MAIN ] Update Progress: 1033/2370 symbols completed. HMC took 22.6s. Estimated remaining: 2h 21m 42s. Rate: 9.4 symbols/min [2025-09-14T18:26:40.567894] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-09-14T18:26:40.773064] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-09-14T18:26:40.808045] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-09-14T18:26:40.838708] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:26:40.837336] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-09-14T18:26:40.838869] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-09-14T18:26:40.840405] [DEBUG] [LOCAL ] HLX: Trimmed 52312 records to 35929 (keeping 150 days of data) [2025-09-14T18:26:40.939259] [DEBUG] [LOCAL ] HNGE: Loaded 18879 existing records from primary storage. [2025-09-14T18:26:40.940228] [INFO ] [MAIN ] HNGE: Loaded 18879 existing records. [2025-09-14T18:26:41.124963] [WARN ] [MAIN ] HNGE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:26:41.126865] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-14T18:26:41.127444] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-14T18:26:41.128350] [DEBUG] [LOCAL ] HNGE: Deleted primary data file. [2025-09-14T18:26:41.129019] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-14T18:26:41.382173] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-09-14T18:26:41.581370] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:26:41.605360] [DEBUG] [LOCAL ] HLX: Primary data saved (35929 records). [2025-09-14T18:26:41.605498] [INFO ] [MAIN ] HLX: Full history saved. [2025-09-14T18:26:41.605627] [INFO ] [MAIN ] Update Progress: 1034/2370 symbols completed. HLX took 25.9s. Estimated remaining: 2h 21m 29s. Rate: 9.4 symbols/min [2025-09-14T18:26:41.777508] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:26:41.792896] [DEBUG] [LOCAL ] HNI: Loaded 14334 existing records from primary storage. [2025-09-14T18:26:41.793048] [INFO ] [MAIN ] HNI: Loaded 14334 existing records. [2025-09-14T18:26:41.997156] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:26:41.997495] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-09-14T18:26:41.997562] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-09-14T18:26:41.998335] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-09-14T18:26:41.998601] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-09-14T18:26:42.159900] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-02. [2025-09-14T18:26:42.357534] [INFO ] [REMOTE ] HNI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:26:42.483838] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:26:42.484667] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-02 [2025-09-14T18:26:42.546193] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T18:26:42.623813] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-14T18:26:42.958826] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-03. [2025-09-14T18:26:43.212291] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:26:43.212868] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-03 [2025-09-14T18:26:43.758849] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-09-14T18:26:44.558866] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-09-14T18:26:45.012875] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-14T18:26:45.015346] [INFO ] [REMOTE ] HMN: Full fetch complete (24917 records). [2025-09-14T18:26:45.015439] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-09-14T18:26:45.358795] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-09-14T18:26:45.429696] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-09-14T18:26:45.432278] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-09-14T18:26:45.432215] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T18:26:45.438833] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-09-14T18:26:45.439681] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-09-14T18:26:45.441375] [DEBUG] [LOCAL ] HMN: Trimmed 24917 records to 18068 (keeping 150 days of data) [2025-09-14T18:26:45.573300] [DEBUG] [LOCAL ] HMN: Primary data saved (18068 records). [2025-09-14T18:26:45.573576] [INFO ] [MAIN ] HMN: Full history saved. [2025-09-14T18:26:45.573731] [INFO ] [MAIN ] Update Progress: 1035/2370 symbols completed. HMN took 26.3s. Estimated remaining: 2h 21m 19s. Rate: 9.4 symbols/min [2025-09-14T18:26:45.755175] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:26:45.781813] [DEBUG] [LOCAL ] HOG: Loaded 22685 existing records from primary storage. [2025-09-14T18:26:45.782076] [INFO ] [MAIN ] HOG: Loaded 22685 existing records. [2025-09-14T18:26:45.983067] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:26:45.983390] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-09-14T18:26:45.983458] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-09-14T18:26:45.984256] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-09-14T18:26:45.984323] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-09-14T18:26:46.164002] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-09-14T18:26:46.359226] [INFO ] [REMOTE ] HOG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:26:46.958842] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-09-14T18:26:47.546938] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-14T18:26:47.578783] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-14T18:26:47.758853] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-09-14T18:26:48.385112] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T18:26:48.558919] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-04. [2025-09-14T18:26:48.811678] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:26:48.812836] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-04 [2025-09-14T18:26:49.358916] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-05. [2025-09-14T18:26:49.876061] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-14T18:26:49.944715] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-14T18:26:50.158857] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-09-14T18:26:50.958875] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-06. [2025-09-14T18:26:51.758962] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-09-14T18:26:52.048932] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-14T18:26:52.558898] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-09-14T18:26:52.586197] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-14T18:26:52.652446] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-14T18:26:53.358849] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-07. [2025-09-14T18:26:54.158843] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-09-14T18:26:54.310084] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T18:26:54.958922] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-09-14T18:26:55.013451] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-14T18:26:55.758946] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-08. [2025-09-14T18:26:56.215899] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-14T18:26:56.558889] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-09-14T18:26:56.725799] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-14T18:26:57.358829] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-09-14T18:26:57.468594] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T18:26:58.158871] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-09-14T18:26:58.427157] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-14T18:26:58.433414] [INFO ] [REMOTE ] HMY: Full fetch complete (57767 records). [2025-09-14T18:26:58.433603] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-09-14T18:26:58.829845] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-09-14T18:26:58.829953] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-09-14T18:26:58.830762] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-09-14T18:26:58.830822] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-09-14T18:26:58.832009] [DEBUG] [LOCAL ] HMY: Trimmed 57767 records to 39927 (keeping 150 days of data) [2025-09-14T18:26:59.007575] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-09. [2025-09-14T18:26:59.104123] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T18:26:59.145388] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T18:26:59.159658] [DEBUG] [LOCAL ] HMY: Primary data saved (39927 records). [2025-09-14T18:26:59.159937] [INFO ] [MAIN ] HMY: Full history saved. [2025-09-14T18:26:59.160078] [INFO ] [MAIN ] Update Progress: 1036/2370 symbols completed. HMY took 30.9s. Estimated remaining: 2h 21m 22s. Rate: 9.4 symbols/min [2025-09-14T18:26:59.340595] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:26:59.362768] [DEBUG] [LOCAL ] HOMB: Loaded 19860 existing records from primary storage. [2025-09-14T18:26:59.363111] [INFO ] [MAIN ] HOMB: Loaded 19860 existing records. [2025-09-14T18:26:59.551535] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:26:59.551917] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-09-14T18:26:59.551985] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-09-14T18:26:59.552588] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-09-14T18:26:59.552708] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-09-14T18:26:59.766557] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-09-14T18:26:59.924008] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:27:00.560775] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-09-14T18:27:00.567211] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-14T18:27:00.575077] [INFO ] [REMOTE ] HNGE: Full fetch complete (23598 records). [2025-09-14T18:27:00.575296] [DEBUG] [VALIDATOR ] HNGE: Validating primary data. [2025-09-14T18:27:00.811542] [WARN ] [VALIDATOR ] HNGE: Validation failed - insufficient historical data. Have 78 unique days, need 150 days [2025-09-14T18:27:00.812063] [FATAL] [MAIN ] HNGE: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:27:00.812123] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:27:00.812179] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-14T18:27:00.812271] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-14T18:27:00.812324] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-14T18:27:00.812406] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-14T18:27:00.812520] [INFO ] [MAIN ] Update Progress: 1037/2370 symbols completed. HNGE took 20.2s. Estimated remaining: 2h 21m 10s. Rate: 9.4 symbols/min [2025-09-14T18:27:01.358908] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-09-14T18:27:02.024811] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T18:27:02.158885] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-09-14T18:27:02.234430] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-14T18:27:02.958909] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-09-14T18:27:04.422836] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-14T18:27:04.429011] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-09-14T18:27:04.536936] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (3.18 seconds). [2025-09-14T18:27:04.558808] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-09-14T18:27:05.682373] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T18:27:05.691722] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-09-14T18:27:05.768534] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-09-14T18:27:05.981033] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-14T18:27:05.985428] [INFO ] [REMOTE ] HNI: Full fetch complete (31167 records). [2025-09-14T18:27:05.985589] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-09-14T18:27:06.162865] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-09-14T18:27:06.372353] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-09-14T18:27:06.372614] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-09-14T18:27:06.373830] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-09-14T18:27:06.373968] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-09-14T18:27:06.375122] [DEBUG] [LOCAL ] HNI: Trimmed 31167 records to 21400 (keeping 150 days of data) [2025-09-14T18:27:06.495605] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-14T18:27:06.562476] [DEBUG] [LOCAL ] HNI: Primary data saved (21400 records). [2025-09-14T18:27:06.562674] [INFO ] [MAIN ] HNI: Full history saved. [2025-09-14T18:27:06.562795] [INFO ] [MAIN ] Update Progress: 1038/2370 symbols completed. HNI took 25.0s. Estimated remaining: 2h 21m 3s. Rate: 9.4 symbols/min [2025-09-14T18:27:06.918413] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:27:06.923816] [INFO ] [REMOTE ] HOG: Full fetch complete (55966 records). [2025-09-14T18:27:06.923933] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-09-14T18:27:06.966678] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-09-14T18:27:07.301386] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-09-14T18:27:07.301502] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-09-14T18:27:07.302361] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-09-14T18:27:07.302420] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-09-14T18:27:07.303707] [DEBUG] [LOCAL ] HOG: Trimmed 55966 records to 38253 (keeping 150 days of data) [2025-09-14T18:27:07.563654] [DEBUG] [LOCAL ] HOG: Primary data saved (38253 records). [2025-09-14T18:27:07.563857] [INFO ] [MAIN ] HOG: Full history saved. [2025-09-14T18:27:07.563994] [INFO ] [MAIN ] Update Progress: 1039/2370 symbols completed. HOG took 22.0s. Estimated remaining: 2h 20m 50s. Rate: 9.5 symbols/min [2025-09-14T18:27:08.621333] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-14T18:27:08.632174] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-09-14T18:27:10.234922] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-14T18:27:10.243902] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-09-14T18:27:11.785396] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-14T18:27:11.797291] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-09-14T18:27:13.487843] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T18:27:13.498437] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-09-14T18:27:15.064969] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T18:27:15.074282] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-09-14T18:27:16.046014] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-14T18:27:16.051067] [INFO ] [REMOTE ] HOMB: Full fetch complete (47551 records). [2025-09-14T18:27:16.051198] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-09-14T18:27:16.429438] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-09-14T18:27:16.429552] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-09-14T18:27:16.430389] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-09-14T18:27:16.430470] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-09-14T18:27:16.431520] [DEBUG] [LOCAL ] HOMB: Trimmed 47551 records to 32060 (keeping 150 days of data) [2025-09-14T18:27:16.633711] [DEBUG] [LOCAL ] HOMB: Primary data saved (32060 records). [2025-09-14T18:27:16.633882] [INFO ] [MAIN ] HOMB: Full history saved. [2025-09-14T18:27:16.633985] [INFO ] [MAIN ] Update Progress: 1040/2370 symbols completed. HOMB took 17.5s. Estimated remaining: 2h 20m 47s. Rate: 9.4 symbols/min [2025-09-14T18:27:17.289817] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:27:17.334444] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:27:17.339276] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:27:17.356384] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:27:17.376357] [DEBUG] [LOCAL ] HOV: Loaded 7379 existing records from primary storage. [2025-09-14T18:27:17.385112] [INFO ] [MAIN ] HOV: Loaded 7379 existing records. [2025-09-14T18:27:17.391154] [DEBUG] [LOCAL ] HOUS: Loaded 19797 existing records from primary storage. [2025-09-14T18:27:17.444583] [INFO ] [MAIN ] HOUS: Loaded 19797 existing records. [2025-09-14T18:27:17.458924] [DEBUG] [LOCAL ] HPE: Loaded 24061 existing records from primary storage. [2025-09-14T18:27:17.518582] [DEBUG] [LOCAL ] HP: Loaded 23241 existing records from primary storage. [2025-09-14T18:27:17.528983] [INFO ] [MAIN ] HPE: Loaded 24061 existing records. [2025-09-14T18:27:17.558604] [INFO ] [MAIN ] HP: Loaded 23241 existing records. [2025-09-14T18:27:17.879091] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:27:18.157824] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:27:18.095592] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-09-14T18:27:18.158086] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-09-14T18:27:18.157670] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:27:18.158465] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-09-14T18:27:18.158862] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-09-14T18:27:18.152938] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:27:18.158776] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-09-14T18:27:18.159024] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-09-14T18:27:18.159521] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-09-14T18:27:18.159604] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-09-14T18:27:18.159673] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-09-14T18:27:18.159850] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-09-14T18:27:18.165668] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-09-14T18:27:18.165716] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-09-14T18:27:18.228430] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-09-14T18:27:18.212814] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-09-14T18:27:18.165762] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-09-14T18:27:18.244139] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-09-14T18:27:19.449669] [INFO ] [REMOTE ] HOV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:27:19.610700] [INFO ] [REMOTE ] HP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:27:19.620739] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-09-14T18:27:19.621040] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-09-14T18:27:19.620375] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:27:19.698676] [INFO ] [REMOTE ] HPE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:27:19.690533] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-09-14T18:27:19.699094] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-09-14T18:27:20.668802] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T18:27:20.671577] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-09-14T18:27:20.902596] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-14T18:27:20.910546] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-09-14T18:27:21.343964] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-14T18:27:21.354369] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-09-14T18:27:21.549039] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T18:27:21.552024] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-09-14T18:27:21.593446] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-14T18:27:21.603819] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-09-14T18:27:22.389899] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-14T18:27:22.399698] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-09-14T18:27:22.633093] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T18:27:22.636486] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-09-14T18:27:23.325535] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T18:27:23.337288] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-09-14T18:27:23.512618] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-14T18:27:23.532301] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-09-14T18:27:23.532663] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-14T18:27:23.536930] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-09-14T18:27:23.874065] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-14T18:27:23.883952] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-09-14T18:27:24.278941] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-14T18:27:24.283810] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-09-14T18:27:24.834251] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-14T18:27:24.845500] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-09-14T18:27:25.073674] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-14T18:27:25.358863] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-09-14T18:27:25.439401] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-14T18:27:25.562457] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-14T18:27:26.158842] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-09-14T18:27:26.416808] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-14T18:27:26.466510] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-14T18:27:26.958870] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-09-14T18:27:27.613280] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-14T18:27:27.715327] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:27:27.717193] [INFO ] [REMOTE ] HOV: Full fetch complete (14767 records). [2025-09-14T18:27:27.717280] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-09-14T18:27:27.763877] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-09-14T18:27:28.082296] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-09-14T18:27:28.082441] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-09-14T18:27:28.082858] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-09-14T18:27:28.082922] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-09-14T18:27:28.083495] [DEBUG] [LOCAL ] HOV: Trimmed 14767 records to 10650 (keeping 150 days of data) [2025-09-14T18:27:28.148961] [DEBUG] [LOCAL ] HOV: Primary data saved (10650 records). [2025-09-14T18:27:28.149126] [INFO ] [MAIN ] HOV: Full history saved. [2025-09-14T18:27:28.149230] [INFO ] [MAIN ] Update Progress: 1041/2370 symbols completed. HOV took 11.5s. Estimated remaining: 2h 20m 47s. Rate: 9.4 symbols/min [2025-09-14T18:27:28.329080] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:27:28.335196] [DEBUG] [LOCAL ] HPF: Loaded 3590 existing records from primary storage. [2025-09-14T18:27:28.335335] [INFO ] [MAIN ] HPF: Loaded 3590 existing records. [2025-09-14T18:27:28.512893] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:27:28.513197] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-09-14T18:27:28.513273] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-09-14T18:27:28.513532] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-09-14T18:27:28.513599] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-09-14T18:27:28.567531] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-09-14T18:27:28.871937] [INFO ] [REMOTE ] HPF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:27:29.358827] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-09-14T18:27:30.108618] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-14T18:27:30.158799] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-09-14T18:27:30.312449] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-09-14T18:27:30.415581] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T18:27:30.855923] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-14T18:27:30.958829] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-09-14T18:27:31.722616] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-14T18:27:31.758823] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-09-14T18:27:32.558841] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-09-14T18:27:33.230759] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-14T18:27:33.358826] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-09-14T18:27:34.158849] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-09-14T18:27:34.541428] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-14T18:27:34.958846] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-09-14T18:27:35.640024] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-14T18:27:35.758796] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-09-14T18:27:35.791961] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T18:27:36.558836] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-09-14T18:27:36.794414] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T18:27:37.358879] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-09-14T18:27:37.790750] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-14T18:27:38.089534] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-14T18:27:38.094468] [INFO ] [REMOTE ] HOUS: Full fetch complete (47464 records). [2025-09-14T18:27:38.094600] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-09-14T18:27:38.163927] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-09-14T18:27:38.225568] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T18:27:38.498561] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-09-14T18:27:38.498700] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-09-14T18:27:38.499722] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-09-14T18:27:38.499802] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-09-14T18:27:38.500992] [DEBUG] [LOCAL ] HOUS: Trimmed 47464 records to 33145 (keeping 150 days of data) [2025-09-14T18:27:38.700901] [DEBUG] [LOCAL ] HOUS: Primary data saved (33145 records). [2025-09-14T18:27:38.701102] [INFO ] [MAIN ] HOUS: Full history saved. [2025-09-14T18:27:38.701255] [INFO ] [MAIN ] Update Progress: 1042/2370 symbols completed. HOUS took 22.1s. Estimated remaining: 2h 20m 46s. Rate: 9.4 symbols/min [2025-09-14T18:27:38.880864] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:27:38.889557] [DEBUG] [LOCAL ] HPI: Loaded 5208 existing records from primary storage. [2025-09-14T18:27:38.889783] [INFO ] [MAIN ] HPI: Loaded 5208 existing records. [2025-09-14T18:27:38.964032] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-09-14T18:27:39.074474] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:27:39.074761] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-09-14T18:27:39.074824] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-09-14T18:27:39.075151] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-09-14T18:27:39.075212] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-09-14T18:27:39.427686] [INFO ] [REMOTE ] HPI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:27:39.758831] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-09-14T18:27:39.827582] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T18:27:40.093451] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-14T18:27:40.221368] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-14T18:27:40.558860] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-09-14T18:27:41.358910] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-09-14T18:27:41.392344] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-14T18:27:42.158835] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-09-14T18:27:42.178960] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-14T18:27:42.849019] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:27:42.854988] [INFO ] [REMOTE ] HP: Full fetch complete (56297 records). [2025-09-14T18:27:42.855231] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-09-14T18:27:42.960331] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-09-14T18:27:43.253613] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-09-14T18:27:43.253761] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-09-14T18:27:43.254588] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-09-14T18:27:43.254672] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-09-14T18:27:43.256068] [DEBUG] [LOCAL ] HP: Trimmed 56297 records to 39084 (keeping 150 days of data) [2025-09-14T18:27:43.529187] [DEBUG] [LOCAL ] HP: Primary data saved (39084 records). [2025-09-14T18:27:43.529451] [INFO ] [MAIN ] HP: Full history saved. [2025-09-14T18:27:43.529591] [INFO ] [MAIN ] Update Progress: 1043/2370 symbols completed. HP took 26.9s. Estimated remaining: 2h 20m 38s. Rate: 9.4 symbols/min [2025-09-14T18:27:43.702485] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:27:43.711805] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-14T18:27:43.735099] [DEBUG] [LOCAL ] HPP: Loaded 23563 existing records from primary storage. [2025-09-14T18:27:43.735291] [INFO ] [MAIN ] HPP: Loaded 23563 existing records. [2025-09-14T18:27:43.764535] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-09-14T18:27:43.918103] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:27:43.918393] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-09-14T18:27:43.918464] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-09-14T18:27:43.919036] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-09-14T18:27:43.919099] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-09-14T18:27:44.282015] [INFO ] [REMOTE ] HPP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:27:44.296676] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T18:27:44.302147] [INFO ] [REMOTE ] HPE: Full fetch complete (58377 records). [2025-09-14T18:27:44.302319] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-09-14T18:27:44.564052] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-09-14T18:27:44.699874] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-09-14T18:27:44.700014] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-09-14T18:27:44.700964] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-09-14T18:27:44.701060] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-09-14T18:27:44.702511] [DEBUG] [LOCAL ] HPE: Trimmed 58377 records to 40437 (keeping 150 days of data) [2025-09-14T18:27:44.973516] [DEBUG] [LOCAL ] HPE: Primary data saved (40437 records). [2025-09-14T18:27:44.973722] [INFO ] [MAIN ] HPE: Full history saved. [2025-09-14T18:27:44.973898] [INFO ] [MAIN ] Update Progress: 1044/2370 symbols completed. HPE took 28.3s. Estimated remaining: 2h 20m 25s. Rate: 9.4 symbols/min [2025-09-14T18:27:45.162181] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:27:45.184695] [DEBUG] [LOCAL ] HPQ: Loaded 24086 existing records from primary storage. [2025-09-14T18:27:45.184861] [INFO ] [MAIN ] HPQ: Loaded 24086 existing records. [2025-09-14T18:27:45.367299] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T18:27:45.366728] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-09-14T18:27:45.372575] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:27:45.374866] [INFO ] [REMOTE ] HPF: Full fetch complete (7706 records). [2025-09-14T18:27:45.376026] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-09-14T18:27:45.376190] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-09-14T18:27:45.376087] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-09-14T18:27:45.387989] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-09-14T18:27:45.440946] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-09-14T18:27:46.040346] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-09-14T18:27:46.074923] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-09-14T18:27:46.109580] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-09-14T18:27:46.113353] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:27:46.113798] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-09-14T18:27:46.114255] [DEBUG] [LOCAL ] HPF: Trimmed 7706 records to 5597 (keeping 150 days of data) [2025-09-14T18:27:46.149813] [DEBUG] [LOCAL ] HPF: Primary data saved (5597 records). [2025-09-14T18:27:46.149999] [INFO ] [MAIN ] HPF: Full history saved. [2025-09-14T18:27:46.150129] [INFO ] [MAIN ] Update Progress: 1045/2370 symbols completed. HPF took 18.0s. Estimated remaining: 2h 20m 12s. Rate: 9.5 symbols/min [2025-09-14T18:27:46.163966] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-09-14T18:27:46.325979] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:27:46.333477] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-14T18:27:46.342088] [DEBUG] [LOCAL ] HPS: Loaded 5295 existing records from primary storage. [2025-09-14T18:27:46.342255] [INFO ] [MAIN ] HPS: Loaded 5295 existing records. [2025-09-14T18:27:46.530040] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:27:46.530379] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-09-14T18:27:46.530458] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-09-14T18:27:46.530826] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-09-14T18:27:46.530891] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-09-14T18:27:46.895709] [INFO ] [REMOTE ] HPS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:27:46.958838] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-09-14T18:27:47.758899] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-09-14T18:27:47.793931] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-14T18:27:48.150136] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-14T18:27:48.558927] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-09-14T18:27:49.358858] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-09-14T18:27:49.418868] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T18:27:49.427230] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T18:27:49.845363] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-14T18:27:50.158845] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-09-14T18:27:50.958865] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-09-14T18:27:51.758896] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-09-14T18:27:51.833426] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T18:27:51.868130] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-14T18:27:52.558873] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-09-14T18:27:52.648298] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-14T18:27:53.358881] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-09-14T18:27:54.148949] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T18:27:54.159326] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-09-14T18:27:54.229059] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T18:27:54.958887] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-09-14T18:27:54.985076] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-14T18:27:55.758909] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-09-14T18:27:56.558918] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-09-14T18:27:56.612952] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-14T18:27:56.962386] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-14T18:27:57.358865] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-09-14T18:27:58.094541] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T18:27:58.158870] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-09-14T18:27:58.951562] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-14T18:27:58.958772] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-09-14T18:27:59.530405] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-14T18:27:59.758826] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-09-14T18:27:59.850835] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-14T18:27:59.853009] [INFO ] [REMOTE ] HPI: Full fetch complete (10062 records). [2025-09-14T18:27:59.853094] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-09-14T18:28:00.211380] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-09-14T18:28:00.211480] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-09-14T18:28:00.211741] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-09-14T18:28:00.211797] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-09-14T18:28:00.212259] [DEBUG] [LOCAL ] HPI: Trimmed 10062 records to 7619 (keeping 150 days of data) [2025-09-14T18:28:00.260740] [DEBUG] [LOCAL ] HPI: Primary data saved (7619 records). [2025-09-14T18:28:00.260868] [INFO ] [MAIN ] HPI: Full history saved. [2025-09-14T18:28:00.260982] [INFO ] [MAIN ] Update Progress: 1046/2370 symbols completed. HPI took 21.6s. Estimated remaining: 2h 20m 16s. Rate: 9.4 symbols/min [2025-09-14T18:28:00.428889] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:28:00.441080] [DEBUG] [LOCAL ] HQH: Loaded 11345 existing records from primary storage. [2025-09-14T18:28:00.441219] [INFO ] [MAIN ] HQH: Loaded 11345 existing records. [2025-09-14T18:28:00.563934] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-09-14T18:28:00.623600] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:28:00.623848] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-09-14T18:28:00.623909] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-09-14T18:28:00.632695] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-09-14T18:28:00.633533] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-14T18:28:00.633603] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-09-14T18:28:00.989475] [INFO ] [REMOTE ] HQH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:28:01.358887] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-09-14T18:28:02.158906] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-09-14T18:28:02.414509] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T18:28:02.457159] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T18:28:02.958840] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-09-14T18:28:03.758797] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-09-14T18:28:04.108032] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-14T18:28:04.153252] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-14T18:28:04.558856] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-09-14T18:28:05.358836] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-09-14T18:28:05.624355] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-14T18:28:05.651114] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T18:28:05.880149] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-14T18:28:06.158859] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-09-14T18:28:06.845333] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:28:06.846988] [INFO ] [REMOTE ] HPS: Full fetch complete (11380 records). [2025-09-14T18:28:06.847089] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-09-14T18:28:06.963974] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-09-14T18:28:07.226893] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-09-14T18:28:07.227105] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-09-14T18:28:07.227627] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-09-14T18:28:07.227759] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-09-14T18:28:07.229711] [DEBUG] [LOCAL ] HPS: Trimmed 11380 records to 7697 (keeping 150 days of data) [2025-09-14T18:28:07.290275] [DEBUG] [LOCAL ] HPS: Primary data saved (7697 records). [2025-09-14T18:28:07.290533] [INFO ] [MAIN ] HPS: Full history saved. [2025-09-14T18:28:07.290705] [INFO ] [MAIN ] Update Progress: 1047/2370 symbols completed. HPS took 21.1s. Estimated remaining: 2h 20m 10s. Rate: 9.4 symbols/min [2025-09-14T18:28:07.475781] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:28:07.490473] [DEBUG] [LOCAL ] HQL: Loaded 7398 existing records from primary storage. [2025-09-14T18:28:07.490725] [INFO ] [MAIN ] HQL: Loaded 7398 existing records. [2025-09-14T18:28:07.686062] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:28:07.686471] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-09-14T18:28:07.686596] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-09-14T18:28:07.687125] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-09-14T18:28:07.687211] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-09-14T18:28:07.766839] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-09-14T18:28:08.061774] [INFO ] [REMOTE ] HQL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:28:08.270591] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-14T18:28:08.558882] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-09-14T18:28:09.351990] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-14T18:28:09.358762] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-09-14T18:28:09.535982] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T18:28:10.158879] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-09-14T18:28:10.396909] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-14T18:28:10.958884] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-09-14T18:28:11.758842] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-09-14T18:28:11.910511] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-14T18:28:12.100795] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-14T18:28:12.558801] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-09-14T18:28:12.844151] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T18:28:13.358846] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-09-14T18:28:13.903914] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T18:28:14.158850] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-09-14T18:28:14.272634] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-14T18:28:14.958880] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-09-14T18:28:15.758821] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-09-14T18:28:15.919772] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-14T18:28:16.147126] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T18:28:16.153354] [INFO ] [REMOTE ] HPP: Full fetch complete (54880 records). [2025-09-14T18:28:16.153607] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-09-14T18:28:16.404149] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-14T18:28:16.563889] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-09-14T18:28:16.617837] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-09-14T18:28:16.617957] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-09-14T18:28:16.619127] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-09-14T18:28:16.619208] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-09-14T18:28:16.620602] [DEBUG] [LOCAL ] HPP: Trimmed 54880 records to 38521 (keeping 150 days of data) [2025-09-14T18:28:16.860994] [DEBUG] [LOCAL ] HPP: Primary data saved (38521 records). [2025-09-14T18:28:16.861170] [INFO ] [MAIN ] HPP: Full history saved. [2025-09-14T18:28:16.861285] [INFO ] [MAIN ] Update Progress: 1048/2370 symbols completed. HPP took 33.3s. Estimated remaining: 2h 20m 8s. Rate: 9.4 symbols/min [2025-09-14T18:28:17.036843] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:28:17.064163] [DEBUG] [LOCAL ] HR: Loaded 23459 existing records from primary storage. [2025-09-14T18:28:17.064332] [INFO ] [MAIN ] HR: Loaded 23459 existing records. [2025-09-14T18:28:17.246432] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:28:17.246745] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-09-14T18:28:17.246820] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-09-14T18:28:17.247569] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-09-14T18:28:17.247672] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-09-14T18:28:17.364089] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-09-14T18:28:17.611113] [INFO ] [REMOTE ] HR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:28:17.715206] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T18:28:18.158906] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-09-14T18:28:18.779245] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-14T18:28:18.794481] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-14T18:28:18.958839] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-09-14T18:28:19.758817] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-09-14T18:28:19.998663] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-14T18:28:20.001229] [INFO ] [REMOTE ] HQH: Full fetch complete (27208 records). [2025-09-14T18:28:20.001357] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-09-14T18:28:20.371618] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-09-14T18:28:20.371760] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-09-14T18:28:20.372393] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-09-14T18:28:20.372456] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-09-14T18:28:20.373278] [DEBUG] [LOCAL ] HQH: Trimmed 27208 records to 18918 (keeping 150 days of data) [2025-09-14T18:28:20.494673] [DEBUG] [LOCAL ] HQH: Primary data saved (18918 records). [2025-09-14T18:28:20.494852] [INFO ] [MAIN ] HQH: Full history saved. [2025-09-14T18:28:20.494996] [INFO ] [MAIN ] Update Progress: 1049/2370 symbols completed. HQH took 20.2s. Estimated remaining: 2h 19m 58s. Rate: 9.4 symbols/min [2025-09-14T18:28:20.564076] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-09-14T18:28:20.669862] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:28:20.690817] [DEBUG] [LOCAL ] HRB: Loaded 21731 existing records from primary storage. [2025-09-14T18:28:20.690977] [INFO ] [MAIN ] HRB: Loaded 21731 existing records. [2025-09-14T18:28:20.865315] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:28:20.865585] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-09-14T18:28:20.865659] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-09-14T18:28:20.866232] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-09-14T18:28:20.866291] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-09-14T18:28:21.220809] [INFO ] [REMOTE ] HRB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:28:21.358797] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-09-14T18:28:21.796763] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-14T18:28:21.837061] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-14T18:28:22.127971] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T18:28:22.129956] [INFO ] [REMOTE ] HQL: Full fetch complete (17944 records). [2025-09-14T18:28:22.130063] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-09-14T18:28:22.164006] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-09-14T18:28:22.499126] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-09-14T18:28:22.499232] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-09-14T18:28:22.499809] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-09-14T18:28:22.499871] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-09-14T18:28:22.500488] [DEBUG] [LOCAL ] HQL: Trimmed 17944 records to 11831 (keeping 150 days of data) [2025-09-14T18:28:22.576291] [DEBUG] [LOCAL ] HQL: Primary data saved (11831 records). [2025-09-14T18:28:22.576453] [INFO ] [MAIN ] HQL: Full history saved. [2025-09-14T18:28:22.576558] [INFO ] [MAIN ] Update Progress: 1050/2370 symbols completed. HQL took 15.3s. Estimated remaining: 2h 19m 46s. Rate: 9.4 symbols/min [2025-09-14T18:28:22.748627] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:28:22.765472] [DEBUG] [LOCAL ] HRI: Loaded 14087 existing records from primary storage. [2025-09-14T18:28:22.765701] [INFO ] [MAIN ] HRI: Loaded 14087 existing records. [2025-09-14T18:28:22.956393] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:28:22.956800] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-09-14T18:28:22.957165] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-09-14T18:28:22.957940] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-09-14T18:28:22.958025] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-09-14T18:28:22.963934] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-09-14T18:28:23.358379] [INFO ] [REMOTE ] HRI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:28:23.758835] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-09-14T18:28:24.021308] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T18:28:24.421427] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:28:24.427869] [INFO ] [REMOTE ] HPQ: Full fetch complete (58348 records). [2025-09-14T18:28:24.428008] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-09-14T18:28:24.569140] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-09-14T18:28:24.815146] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-09-14T18:28:24.815360] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-09-14T18:28:24.816356] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-09-14T18:28:24.816459] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-09-14T18:28:24.818122] [DEBUG] [LOCAL ] HPQ: Trimmed 58348 records to 40412 (keeping 150 days of data) [2025-09-14T18:28:24.938746] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-14T18:28:25.114832] [DEBUG] [LOCAL ] HPQ: Primary data saved (40412 records). [2025-09-14T18:28:25.115000] [INFO ] [MAIN ] HPQ: Full history saved. [2025-09-14T18:28:25.115107] [INFO ] [MAIN ] Update Progress: 1051/2370 symbols completed. HPQ took 40.1s. Estimated remaining: 2h 19m 35s. Rate: 9.4 symbols/min [2025-09-14T18:28:25.282301] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:28:25.306407] [DEBUG] [LOCAL ] HRL: Loaded 23808 existing records from primary storage. [2025-09-14T18:28:25.306623] [INFO ] [MAIN ] HRL: Loaded 23808 existing records. [2025-09-14T18:28:25.367963] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-09-14T18:28:25.485855] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:28:25.486133] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-09-14T18:28:25.486199] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-09-14T18:28:25.487021] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-09-14T18:28:25.487089] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-09-14T18:28:25.843611] [INFO ] [REMOTE ] HRL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:28:26.089193] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T18:28:26.158787] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-09-14T18:28:26.898987] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-14T18:28:26.958785] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-09-14T18:28:27.486375] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T18:28:27.758831] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-09-14T18:28:28.558793] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-09-14T18:28:28.720755] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-14T18:28:29.358828] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-09-14T18:28:29.701920] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-14T18:28:30.058124] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T18:28:30.158847] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-09-14T18:28:30.958879] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-09-14T18:28:31.194468] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T18:28:31.758846] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-09-14T18:28:32.077483] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T18:28:32.369373] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-14T18:28:32.558828] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-09-14T18:28:33.358892] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-09-14T18:28:33.438797] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-14T18:28:34.158900] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-09-14T18:28:34.483279] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-14T18:28:34.958819] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-09-14T18:28:35.025183] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T18:28:35.282958] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T18:28:35.758898] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-09-14T18:28:36.558856] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-09-14T18:28:36.798785] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-14T18:28:37.358831] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-09-14T18:28:37.560765] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-14T18:28:38.021552] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T18:28:38.158842] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-09-14T18:28:38.958801] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-09-14T18:28:39.038798] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T18:28:39.758793] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-09-14T18:28:39.873512] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T18:28:40.334120] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-14T18:28:40.558834] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-09-14T18:28:41.369898] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-09-14T18:28:41.399133] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T18:28:41.996908] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T18:28:42.158825] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-09-14T18:28:42.958833] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-09-14T18:28:43.140266] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T18:28:43.758843] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-09-14T18:28:44.026149] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-14T18:28:44.046952] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-14T18:28:44.052553] [INFO ] [REMOTE ] HRI: Full fetch complete (36556 records). [2025-09-14T18:28:44.052902] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-09-14T18:28:44.447357] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-09-14T18:28:44.447607] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-09-14T18:28:44.449015] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-09-14T18:28:44.449150] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-09-14T18:28:44.450897] [DEBUG] [LOCAL ] HRI: Trimmed 36556 records to 24307 (keeping 150 days of data) [2025-09-14T18:28:44.571057] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T18:28:44.571177] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-09-14T18:28:44.643746] [INFO ] [REMOTE ] HRL: Full fetch complete (57710 records). [2025-09-14T18:28:44.647709] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-09-14T18:28:44.650076] [DEBUG] [LOCAL ] HRI: Primary data saved (24307 records). [2025-09-14T18:28:44.650671] [INFO ] [MAIN ] HRI: Full history saved. [2025-09-14T18:28:44.650806] [INFO ] [MAIN ] Update Progress: 1052/2370 symbols completed. HRI took 22.1s. Estimated remaining: 2h 19m 45s. Rate: 9.4 symbols/min [2025-09-14T18:28:45.083128] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:28:45.264833] [DEBUG] [LOCAL ] HRTG: Loaded 14492 existing records from primary storage. [2025-09-14T18:28:45.282006] [INFO ] [MAIN ] HRTG: Loaded 14492 existing records. [2025-09-14T18:28:45.282195] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-09-14T18:28:45.325788] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-09-14T18:28:45.349019] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-09-14T18:28:45.375577] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-09-14T18:28:45.360227] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-09-14T18:28:45.468172] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:28:45.468818] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-09-14T18:28:45.468693] [DEBUG] [LOCAL ] HRL: Trimmed 57710 records to 39940 (keeping 150 days of data) [2025-09-14T18:28:45.469396] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-09-14T18:28:45.470003] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-09-14T18:28:45.470080] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-09-14T18:28:45.953359] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:28:46.102174] [DEBUG] [LOCAL ] HRL: Primary data saved (39940 records). [2025-09-14T18:28:46.102357] [INFO ] [MAIN ] HRL: Full history saved. [2025-09-14T18:28:46.102482] [INFO ] [MAIN ] Update Progress: 1053/2370 symbols completed. HRL took 21.0s. Estimated remaining: 2h 19m 33s. Rate: 9.4 symbols/min [2025-09-14T18:28:46.166092] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-09-14T18:28:46.276307] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:28:46.298051] [DEBUG] [LOCAL ] HSBC: Loaded 22576 existing records from primary storage. [2025-09-14T18:28:46.298221] [INFO ] [MAIN ] HSBC: Loaded 22576 existing records. [2025-09-14T18:28:46.478258] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:28:46.478711] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-09-14T18:28:46.478815] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-09-14T18:28:46.489006] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-09-14T18:28:46.505371] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-09-14T18:28:46.587582] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-14T18:28:46.874047] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:28:46.905996] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-14T18:28:46.939499] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-14T18:28:46.958781] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-09-14T18:28:47.397377] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T18:28:47.403027] [INFO ] [REMOTE ] HR: Full fetch complete (56310 records). [2025-09-14T18:28:47.403206] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-09-14T18:28:47.762244] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-09-14T18:28:47.802842] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-09-14T18:28:47.802976] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-09-14T18:28:47.804162] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-09-14T18:28:47.804246] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-09-14T18:28:47.805921] [DEBUG] [LOCAL ] HR: Trimmed 56310 records to 39162 (keeping 150 days of data) [2025-09-14T18:28:48.067900] [DEBUG] [LOCAL ] HR: Primary data saved (39162 records). [2025-09-14T18:28:48.068070] [INFO ] [MAIN ] HR: Full history saved. [2025-09-14T18:28:48.068172] [INFO ] [MAIN ] Update Progress: 1054/2370 symbols completed. HR took 31.2s. Estimated remaining: 2h 19m 21s. Rate: 9.4 symbols/min [2025-09-14T18:28:48.242027] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:28:48.250135] [DEBUG] [LOCAL ] HSHP: Loaded 6495 existing records from primary storage. [2025-09-14T18:28:48.250280] [INFO ] [MAIN ] HSHP: Loaded 6495 existing records. [2025-09-14T18:28:48.430882] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:28:48.431373] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-09-14T18:28:48.431597] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-09-14T18:28:48.431996] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-09-14T18:28:48.432070] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-09-14T18:28:48.561266] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-09-14T18:28:48.577987] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T18:28:48.692571] [INFO ] [REMOTE ] HRB: Full fetch complete (52869 records). [2025-09-14T18:28:48.738238] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-09-14T18:28:48.922607] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:28:49.205224] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-09-14T18:28:49.205339] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-09-14T18:28:49.206244] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-09-14T18:28:49.206311] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-09-14T18:28:49.207506] [DEBUG] [LOCAL ] HRB: Trimmed 52869 records to 36481 (keeping 150 days of data) [2025-09-14T18:28:49.392618] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-09-14T18:28:49.463578] [DEBUG] [LOCAL ] HRB: Primary data saved (36481 records). [2025-09-14T18:28:49.463782] [INFO ] [MAIN ] HRB: Full history saved. [2025-09-14T18:28:49.463897] [INFO ] [MAIN ] Update Progress: 1055/2370 symbols completed. HRB took 29.0s. Estimated remaining: 2h 19m 8s. Rate: 9.5 symbols/min [2025-09-14T18:28:49.639278] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:28:49.666670] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-14T18:28:49.695328] [DEBUG] [LOCAL ] HSY: Loaded 22597 existing records from primary storage. [2025-09-14T18:28:49.695564] [INFO ] [MAIN ] HSY: Loaded 22597 existing records. [2025-09-14T18:28:49.871374] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:28:49.871686] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-09-14T18:28:49.871785] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-09-14T18:28:49.872633] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-09-14T18:28:49.872760] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-09-14T18:28:50.160779] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-09-14T18:28:50.243098] [INFO ] [REMOTE ] HSY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:28:50.463756] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T18:28:50.958883] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-09-14T18:28:51.416712] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-14T18:28:51.758840] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-09-14T18:28:52.558872] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-09-14T18:28:52.788497] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-14T18:28:53.273998] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-14T18:28:53.358780] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-09-14T18:28:53.608998] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T18:28:54.158821] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-09-14T18:28:54.859247] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T18:28:54.958832] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-09-14T18:28:55.074302] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-14T18:28:55.758833] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-09-14T18:28:56.123463] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-14T18:28:56.558795] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-09-14T18:28:56.688725] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-14T18:28:57.358871] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-09-14T18:28:57.754863] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T18:28:58.158881] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-09-14T18:28:58.225855] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T18:28:58.958881] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-09-14T18:28:59.631203] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T18:28:59.758779] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-09-14T18:28:59.935137] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-14T18:29:00.558902] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-09-14T18:29:00.970202] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-14T18:29:00.973489] [INFO ] [REMOTE ] HRTG: Full fetch complete (33610 records). [2025-09-14T18:29:00.973605] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-09-14T18:29:01.345059] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-09-14T18:29:01.345167] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-09-14T18:29:01.345948] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-09-14T18:29:01.346053] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-09-14T18:29:01.347006] [DEBUG] [LOCAL ] HRTG: Trimmed 33610 records to 25534 (keeping 150 days of data) [2025-09-14T18:29:01.397766] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-09-14T18:29:01.506985] [DEBUG] [LOCAL ] HRTG: Primary data saved (25534 records). [2025-09-14T18:29:01.507285] [INFO ] [MAIN ] HRTG: Full history saved. [2025-09-14T18:29:01.507487] [INFO ] [MAIN ] Update Progress: 1056/2370 symbols completed. HRTG took 16.9s. Estimated remaining: 2h 19m 9s. Rate: 9.4 symbols/min [2025-09-14T18:29:01.684123] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:29:01.719368] [DEBUG] [LOCAL ] HTB: Loaded 3145 existing records from primary storage. [2025-09-14T18:29:01.721165] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T18:29:01.732097] [INFO ] [MAIN ] HTB: Loaded 3145 existing records. [2025-09-14T18:29:01.912701] [WARN ] [MAIN ] HTB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:29:01.912960] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-09-14T18:29:01.913035] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-14T18:29:01.913352] [DEBUG] [LOCAL ] HTB: Deleted primary data file. [2025-09-14T18:29:01.913411] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-09-14T18:29:02.163928] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-09-14T18:29:02.267030] [INFO ] [REMOTE ] HTB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:29:02.958830] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-02. [2025-09-14T18:29:03.100770] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-14T18:29:03.312613] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-14T18:29:03.374852] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-14T18:29:03.758858] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-09-14T18:29:04.558891] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-09-14T18:29:04.898621] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-14T18:29:04.984733] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T18:29:04.990112] [INFO ] [REMOTE ] HSBC: Full fetch complete (55792 records). [2025-09-14T18:29:04.990294] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-09-14T18:29:05.364720] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-09-14T18:29:05.386469] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-09-14T18:29:05.386696] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-09-14T18:29:05.388335] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-09-14T18:29:05.388574] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-09-14T18:29:05.390561] [DEBUG] [LOCAL ] HSBC: Trimmed 55792 records to 38237 (keeping 150 days of data) [2025-09-14T18:29:05.661395] [DEBUG] [LOCAL ] HSBC: Primary data saved (38237 records). [2025-09-14T18:29:05.661660] [INFO ] [MAIN ] HSBC: Full history saved. [2025-09-14T18:29:05.661790] [INFO ] [MAIN ] Update Progress: 1057/2370 symbols completed. HSBC took 19.6s. Estimated remaining: 2h 19m 0s. Rate: 9.4 symbols/min [2025-09-14T18:29:05.843265] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:29:05.853287] [DEBUG] [LOCAL ] HTD: Loaded 6316 existing records from primary storage. [2025-09-14T18:29:05.853504] [INFO ] [MAIN ] HTD: Loaded 6316 existing records. [2025-09-14T18:29:06.090856] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:29:06.091239] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-09-14T18:29:06.091306] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-09-14T18:29:06.091852] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-09-14T18:29:06.091920] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-09-14T18:29:06.164087] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-03. [2025-09-14T18:29:06.444491] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-14T18:29:06.479054] [INFO ] [REMOTE ] HTD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:29:06.952973] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-14T18:29:06.958759] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-04. [2025-09-14T18:29:07.758849] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-09-14T18:29:07.828334] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-14T18:29:08.344673] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-14T18:29:08.558880] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-05. [2025-09-14T18:29:09.319953] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-14T18:29:09.358779] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-06. [2025-09-14T18:29:10.111797] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-14T18:29:10.158809] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-07. [2025-09-14T18:29:10.921088] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-14T18:29:10.958805] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-09-14T18:29:11.758930] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-09-14T18:29:11.918183] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-14T18:29:12.558908] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-09-14T18:29:13.358880] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-08. [2025-09-14T18:29:13.428001] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T18:29:13.644694] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T18:29:14.117598] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-14T18:29:14.158855] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-09. [2025-09-14T18:29:14.797882] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T18:29:14.799352] [INFO ] [REMOTE ] HTB: Full fetch complete (6869 records). [2025-09-14T18:29:14.799439] [DEBUG] [VALIDATOR ] HTB: Validating primary data. [2025-09-14T18:29:14.962084] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-09-14T18:29:14.991760] [WARN ] [VALIDATOR ] HTB: Validation failed - insufficient historical data. Have 136 unique days, need 150 days [2025-09-14T18:29:14.992047] [FATAL] [MAIN ] HTB: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:29:14.992100] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:29:14.992149] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-14T18:29:14.992222] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-14T18:29:14.992273] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-09-14T18:29:14.992335] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-09-14T18:29:14.992426] [INFO ] [MAIN ] Update Progress: 1058/2370 symbols completed. HTB took 13.5s. Estimated remaining: 2h 18m 57s. Rate: 9.4 symbols/min [2025-09-14T18:29:15.166331] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:29:15.168344] [DEBUG] [LOCAL ] HTFC: Loaded 156 existing records from primary storage. [2025-09-14T18:29:15.168430] [INFO ] [MAIN ] HTFC: Loaded 156 existing records. [2025-09-14T18:29:15.346120] [WARN ] [MAIN ] HTFC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:29:15.346397] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-09-14T18:29:15.346461] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-14T18:29:15.346730] [DEBUG] [LOCAL ] HTFC: Deleted primary data file. [2025-09-14T18:29:15.347339] [DEBUG] [LOCAL ] HTFC: Removed from QA tracker. [2025-09-14T18:29:15.347403] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-09-14T18:29:15.701401] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:29:15.758830] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-09-14T18:29:16.083753] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-14T18:29:16.139262] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-14T18:29:16.558894] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-09-14T18:29:16.926946] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-14T18:29:17.358856] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-09-14T18:29:18.158849] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-09-14T18:29:18.439187] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-14T18:29:18.635503] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-14T18:29:18.958924] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-09-14T18:29:19.758904] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-09-14T18:29:20.558889] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-09-14T18:29:20.584220] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T18:29:20.818332] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T18:29:20.928863] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-14T18:29:21.358864] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-09-14T18:29:22.158827] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-09-14T18:29:22.205811] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-14T18:29:22.447813] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-14T18:29:22.958844] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-09-14T18:29:23.758834] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-09-14T18:29:24.558838] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-09-14T18:29:24.683975] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T18:29:24.778923] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T18:29:25.327206] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T18:29:25.329208] [INFO ] [REMOTE ] HSHP: Full fetch complete (17525 records). [2025-09-14T18:29:25.329292] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-09-14T18:29:25.364006] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-09-14T18:29:25.706280] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-09-14T18:29:25.706407] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-09-14T18:29:25.707006] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-09-14T18:29:25.707070] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-09-14T18:29:25.707706] [DEBUG] [LOCAL ] HSHP: Trimmed 17525 records to 10277 (keeping 150 days of data) [2025-09-14T18:29:25.768897] [DEBUG] [LOCAL ] HSHP: Primary data saved (10277 records). [2025-09-14T18:29:25.769085] [INFO ] [MAIN ] HSHP: Full history saved. [2025-09-14T18:29:25.769205] [INFO ] [MAIN ] Update Progress: 1059/2370 symbols completed. HSHP took 37.7s. Estimated remaining: 2h 18m 57s. Rate: 9.4 symbols/min [2025-09-14T18:29:25.937538] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:29:25.959818] [DEBUG] [LOCAL ] HTGC: Loaded 20628 existing records from primary storage. [2025-09-14T18:29:25.959993] [INFO ] [MAIN ] HTGC: Loaded 20628 existing records. [2025-09-14T18:29:26.138502] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:29:26.138766] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-09-14T18:29:26.138846] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-09-14T18:29:26.139506] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-09-14T18:29:26.139568] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-09-14T18:29:26.169543] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-09-14T18:29:26.522882] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:29:26.535400] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-14T18:29:26.958904] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-09-14T18:29:27.758868] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-09-14T18:29:27.869633] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-14T18:29:27.965884] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-14T18:29:28.062101] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-14T18:29:28.558826] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-09-14T18:29:29.358825] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-09-14T18:29:30.105567] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T18:29:30.158780] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-09-14T18:29:30.173329] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T18:29:30.175196] [INFO ] [REMOTE ] HTD: Full fetch complete (14157 records). [2025-09-14T18:29:30.175283] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-09-14T18:29:30.527883] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-09-14T18:29:30.527995] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-09-14T18:29:30.528345] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-09-14T18:29:30.528399] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-09-14T18:29:30.528928] [DEBUG] [LOCAL ] HTD: Trimmed 14157 records to 9986 (keeping 150 days of data) [2025-09-14T18:29:30.591993] [DEBUG] [LOCAL ] HTD: Primary data saved (9986 records). [2025-09-14T18:29:30.592156] [INFO ] [MAIN ] HTD: Full history saved. [2025-09-14T18:29:30.592257] [INFO ] [MAIN ] Update Progress: 1060/2370 symbols completed. HTD took 24.9s. Estimated remaining: 2h 18m 48s. Rate: 9.4 symbols/min [2025-09-14T18:29:30.761387] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:29:30.777242] [DEBUG] [LOCAL ] HTH: Loaded 15124 existing records from primary storage. [2025-09-14T18:29:30.777430] [INFO ] [MAIN ] HTH: Loaded 15124 existing records. [2025-09-14T18:29:30.949828] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:29:30.950097] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-09-14T18:29:30.950155] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-09-14T18:29:30.950718] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-09-14T18:29:30.950780] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-09-14T18:29:30.963906] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-09-14T18:29:31.296705] [INFO ] [REMOTE ] HTH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:29:31.758860] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-09-14T18:29:32.113557] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T18:29:32.558879] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-09-14T18:29:32.679332] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T18:29:33.317029] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T18:29:33.358897] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-09-14T18:29:34.050629] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:29:34.056278] [INFO ] [REMOTE ] HSY: Full fetch complete (55149 records). [2025-09-14T18:29:34.056476] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-09-14T18:29:34.161558] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-09-14T18:29:34.458148] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-09-14T18:29:34.458387] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-09-14T18:29:34.459421] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-09-14T18:29:34.459516] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-09-14T18:29:34.461165] [DEBUG] [LOCAL ] HSY: Trimmed 55149 records to 38032 (keeping 150 days of data) [2025-09-14T18:29:34.597041] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-14T18:29:34.780105] [DEBUG] [LOCAL ] HSY: Primary data saved (38032 records). [2025-09-14T18:29:34.780324] [INFO ] [MAIN ] HSY: Full history saved. [2025-09-14T18:29:34.780487] [INFO ] [MAIN ] Update Progress: 1061/2370 symbols completed. HSY took 45.3s. Estimated remaining: 2h 18m 39s. Rate: 9.4 symbols/min [2025-09-14T18:29:34.950927] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:29:34.961040] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-09-14T18:29:34.969436] [DEBUG] [LOCAL ] HUBB: Loaded 15477 existing records from primary storage. [2025-09-14T18:29:34.969683] [INFO ] [MAIN ] HUBB: Loaded 15477 existing records. [2025-09-14T18:29:35.151855] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:29:35.152113] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-09-14T18:29:35.152183] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-09-14T18:29:35.152863] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-09-14T18:29:35.152931] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-09-14T18:29:35.507843] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:29:35.531522] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-14T18:29:35.758840] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-09-14T18:29:36.558831] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-14T18:29:36.858859] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-14T18:29:36.860862] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-14T18:29:37.244702] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T18:29:37.358820] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-09-14T18:29:38.158825] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-09-14T18:29:38.958828] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-14T18:29:39.156839] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T18:29:39.171030] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.21 seconds). [2025-09-14T18:29:39.171794] [INFO ] [REMOTE ] HTFC: Full fetch complete (624 records). [2025-09-14T18:29:39.171880] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-09-14T18:29:39.350881] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 139 unique days, need 150 days [2025-09-14T18:29:39.351133] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:29:39.351188] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:29:39.351235] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-14T18:29:39.351307] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-14T18:29:39.351355] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-14T18:29:39.351494] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-09-14T18:29:39.351589] [INFO ] [MAIN ] Update Progress: 1062/2370 symbols completed. HTFC took 24.4s. Estimated remaining: 2h 18m 31s. Rate: 9.4 symbols/min [2025-09-14T18:29:39.519998] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:29:39.539872] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T18:29:39.562026] [DEBUG] [LOCAL ] HUBS: Loaded 18114 existing records from primary storage. [2025-09-14T18:29:39.562208] [INFO ] [MAIN ] HUBS: Loaded 18114 existing records. [2025-09-14T18:29:39.736074] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:29:39.736339] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-09-14T18:29:39.736398] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-09-14T18:29:39.736959] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-09-14T18:29:39.737023] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-09-14T18:29:39.765580] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-09-14T18:29:40.103816] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:29:40.558867] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-09-14T18:29:41.358822] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-09-14T18:29:41.451838] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T18:29:42.158851] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-09-14T18:29:42.215866] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T18:29:42.958876] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-09-14T18:29:43.007144] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-14T18:29:43.503916] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T18:29:43.758882] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-09-14T18:29:44.095777] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T18:29:44.558844] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-09-14T18:29:45.266151] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T18:29:45.358863] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-09-14T18:29:46.098088] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T18:29:46.158856] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-09-14T18:29:46.958856] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-09-14T18:29:47.106423] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T18:29:47.583298] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T18:29:47.758871] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-09-14T18:29:48.558944] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-09-14T18:29:48.715566] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-14T18:29:49.350915] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-14T18:29:49.358804] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-09-14T18:29:49.818100] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T18:29:50.158832] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-09-14T18:29:50.905936] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-14T18:29:50.910502] [INFO ] [REMOTE ] HTGC: Full fetch complete (51713 records). [2025-09-14T18:29:50.910619] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-09-14T18:29:50.968298] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-09-14T18:29:51.311459] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-09-14T18:29:51.311602] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-09-14T18:29:51.312514] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-09-14T18:29:51.312578] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-09-14T18:29:51.314055] [DEBUG] [LOCAL ] HTGC: Trimmed 51713 records to 35510 (keeping 150 days of data) [2025-09-14T18:29:51.564918] [DEBUG] [LOCAL ] HTGC: Primary data saved (35510 records). [2025-09-14T18:29:51.565130] [INFO ] [MAIN ] HTGC: Full history saved. [2025-09-14T18:29:51.565298] [INFO ] [MAIN ] Update Progress: 1063/2370 symbols completed. HTGC took 25.8s. Estimated remaining: 2h 18m 32s. Rate: 9.4 symbols/min [2025-09-14T18:29:51.739730] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:29:51.760681] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-09-14T18:29:51.763609] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-14T18:29:51.787857] [DEBUG] [LOCAL ] HUM: Loaded 21830 existing records from primary storage. [2025-09-14T18:29:51.788034] [INFO ] [MAIN ] HUM: Loaded 21830 existing records. [2025-09-14T18:29:51.965685] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:29:51.965979] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-09-14T18:29:51.966154] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-09-14T18:29:51.966837] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-09-14T18:29:51.966908] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-09-14T18:29:52.084699] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T18:29:52.351666] [INFO ] [REMOTE ] HUM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:29:52.558901] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-09-14T18:29:53.300903] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T18:29:53.358831] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-09-14T18:29:54.158882] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-09-14T18:29:54.431056] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-14T18:29:54.807078] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-14T18:29:54.958852] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-09-14T18:29:55.362895] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T18:29:55.648632] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:29:55.652623] [INFO ] [REMOTE ] HUBB: Full fetch complete (41370 records). [2025-09-14T18:29:55.652815] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-09-14T18:29:55.764076] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-09-14T18:29:56.048783] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-09-14T18:29:56.048902] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-09-14T18:29:56.049775] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-09-14T18:29:56.049835] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-09-14T18:29:56.051030] [DEBUG] [LOCAL ] HUBB: Trimmed 41370 records to 27177 (keeping 150 days of data) [2025-09-14T18:29:56.228350] [DEBUG] [LOCAL ] HUBB: Primary data saved (27177 records). [2025-09-14T18:29:56.228516] [INFO ] [MAIN ] HUBB: Full history saved. [2025-09-14T18:29:56.228629] [INFO ] [MAIN ] Update Progress: 1064/2370 symbols completed. HUBB took 21.4s. Estimated remaining: 2h 18m 23s. Rate: 9.4 symbols/min [2025-09-14T18:29:56.403996] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:29:56.431205] [DEBUG] [LOCAL ] HUN: Loaded 23890 existing records from primary storage. [2025-09-14T18:29:56.431426] [INFO ] [MAIN ] HUN: Loaded 23890 existing records. [2025-09-14T18:29:56.563985] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-09-14T18:29:56.621370] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:29:56.621721] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-09-14T18:29:56.621789] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-09-14T18:29:56.622495] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-09-14T18:29:56.622562] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-09-14T18:29:56.976250] [INFO ] [REMOTE ] HUN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:29:57.356241] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-14T18:29:57.364826] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-09-14T18:29:57.919575] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-14T18:29:58.158876] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-09-14T18:29:58.958925] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-09-14T18:29:59.153264] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T18:29:59.758878] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-09-14T18:30:00.200420] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-14T18:30:00.273689] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-14T18:30:00.558939] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-09-14T18:30:00.960082] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-14T18:30:00.964706] [INFO ] [REMOTE ] HUBS: Full fetch complete (43294 records). [2025-09-14T18:30:00.964848] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-09-14T18:30:01.367298] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-09-14T18:30:01.384473] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-09-14T18:30:01.384587] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-09-14T18:30:01.385755] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-09-14T18:30:01.385921] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-09-14T18:30:01.387723] [DEBUG] [LOCAL ] HUBS: Trimmed 43294 records to 29603 (keeping 150 days of data) [2025-09-14T18:30:01.691040] [DEBUG] [LOCAL ] HUBS: Primary data saved (29603 records). [2025-09-14T18:30:01.691312] [INFO ] [MAIN ] HUBS: Full history saved. [2025-09-14T18:30:01.691573] [INFO ] [MAIN ] Update Progress: 1065/2370 symbols completed. HUBS took 22.3s. Estimated remaining: 2h 18m 16s. Rate: 9.4 symbols/min [2025-09-14T18:30:01.933722] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:30:01.968031] [DEBUG] [LOCAL ] HUYA: Loaded 20272 existing records from primary storage. [2025-09-14T18:30:01.968283] [INFO ] [MAIN ] HUYA: Loaded 20272 existing records. [2025-09-14T18:30:02.167632] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-09-14T18:30:02.220006] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:30:02.220349] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-09-14T18:30:02.220421] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-09-14T18:30:02.221134] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-09-14T18:30:02.221225] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-09-14T18:30:02.611461] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:30:02.660900] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-14T18:30:02.958949] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-09-14T18:30:03.758961] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-09-14T18:30:05.174368] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (3.01 seconds). [2025-09-14T18:30:05.179448] [INFO ] [REMOTE ] HTH: Full fetch complete (36623 records). [2025-09-14T18:30:05.179581] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-09-14T18:30:05.553608] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-09-14T18:30:05.553765] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-09-14T18:30:05.554449] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-09-14T18:30:05.554509] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-09-14T18:30:05.555341] [DEBUG] [LOCAL ] HTH: Trimmed 36623 records to 25401 (keeping 150 days of data) [2025-09-14T18:30:05.718136] [DEBUG] [LOCAL ] HTH: Primary data saved (25401 records). [2025-09-14T18:30:05.718313] [INFO ] [MAIN ] HTH: Full history saved. [2025-09-14T18:30:05.718446] [INFO ] [MAIN ] Update Progress: 1066/2370 symbols completed. HTH took 35.1s. Estimated remaining: 2h 18m 6s. Rate: 9.4 symbols/min [2025-09-14T18:30:05.887067] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:30:05.894538] [DEBUG] [LOCAL ] HVT: Loaded 6026 existing records from primary storage. [2025-09-14T18:30:05.894692] [INFO ] [MAIN ] HVT: Loaded 6026 existing records. [2025-09-14T18:30:06.075457] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:30:06.076198] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-09-14T18:30:06.076369] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-09-14T18:30:06.076777] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-09-14T18:30:06.076848] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-09-14T18:30:06.514630] [INFO ] [REMOTE ] HVT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:30:06.515886] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-09-14T18:30:06.522955] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (5.16 seconds). [2025-09-14T18:30:06.535935] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-09-14T18:30:06.584068] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (3.63 seconds). [2025-09-14T18:30:06.597594] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-09-14T18:30:06.665585] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (2.91 seconds). [2025-09-14T18:30:06.958908] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-09-14T18:30:07.439794] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-14T18:30:07.758949] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-09-14T18:30:08.436023] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T18:30:08.510263] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-14T18:30:08.558800] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-09-14T18:30:08.574927] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T18:30:08.940155] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-14T18:30:09.358823] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-09-14T18:30:10.158822] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-09-14T18:30:10.518969] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-14T18:30:10.542867] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-14T18:30:10.958848] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-09-14T18:30:11.758838] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-09-14T18:30:11.848875] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T18:30:12.183135] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-14T18:30:12.558843] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-09-14T18:30:13.358870] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-09-14T18:30:13.650395] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-14T18:30:14.158861] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-09-14T18:30:14.509435] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-14T18:30:14.539501] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-14T18:30:14.958860] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-09-14T18:30:15.758840] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-09-14T18:30:16.558844] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-09-14T18:30:16.907067] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T18:30:17.103402] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-09-14T18:30:17.176305] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-14T18:30:17.283335] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T18:30:17.288755] [INFO ] [REMOTE ] HUM: Full fetch complete (53326 records). [2025-09-14T18:30:17.288914] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-09-14T18:30:17.363892] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-09-14T18:30:17.675363] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-09-14T18:30:17.675532] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-09-14T18:30:17.676732] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-09-14T18:30:17.676805] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-09-14T18:30:17.678629] [DEBUG] [LOCAL ] HUM: Trimmed 53326 records to 36925 (keeping 150 days of data) [2025-09-14T18:30:17.924937] [DEBUG] [LOCAL ] HUM: Primary data saved (36925 records). [2025-09-14T18:30:17.925123] [INFO ] [MAIN ] HUM: Full history saved. [2025-09-14T18:30:17.925250] [INFO ] [MAIN ] Update Progress: 1067/2370 symbols completed. HUM took 26.4s. Estimated remaining: 2h 18m 7s. Rate: 9.4 symbols/min [2025-09-14T18:30:18.094848] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:30:18.125832] [DEBUG] [LOCAL ] HWM: Loaded 23667 existing records from primary storage. [2025-09-14T18:30:18.126050] [INFO ] [MAIN ] HWM: Loaded 23667 existing records. [2025-09-14T18:30:18.163988] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-09-14T18:30:18.318658] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:30:18.319015] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-09-14T18:30:18.319095] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-09-14T18:30:18.319950] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-09-14T18:30:18.320029] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-09-14T18:30:18.686878] [INFO ] [REMOTE ] HWM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:30:18.958855] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-09-14T18:30:19.269077] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-14T18:30:19.758877] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-09-14T18:30:19.857445] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T18:30:19.877244] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-14T18:30:20.558879] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-09-14T18:30:21.225191] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-14T18:30:21.231861] [INFO ] [REMOTE ] HUN: Full fetch complete (57822 records). [2025-09-14T18:30:21.231990] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-09-14T18:30:21.363975] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-09-14T18:30:21.649471] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-09-14T18:30:21.649620] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-09-14T18:30:21.650574] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-09-14T18:30:21.650696] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-09-14T18:30:21.652163] [DEBUG] [LOCAL ] HUN: Trimmed 57822 records to 40015 (keeping 150 days of data) [2025-09-14T18:30:21.927767] [DEBUG] [LOCAL ] HUN: Primary data saved (40015 records). [2025-09-14T18:30:21.927933] [INFO ] [MAIN ] HUN: Full history saved. [2025-09-14T18:30:21.928045] [INFO ] [MAIN ] Update Progress: 1068/2370 symbols completed. HUN took 25.7s. Estimated remaining: 2h 17m 58s. Rate: 9.4 symbols/min [2025-09-14T18:30:22.097886] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:30:22.119681] [DEBUG] [LOCAL ] HXL: Loaded 20269 existing records from primary storage. [2025-09-14T18:30:22.119880] [INFO ] [MAIN ] HXL: Loaded 20269 existing records. [2025-09-14T18:30:22.164323] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-09-14T18:30:22.300863] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:30:22.301130] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-09-14T18:30:22.301194] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-09-14T18:30:22.301891] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-09-14T18:30:22.301958] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-09-14T18:30:22.656745] [INFO ] [REMOTE ] HXL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:30:22.688097] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-14T18:30:22.707954] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T18:30:22.709930] [INFO ] [REMOTE ] HVT: Full fetch complete (17993 records). [2025-09-14T18:30:22.710023] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-09-14T18:30:22.963945] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-09-14T18:30:23.074138] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-09-14T18:30:23.074268] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-09-14T18:30:23.074745] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-09-14T18:30:23.074802] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-09-14T18:30:23.075493] [DEBUG] [LOCAL ] HVT: Trimmed 17993 records to 11292 (keeping 150 days of data) [2025-09-14T18:30:23.145973] [DEBUG] [LOCAL ] HVT: Primary data saved (11292 records). [2025-09-14T18:30:23.146138] [INFO ] [MAIN ] HVT: Full history saved. [2025-09-14T18:30:23.146241] [INFO ] [MAIN ] Update Progress: 1069/2370 symbols completed. HVT took 17.4s. Estimated remaining: 2h 17m 45s. Rate: 9.4 symbols/min [2025-09-14T18:30:23.324154] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:30:23.331060] [DEBUG] [LOCAL ] HY: Loaded 4391 existing records from primary storage. [2025-09-14T18:30:23.331198] [INFO ] [MAIN ] HY: Loaded 4391 existing records. [2025-09-14T18:30:23.511335] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:30:23.511749] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-09-14T18:30:23.511853] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-09-14T18:30:23.512276] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-09-14T18:30:23.512348] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-09-14T18:30:23.757726] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-14T18:30:23.768864] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-09-14T18:30:23.915607] [INFO ] [REMOTE ] HY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:30:24.309137] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-14T18:30:24.558853] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-09-14T18:30:25.358919] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-09-14T18:30:25.391500] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T18:30:25.563439] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T18:30:26.158860] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-09-14T18:30:26.958852] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-09-14T18:30:27.758800] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-09-14T18:30:27.861510] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-09-14T18:30:28.200271] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-14T18:30:28.558892] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-09-14T18:30:28.693114] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-09-14T18:30:29.035086] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-14T18:30:29.040114] [INFO ] [REMOTE ] HUYA: Full fetch complete (47990 records). [2025-09-14T18:30:29.040232] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-09-14T18:30:29.380332] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-09-14T18:30:29.430084] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-09-14T18:30:29.430940] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-14T18:30:29.431002] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-09-14T18:30:29.435261] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-09-14T18:30:29.435423] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-09-14T18:30:29.438193] [DEBUG] [LOCAL ] HUYA: Trimmed 47990 records to 32446 (keeping 150 days of data) [2025-09-14T18:30:29.636573] [DEBUG] [LOCAL ] HUYA: Primary data saved (32446 records). [2025-09-14T18:30:29.636778] [INFO ] [MAIN ] HUYA: Full history saved. [2025-09-14T18:30:29.636894] [INFO ] [MAIN ] Update Progress: 1070/2370 symbols completed. HUYA took 27.9s. Estimated remaining: 2h 17m 39s. Rate: 9.4 symbols/min [2025-09-14T18:30:29.810585] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:30:29.810867] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-09-14T18:30:29.810933] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-14T18:30:29.811054] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-14T18:30:29.811105] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-14T18:30:29.811156] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-14T18:30:29.811200] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-14T18:30:30.159325] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-09-14T18:30:30.162685] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:30:30.889413] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-14T18:30:30.958810] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-09-14T18:30:31.242692] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T18:30:31.758855] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-09-14T18:30:32.558821] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-14T18:30:32.606133] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-14T18:30:32.815183] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T18:30:33.054136] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-14T18:30:33.358833] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-14T18:30:33.724493] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-14T18:30:34.158834] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-09-14T18:30:34.958857] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-09-14T18:30:35.758850] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-09-14T18:30:35.792799] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-14T18:30:36.031894] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T18:30:36.558824] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-09-14T18:30:37.358843] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-09-14T18:30:37.516135] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-14T18:30:38.158880] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-09-14T18:30:38.300923] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-14T18:30:38.357464] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T18:30:38.958855] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-09-14T18:30:39.758816] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-14T18:30:39.788974] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-14T18:30:39.791042] [INFO ] [REMOTE ] HY: Full fetch complete (11415 records). [2025-09-14T18:30:39.791135] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-09-14T18:30:40.104634] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-14T18:30:40.118706] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-14T18:30:40.208426] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-09-14T18:30:40.208545] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-09-14T18:30:40.208907] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-09-14T18:30:40.208981] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-09-14T18:30:40.209531] [DEBUG] [LOCAL ] HY: Trimmed 11415 records to 7350 (keeping 150 days of data) [2025-09-14T18:30:40.256176] [DEBUG] [LOCAL ] HY: Primary data saved (7350 records). [2025-09-14T18:30:40.256368] [INFO ] [MAIN ] HY: Full history saved. [2025-09-14T18:30:40.256565] [INFO ] [MAIN ] Update Progress: 1071/2370 symbols completed. HY took 17.1s. Estimated remaining: 2h 17m 38s. Rate: 9.4 symbols/min [2025-09-14T18:30:40.425180] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:30:40.427257] [DEBUG] [LOCAL ] HYBX: Loaded 179 existing records from primary storage. [2025-09-14T18:30:40.427358] [INFO ] [MAIN ] HYBX: Loaded 179 existing records. [2025-09-14T18:30:40.566975] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-14T18:30:40.607606] [WARN ] [MAIN ] HYBX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:30:40.607886] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-09-14T18:30:40.607959] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-14T18:30:40.608147] [DEBUG] [LOCAL ] HYBX: Deleted primary data file. [2025-09-14T18:30:40.608213] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-09-14T18:30:40.960499] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:30:40.968043] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-14T18:30:41.358837] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-09-14T18:30:41.744020] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-14T18:30:42.158871] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-09-14T18:30:42.958890] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-14T18:30:43.273276] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-14T18:30:43.758918] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-09-14T18:30:44.108299] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-14T18:30:44.153771] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-14T18:30:44.558867] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-09-14T18:30:45.358857] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-14T18:30:45.800297] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-14T18:30:46.158882] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-09-14T18:30:46.616421] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-14T18:30:46.620943] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-14T18:30:46.958853] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-09-14T18:30:47.356923] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-14T18:30:47.758864] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-09-14T18:30:48.442984] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:30:48.448585] [INFO ] [REMOTE ] HWM: Full fetch complete (57677 records). [2025-09-14T18:30:48.448777] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-09-14T18:30:48.564134] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-09-14T18:30:48.843156] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-09-14T18:30:48.843281] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-09-14T18:30:48.844139] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-09-14T18:30:48.844204] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-09-14T18:30:48.845670] [DEBUG] [LOCAL ] HWM: Trimmed 57677 records to 39910 (keeping 150 days of data) [2025-09-14T18:30:49.134622] [DEBUG] [LOCAL ] HWM: Primary data saved (39910 records). [2025-09-14T18:30:49.134903] [INFO ] [MAIN ] HWM: Full history saved. [2025-09-14T18:30:49.135041] [INFO ] [MAIN ] Update Progress: 1072/2370 symbols completed. HWM took 31.2s. Estimated remaining: 2h 17m 35s. Rate: 9.4 symbols/min [2025-09-14T18:30:49.320938] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:30:49.328675] [DEBUG] [LOCAL ] HYI: Loaded 3888 existing records from primary storage. [2025-09-14T18:30:49.328910] [INFO ] [MAIN ] HYI: Loaded 3888 existing records. [2025-09-14T18:30:49.364020] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-14T18:30:49.533971] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:30:49.534335] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-09-14T18:30:49.534402] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-09-14T18:30:49.534965] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-09-14T18:30:49.535114] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-09-14T18:30:49.707813] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-14T18:30:49.945847] [INFO ] [REMOTE ] HYI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:30:50.158889] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-14T18:30:50.353726] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T18:30:50.372867] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.21 seconds). [2025-09-14T18:30:50.373500] [INFO ] [REMOTE ] HYAC: Full fetch complete (664 records). [2025-09-14T18:30:50.373592] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-09-14T18:30:50.374039] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-09-11) is before last completed trading day (2025-09-12). Symbol may be delisted or halted. [2025-09-14T18:30:50.374113] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:30:50.374167] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:30:50.374222] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-14T18:30:50.374304] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-14T18:30:50.374353] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-14T18:30:50.374436] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-09-14T18:30:50.374518] [INFO ] [MAIN ] Update Progress: 1073/2370 symbols completed. HYAC took 20.7s. Estimated remaining: 2h 17m 22s. Rate: 9.4 symbols/min [2025-09-14T18:30:50.542899] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:30:50.558817] [DEBUG] [LOCAL ] HYT: Loaded 14904 existing records from primary storage. [2025-09-14T18:30:50.558969] [INFO ] [MAIN ] HYT: Loaded 14904 existing records. [2025-09-14T18:30:50.734866] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:30:50.735108] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-09-14T18:30:50.735166] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-09-14T18:30:50.735768] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-09-14T18:30:50.735832] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-09-14T18:30:50.964047] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-09-14T18:30:51.090118] [INFO ] [REMOTE ] HYT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:30:51.758905] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-09-14T18:30:51.891308] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-14T18:30:52.558854] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-09-14T18:30:53.330612] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T18:30:53.358785] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-09-14T18:30:53.939103] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-14T18:30:54.065249] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T18:30:54.071991] [INFO ] [REMOTE ] HXL: Full fetch complete (50125 records). [2025-09-14T18:30:54.072187] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-09-14T18:30:54.163992] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-09-14T18:30:54.475482] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-09-14T18:30:54.475679] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-09-14T18:30:54.476608] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-09-14T18:30:54.476706] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-09-14T18:30:54.478074] [DEBUG] [LOCAL ] HXL: Trimmed 50125 records to 34690 (keeping 150 days of data) [2025-09-14T18:30:54.602004] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-14T18:30:54.713583] [DEBUG] [LOCAL ] HXL: Primary data saved (34690 records). [2025-09-14T18:30:54.713829] [INFO ] [MAIN ] HXL: Full history saved. [2025-09-14T18:30:54.713957] [INFO ] [MAIN ] Update Progress: 1074/2370 symbols completed. HXL took 32.8s. Estimated remaining: 2h 17m 13s. Rate: 9.4 symbols/min [2025-09-14T18:30:54.889041] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:30:54.892149] [DEBUG] [LOCAL ] HYTR: Loaded 1200 existing records from primary storage. [2025-09-14T18:30:54.892260] [INFO ] [MAIN ] HYTR: Loaded 1200 existing records. [2025-09-14T18:30:54.964091] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-09-14T18:30:55.083347] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:30:55.083716] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-09-14T18:30:55.083787] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-09-14T18:30:55.084096] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-09-14T18:30:55.084159] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-09-14T18:30:55.515018] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-14T18:30:55.519298] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:30:55.758861] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-09-14T18:30:56.558895] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-09-14T18:30:56.580609] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T18:30:56.968453] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-14T18:30:57.358838] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-14T18:30:57.684145] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T18:30:57.684967] [INFO ] [REMOTE ] HYBX: Full fetch complete (488 records). [2025-09-14T18:30:57.685067] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-09-14T18:30:57.884679] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 134 unique days, need 150 days [2025-09-14T18:30:57.884898] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:30:57.884952] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:30:57.885000] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-14T18:30:57.885080] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-14T18:30:57.885129] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-09-14T18:30:57.885192] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-09-14T18:30:57.885269] [INFO ] [MAIN ] Update Progress: 1075/2370 symbols completed. HYBX took 17.6s. Estimated remaining: 2h 17m 3s. Rate: 9.4 symbols/min [2025-09-14T18:30:58.059477] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:30:58.072272] [DEBUG] [LOCAL ] HZO: Loaded 12182 existing records from primary storage. [2025-09-14T18:30:58.072412] [INFO ] [MAIN ] HZO: Loaded 12182 existing records. [2025-09-14T18:30:58.163915] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-09-14T18:30:58.260278] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:30:58.260612] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-09-14T18:30:58.260723] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-09-14T18:30:58.261228] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-09-14T18:30:58.261291] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-09-14T18:30:58.622734] [INFO ] [REMOTE ] HZO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:30:58.958821] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-09-14T18:30:59.099100] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-14T18:30:59.758848] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-09-14T18:31:00.479247] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T18:31:00.558883] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-09-14T18:31:00.808621] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T18:31:01.203373] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-14T18:31:01.358881] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-09-14T18:31:02.158847] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-09-14T18:31:02.393771] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T18:31:02.785470] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-14T18:31:02.958847] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-09-14T18:31:03.655338] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-14T18:31:03.758820] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-09-14T18:31:04.209002] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-14T18:31:04.558863] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-09-14T18:31:05.358843] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-09-14T18:31:06.035948] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-14T18:31:06.158876] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-09-14T18:31:06.221165] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T18:31:06.958860] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-09-14T18:31:07.707022] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-14T18:31:07.737904] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T18:31:07.758796] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-09-14T18:31:08.393989] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-14T18:31:08.558840] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-09-14T18:31:09.358832] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-09-14T18:31:09.388299] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-14T18:31:10.158835] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-09-14T18:31:10.777347] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-14T18:31:10.958854] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-09-14T18:31:11.122306] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-14T18:31:11.758832] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-09-14T18:31:12.261671] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-14T18:31:12.558821] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-09-14T18:31:12.630776] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-14T18:31:13.028537] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T18:31:13.029439] [INFO ] [REMOTE ] HYTR: Full fetch complete (3467 records). [2025-09-14T18:31:13.029524] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-09-14T18:31:13.364037] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-09-14T18:31:13.388594] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-09-14T18:31:13.388699] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-09-14T18:31:13.388841] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-09-14T18:31:13.388918] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-09-14T18:31:13.389309] [DEBUG] [LOCAL ] HYTR: Trimmed 3467 records to 2256 (keeping 150 days of data) [2025-09-14T18:31:13.404237] [DEBUG] [LOCAL ] HYTR: Primary data saved (2256 records). [2025-09-14T18:31:13.404338] [INFO ] [MAIN ] HYTR: Full history saved. [2025-09-14T18:31:13.404428] [INFO ] [MAIN ] Update Progress: 1076/2370 symbols completed. HYTR took 18.7s. Estimated remaining: 2h 17m 8s. Rate: 9.4 symbols/min [2025-09-14T18:31:13.579934] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:31:13.584767] [DEBUG] [LOCAL ] IAE: Loaded 2522 existing records from primary storage. [2025-09-14T18:31:13.584878] [INFO ] [MAIN ] IAE: Loaded 2522 existing records. [2025-09-14T18:31:13.760398] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:31:13.760691] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-09-14T18:31:13.760754] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-09-14T18:31:13.761051] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-09-14T18:31:13.761126] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-09-14T18:31:14.110634] [INFO ] [REMOTE ] IAE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:31:14.158824] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-09-14T18:31:14.768847] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-14T18:31:14.904198] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-14T18:31:14.958845] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-09-14T18:31:15.593976] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T18:31:15.595341] [INFO ] [REMOTE ] HYI: Full fetch complete (9778 records). [2025-09-14T18:31:15.595426] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-09-14T18:31:15.762501] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-09-14T18:31:15.959600] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-09-14T18:31:15.959734] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-09-14T18:31:15.960000] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-09-14T18:31:15.960052] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-09-14T18:31:15.960609] [DEBUG] [LOCAL ] HYI: Trimmed 9778 records to 6514 (keeping 150 days of data) [2025-09-14T18:31:16.008078] [DEBUG] [LOCAL ] HYI: Primary data saved (6514 records). [2025-09-14T18:31:16.008519] [INFO ] [MAIN ] HYI: Full history saved. [2025-09-14T18:31:16.008634] [INFO ] [MAIN ] Update Progress: 1077/2370 symbols completed. HYI took 26.9s. Estimated remaining: 2h 16m 57s. Rate: 9.4 symbols/min [2025-09-14T18:31:16.558938] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-09-14T18:31:17.086174] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-14T18:31:17.358864] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-09-14T18:31:17.383914] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T18:31:18.158829] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-09-14T18:31:18.766495] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T18:31:18.958837] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-09-14T18:31:19.178493] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-14T18:31:19.599929] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-14T18:31:19.758841] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-09-14T18:31:20.558845] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-09-14T18:31:21.287510] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-14T18:31:21.312730] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T18:31:21.358821] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-09-14T18:31:21.867324] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-14T18:31:22.158832] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-09-14T18:31:22.958881] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-09-14T18:31:23.714600] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-14T18:31:23.758792] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-09-14T18:31:24.331102] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T18:31:24.558834] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-09-14T18:31:25.121909] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T18:31:25.125567] [INFO ] [REMOTE ] HYT: Full fetch complete (36040 records). [2025-09-14T18:31:25.125710] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-09-14T18:31:25.359111] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-09-14T18:31:25.435663] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-14T18:31:25.525025] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-09-14T18:31:25.525142] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-09-14T18:31:25.525988] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-09-14T18:31:25.526071] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-09-14T18:31:25.527241] [DEBUG] [LOCAL ] HYT: Trimmed 36040 records to 24744 (keeping 150 days of data) [2025-09-14T18:31:25.677015] [DEBUG] [LOCAL ] HYT: Primary data saved (24744 records). [2025-09-14T18:31:25.677215] [INFO ] [MAIN ] HYT: Full history saved. [2025-09-14T18:31:25.677353] [INFO ] [MAIN ] Update Progress: 1078/2370 symbols completed. HYT took 35.3s. Estimated remaining: 2h 16m 55s. Rate: 9.4 symbols/min [2025-09-14T18:31:26.012267] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:31:26.016187] [INFO ] [REMOTE ] HZO: Full fetch complete (31482 records). [2025-09-14T18:31:26.016732] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-09-14T18:31:26.173754] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-09-14T18:31:26.413170] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-09-14T18:31:26.413286] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-09-14T18:31:26.413958] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-09-14T18:31:26.414017] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-09-14T18:31:26.414845] [DEBUG] [LOCAL ] HZO: Trimmed 31482 records to 21209 (keeping 150 days of data) [2025-09-14T18:31:26.552655] [DEBUG] [LOCAL ] HZO: Primary data saved (21209 records). [2025-09-14T18:31:26.552822] [INFO ] [MAIN ] HZO: Full history saved. [2025-09-14T18:31:26.552973] [INFO ] [MAIN ] Update Progress: 1079/2370 symbols completed. HZO took 28.7s. Estimated remaining: 2h 16m 42s. Rate: 9.4 symbols/min [2025-09-14T18:31:27.002593] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-14T18:31:27.004526] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-09-14T18:31:27.585565] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T18:31:27.586764] [INFO ] [REMOTE ] IAE: Full fetch complete (6290 records). [2025-09-14T18:31:27.586848] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-09-14T18:31:27.937821] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-09-14T18:31:27.937943] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-09-14T18:31:27.938134] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-09-14T18:31:27.938187] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-09-14T18:31:27.938610] [DEBUG] [LOCAL ] IAE: Trimmed 6290 records to 4197 (keeping 150 days of data) [2025-09-14T18:31:27.963243] [DEBUG] [LOCAL ] IAE: Primary data saved (4197 records). [2025-09-14T18:31:27.963350] [INFO ] [MAIN ] IAE: Full history saved. [2025-09-14T18:31:27.963445] [INFO ] [MAIN ] Update Progress: 1080/2370 symbols completed. IAE took 14.6s. Estimated remaining: 2h 16m 29s. Rate: 9.5 symbols/min [2025-09-14T18:31:28.574112] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:31:28.663054] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:31:28.664160] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:31:28.661713] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:31:28.700328] [DEBUG] [LOCAL ] IBP: Loaded 13686 existing records from primary storage. [2025-09-14T18:31:28.700673] [INFO ] [MAIN ] IBP: Loaded 13686 existing records. [2025-09-14T18:31:28.807302] [DEBUG] [LOCAL ] IBM: Loaded 24106 existing records from primary storage. [2025-09-14T18:31:28.812512] [DEBUG] [LOCAL ] IBN: Loaded 23597 existing records from primary storage. [2025-09-14T18:31:28.826556] [INFO ] [MAIN ] IBM: Loaded 24106 existing records. [2025-09-14T18:31:28.827086] [DEBUG] [LOCAL ] IAG: Loaded 23936 existing records from primary storage. [2025-09-14T18:31:28.859006] [INFO ] [MAIN ] IBN: Loaded 23597 existing records. [2025-09-14T18:31:28.897140] [INFO ] [MAIN ] IAG: Loaded 23936 existing records. [2025-09-14T18:31:29.051451] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:31:29.188232] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-09-14T18:31:29.253020] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-09-14T18:31:29.311138] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:31:29.358463] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-09-14T18:31:29.369133] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-09-14T18:31:29.391270] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-09-14T18:31:29.391469] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:31:29.401889] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-09-14T18:31:29.412583] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-09-14T18:31:29.417780] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-09-14T18:31:29.417948] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-09-14T18:31:29.443682] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-09-14T18:31:29.545002] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-09-14T18:31:29.587067] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-09-14T18:31:29.571532] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:31:29.663630] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-09-14T18:31:29.749555] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-09-14T18:31:29.791257] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-09-14T18:31:29.910095] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-09-14T18:31:30.668444] [INFO ] [REMOTE ] IBM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:31:30.734270] [INFO ] [REMOTE ] IBP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:31:30.774031] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-09-14T18:31:30.802315] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-09-14T18:31:31.075913] [INFO ] [REMOTE ] IBN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:31:31.086214] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-09-14T18:31:31.216183] [INFO ] [REMOTE ] IAG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:31:31.216892] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-09-14T18:31:31.914987] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T18:31:31.925621] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-09-14T18:31:32.084191] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-14T18:31:32.094844] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-09-14T18:31:32.367790] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T18:31:32.558793] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-09-14T18:31:32.613971] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-14T18:31:32.659034] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-14T18:31:32.718121] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-14T18:31:33.358837] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-09-14T18:31:33.722313] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T18:31:34.158822] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-09-14T18:31:34.298504] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-14T18:31:34.958824] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-09-14T18:31:35.758834] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-09-14T18:31:36.041812] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-14T18:31:36.370982] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-14T18:31:36.558819] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-09-14T18:31:36.682816] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-14T18:31:37.358820] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-09-14T18:31:37.868963] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-14T18:31:38.158886] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-09-14T18:31:38.958826] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-09-14T18:31:39.165074] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-14T18:31:39.257519] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-14T18:31:39.473366] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-14T18:31:39.758828] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-09-14T18:31:40.558876] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-09-14T18:31:40.682832] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-14T18:31:41.358865] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-09-14T18:31:41.772148] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-14T18:31:42.158936] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-09-14T18:31:42.958944] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-09-14T18:31:43.081216] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-14T18:31:43.667711] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-14T18:31:43.758804] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-09-14T18:31:43.910918] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-14T18:31:44.558838] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-09-14T18:31:45.358834] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-09-14T18:31:45.543997] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T18:31:45.585257] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-14T18:31:46.158881] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-09-14T18:31:46.440864] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-14T18:31:46.958830] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-09-14T18:31:47.529203] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T18:31:47.532512] [INFO ] [REMOTE ] IBP: Full fetch complete (32195 records). [2025-09-14T18:31:47.532610] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-09-14T18:31:47.764005] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-09-14T18:31:47.921997] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-09-14T18:31:47.922124] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-09-14T18:31:47.922929] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-09-14T18:31:47.923162] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-09-14T18:31:47.924485] [DEBUG] [LOCAL ] IBP: Trimmed 32195 records to 21904 (keeping 150 days of data) [2025-09-14T18:31:48.056031] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-14T18:31:48.119424] [DEBUG] [LOCAL ] IBP: Primary data saved (21904 records). [2025-09-14T18:31:48.119594] [INFO ] [MAIN ] IBP: Full history saved. [2025-09-14T18:31:48.119793] [INFO ] [MAIN ] Update Progress: 1081/2370 symbols completed. IBP took 20.2s. Estimated remaining: 2h 16m 40s. Rate: 9.4 symbols/min [2025-09-14T18:31:48.289378] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:31:48.305102] [DEBUG] [LOCAL ] IBTA: Loaded 15677 existing records from primary storage. [2025-09-14T18:31:48.305244] [INFO ] [MAIN ] IBTA: Loaded 15677 existing records. [2025-09-14T18:31:48.484084] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:31:48.484396] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-09-14T18:31:48.484464] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-09-14T18:31:48.484908] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-09-14T18:31:48.484969] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-09-14T18:31:48.563979] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-09-14T18:31:48.838207] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:31:48.869814] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T18:31:49.358827] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-09-14T18:31:50.003792] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T18:31:50.009572] [INFO ] [REMOTE ] IBN: Full fetch complete (57546 records). [2025-09-14T18:31:50.009754] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-09-14T18:31:50.165054] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-09-14T18:31:50.415956] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-09-14T18:31:50.416080] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-09-14T18:31:50.416929] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-09-14T18:31:50.416988] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-09-14T18:31:50.418243] [DEBUG] [LOCAL ] IBN: Trimmed 57546 records to 39792 (keeping 150 days of data) [2025-09-14T18:31:50.676755] [DEBUG] [LOCAL ] IBN: Primary data saved (39792 records). [2025-09-14T18:31:50.677001] [INFO ] [MAIN ] IBN: Full history saved. [2025-09-14T18:31:50.677272] [INFO ] [MAIN ] Update Progress: 1082/2370 symbols completed. IBN took 22.7s. Estimated remaining: 2h 16m 29s. Rate: 9.4 symbols/min [2025-09-14T18:31:50.912311] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-14T18:31:50.915461] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:31:50.960608] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-09-14T18:31:50.971886] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-14T18:31:50.993569] [DEBUG] [LOCAL ] ICE: Loaded 23621 existing records from primary storage. [2025-09-14T18:31:50.993766] [INFO ] [MAIN ] ICE: Loaded 23621 existing records. [2025-09-14T18:31:51.197182] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:31:51.197478] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-09-14T18:31:51.197541] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-09-14T18:31:51.198217] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-09-14T18:31:51.198288] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-09-14T18:31:51.642601] [INFO ] [REMOTE ] ICE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:31:51.758855] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-09-14T18:31:52.222557] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-14T18:31:52.558835] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-09-14T18:31:52.672029] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T18:31:53.358845] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-09-14T18:31:54.158885] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-09-14T18:31:54.465047] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T18:31:54.958953] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-09-14T18:31:55.056453] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-14T18:31:55.062349] [INFO ] [REMOTE ] IAG: Full fetch complete (58098 records). [2025-09-14T18:31:55.062511] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-09-14T18:31:55.490672] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T18:31:55.505557] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-09-14T18:31:55.506659] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-09-14T18:31:55.507962] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-09-14T18:31:55.508044] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-09-14T18:31:55.510405] [DEBUG] [LOCAL ] IAG: Trimmed 58098 records to 40237 (keeping 150 days of data) [2025-09-14T18:31:55.758971] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-09-14T18:31:55.772164] [DEBUG] [LOCAL ] IAG: Primary data saved (40237 records). [2025-09-14T18:31:55.772266] [INFO ] [MAIN ] IAG: Full history saved. [2025-09-14T18:31:55.772386] [INFO ] [MAIN ] Update Progress: 1083/2370 symbols completed. IAG took 27.8s. Estimated remaining: 2h 16m 21s. Rate: 9.4 symbols/min [2025-09-14T18:31:55.944574] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:31:55.962199] [DEBUG] [LOCAL ] ICL: Loaded 16509 existing records from primary storage. [2025-09-14T18:31:55.962379] [INFO ] [MAIN ] ICL: Loaded 16509 existing records. [2025-09-14T18:31:56.138073] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:31:56.138389] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-09-14T18:31:56.138474] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-09-14T18:31:56.139082] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-09-14T18:31:56.139171] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-09-14T18:31:56.496043] [INFO ] [REMOTE ] ICL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:31:56.558776] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-09-14T18:31:56.729077] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T18:31:56.769256] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-14T18:31:57.358905] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-09-14T18:31:58.112215] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T18:31:58.158799] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-09-14T18:31:58.857728] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T18:31:58.958814] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-09-14T18:31:59.106669] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-14T18:31:59.758849] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-09-14T18:32:00.140899] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-14T18:32:00.558812] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-09-14T18:32:00.687254] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-14T18:32:01.358834] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-09-14T18:32:01.469702] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-14T18:32:01.476666] [INFO ] [REMOTE ] IBM: Full fetch complete (58282 records). [2025-09-14T18:32:01.476816] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-09-14T18:32:01.869476] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-09-14T18:32:01.869602] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-09-14T18:32:01.870579] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-09-14T18:32:01.870715] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-09-14T18:32:01.872580] [DEBUG] [LOCAL ] IBM: Trimmed 58282 records to 40393 (keeping 150 days of data) [2025-09-14T18:32:02.159002] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-09-14T18:32:02.180905] [DEBUG] [LOCAL ] IBM: Primary data saved (40393 records). [2025-09-14T18:32:02.181072] [INFO ] [MAIN ] IBM: Full history saved. [2025-09-14T18:32:02.181224] [INFO ] [MAIN ] Update Progress: 1084/2370 symbols completed. IBM took 34.2s. Estimated remaining: 2h 16m 15s. Rate: 9.4 symbols/min [2025-09-14T18:32:02.361498] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:32:02.378240] [DEBUG] [LOCAL ] IDA: Loaded 14416 existing records from primary storage. [2025-09-14T18:32:02.378388] [INFO ] [MAIN ] IDA: Loaded 14416 existing records. [2025-09-14T18:32:02.554300] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:32:02.554582] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-09-14T18:32:02.554666] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-09-14T18:32:02.555218] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-09-14T18:32:02.555292] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-09-14T18:32:02.915118] [INFO ] [REMOTE ] IDA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:32:02.935893] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T18:32:02.958814] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-09-14T18:32:03.763996] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-09-14T18:32:03.784008] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T18:32:04.558823] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-09-14T18:32:04.599746] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T18:32:04.637619] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T18:32:05.358881] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-09-14T18:32:05.684058] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-14T18:32:06.158887] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-09-14T18:32:06.299370] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-14T18:32:06.958837] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-09-14T18:32:07.758812] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-09-14T18:32:07.881537] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T18:32:08.140524] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-14T18:32:08.558827] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-09-14T18:32:09.169486] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-14T18:32:09.174531] [INFO ] [REMOTE ] IBTA: Full fetch complete (40299 records). [2025-09-14T18:32:09.174667] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-09-14T18:32:09.375439] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-09-14T18:32:09.579263] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-09-14T18:32:09.579385] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-09-14T18:32:09.580515] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-09-14T18:32:09.580580] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-09-14T18:32:09.582694] [DEBUG] [LOCAL ] IBTA: Trimmed 40299 records to 26676 (keeping 150 days of data) [2025-09-14T18:32:09.750803] [DEBUG] [LOCAL ] IBTA: Primary data saved (26676 records). [2025-09-14T18:32:09.750996] [INFO ] [MAIN ] IBTA: Full history saved. [2025-09-14T18:32:09.751156] [INFO ] [MAIN ] Update Progress: 1085/2370 symbols completed. IBTA took 21.6s. Estimated remaining: 2h 16m 10s. Rate: 9.4 symbols/min [2025-09-14T18:32:09.931070] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:32:09.937830] [DEBUG] [LOCAL ] IDE: Loaded 4198 existing records from primary storage. [2025-09-14T18:32:09.937966] [INFO ] [MAIN ] IDE: Loaded 4198 existing records. [2025-09-14T18:32:10.116359] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:32:10.116887] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-09-14T18:32:10.116975] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-09-14T18:32:10.117236] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-09-14T18:32:10.117408] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-09-14T18:32:10.162286] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-09-14T18:32:10.389577] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-14T18:32:10.538575] [INFO ] [REMOTE ] IDE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:32:10.572967] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-14T18:32:10.958921] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-09-14T18:32:11.746709] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-14T18:32:11.764463] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-09-14T18:32:11.773544] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-14T18:32:12.535324] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T18:32:12.542003] [INFO ] [REMOTE ] ICE: Full fetch complete (57648 records). [2025-09-14T18:32:12.542216] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-09-14T18:32:12.564675] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-09-14T18:32:12.944205] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-09-14T18:32:12.944331] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-09-14T18:32:12.945297] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-09-14T18:32:12.945391] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-09-14T18:32:12.946824] [DEBUG] [LOCAL ] ICE: Trimmed 57648 records to 39805 (keeping 150 days of data) [2025-09-14T18:32:13.215981] [DEBUG] [LOCAL ] ICE: Primary data saved (39805 records). [2025-09-14T18:32:13.216187] [INFO ] [MAIN ] ICE: Full history saved. [2025-09-14T18:32:13.216308] [INFO ] [MAIN ] Update Progress: 1086/2370 symbols completed. ICE took 22.5s. Estimated remaining: 2h 15m 60s. Rate: 9.4 symbols/min [2025-09-14T18:32:13.363978] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-09-14T18:32:13.387236] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:32:13.397750] [DEBUG] [LOCAL ] IDT: Loaded 7768 existing records from primary storage. [2025-09-14T18:32:13.397908] [INFO ] [MAIN ] IDT: Loaded 7768 existing records. [2025-09-14T18:32:13.573793] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:32:13.574023] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-09-14T18:32:13.574083] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-09-14T18:32:13.574494] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-09-14T18:32:13.574554] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-09-14T18:32:13.925111] [INFO ] [REMOTE ] IDT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:32:14.158806] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-09-14T18:32:14.190267] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T18:32:14.968063] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-09-14T18:32:14.972671] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T18:32:15.038693] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T18:32:15.691017] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-14T18:32:15.758879] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-09-14T18:32:16.558838] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-09-14T18:32:17.292889] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T18:32:17.358789] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-09-14T18:32:18.119664] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-14T18:32:18.158802] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-09-14T18:32:18.885081] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-14T18:32:18.958838] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-09-14T18:32:19.765415] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-09-14T18:32:19.768264] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T18:32:20.100788] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-14T18:32:20.558890] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-09-14T18:32:20.838965] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-14T18:32:20.843236] [INFO ] [REMOTE ] ICL: Full fetch complete (42402 records). [2025-09-14T18:32:20.843349] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-09-14T18:32:21.214886] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-09-14T18:32:21.214992] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-09-14T18:32:21.215773] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-09-14T18:32:21.215837] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-09-14T18:32:21.216860] [DEBUG] [LOCAL ] ICL: Trimmed 42402 records to 28754 (keeping 150 days of data) [2025-09-14T18:32:21.378061] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-09-14T18:32:21.410630] [DEBUG] [LOCAL ] ICL: Primary data saved (28754 records). [2025-09-14T18:32:21.410798] [INFO ] [MAIN ] ICL: Full history saved. [2025-09-14T18:32:21.410940] [INFO ] [MAIN ] Update Progress: 1087/2370 symbols completed. ICL took 25.6s. Estimated remaining: 2h 15m 56s. Rate: 9.4 symbols/min [2025-09-14T18:32:21.558567] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-14T18:32:21.590411] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:32:21.612121] [DEBUG] [LOCAL ] IEX: Loaded 17334 existing records from primary storage. [2025-09-14T18:32:21.612312] [INFO ] [MAIN ] IEX: Loaded 17334 existing records. [2025-09-14T18:32:21.799527] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:32:21.799822] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-09-14T18:32:21.799886] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-09-14T18:32:21.800514] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-09-14T18:32:21.800581] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-09-14T18:32:22.152543] [INFO ] [REMOTE ] IEX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:32:22.158843] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-09-14T18:32:22.783518] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-14T18:32:22.958879] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-09-14T18:32:23.245286] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T18:32:23.758914] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-09-14T18:32:23.828683] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T18:32:24.558861] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-09-14T18:32:25.106487] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-14T18:32:25.358842] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-09-14T18:32:25.395371] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-14T18:32:25.683536] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-14T18:32:25.686835] [INFO ] [REMOTE ] IDA: Full fetch complete (34446 records). [2025-09-14T18:32:25.686979] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-09-14T18:32:26.063826] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-09-14T18:32:26.063938] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-09-14T18:32:26.064601] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-09-14T18:32:26.064672] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-09-14T18:32:26.065733] [DEBUG] [LOCAL ] IDA: Trimmed 34446 records to 25071 (keeping 150 days of data) [2025-09-14T18:32:26.161037] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-09-14T18:32:26.239899] [DEBUG] [LOCAL ] IDA: Primary data saved (25071 records). [2025-09-14T18:32:26.240067] [INFO ] [MAIN ] IDA: Full history saved. [2025-09-14T18:32:26.240169] [INFO ] [MAIN ] Update Progress: 1088/2370 symbols completed. IDA took 24.1s. Estimated remaining: 2h 15m 47s. Rate: 9.4 symbols/min [2025-09-14T18:32:26.413405] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:32:26.436728] [DEBUG] [LOCAL ] IFF: Loaded 22945 existing records from primary storage. [2025-09-14T18:32:26.436926] [INFO ] [MAIN ] IFF: Loaded 22945 existing records. [2025-09-14T18:32:26.620230] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:32:26.620506] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-09-14T18:32:26.620570] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-09-14T18:32:26.621167] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-09-14T18:32:26.621232] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-09-14T18:32:26.962130] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-09-14T18:32:26.985955] [INFO ] [REMOTE ] IFF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:32:27.758845] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-09-14T18:32:27.853354] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-14T18:32:27.862920] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-14T18:32:28.558880] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-09-14T18:32:29.358837] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-09-14T18:32:29.477034] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-14T18:32:29.507547] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T18:32:30.158849] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-09-14T18:32:30.874924] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T18:32:30.876427] [INFO ] [REMOTE ] IDE: Full fetch complete (8961 records). [2025-09-14T18:32:30.876519] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-09-14T18:32:30.963943] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-09-14T18:32:31.249068] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-09-14T18:32:31.249336] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-09-14T18:32:31.249680] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-09-14T18:32:31.249737] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-09-14T18:32:31.250314] [DEBUG] [LOCAL ] IDE: Trimmed 8961 records to 6576 (keeping 150 days of data) [2025-09-14T18:32:31.306553] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T18:32:31.327862] [DEBUG] [LOCAL ] IDE: Primary data saved (6576 records). [2025-09-14T18:32:31.328000] [INFO ] [MAIN ] IDE: Full history saved. [2025-09-14T18:32:31.328093] [INFO ] [MAIN ] Update Progress: 1089/2370 symbols completed. IDE took 21.6s. Estimated remaining: 2h 15m 40s. Rate: 9.4 symbols/min [2025-09-14T18:32:31.506192] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:32:31.515870] [DEBUG] [LOCAL ] IFN: Loaded 8347 existing records from primary storage. [2025-09-14T18:32:31.516005] [INFO ] [MAIN ] IFN: Loaded 8347 existing records. [2025-09-14T18:32:31.697869] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:32:31.698171] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-09-14T18:32:31.698234] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-09-14T18:32:31.698690] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-09-14T18:32:31.698757] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-09-14T18:32:31.764241] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-09-14T18:32:32.084004] [INFO ] [REMOTE ] IFN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:32:32.558846] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-09-14T18:32:32.675089] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-14T18:32:32.835268] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T18:32:33.358838] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-09-14T18:32:33.661634] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T18:32:34.158854] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-09-14T18:32:34.542329] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-14T18:32:34.964731] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-09-14T18:32:34.966609] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T18:32:35.758871] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-09-14T18:32:36.558826] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-09-14T18:32:36.850702] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T18:32:36.874917] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T18:32:37.358844] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-09-14T18:32:37.769718] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T18:32:38.158827] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-09-14T18:32:38.171016] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-14T18:32:38.958834] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-09-14T18:32:39.714028] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:32:39.716408] [INFO ] [REMOTE ] IDT: Full fetch complete (18012 records). [2025-09-14T18:32:39.716542] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-09-14T18:32:39.763902] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-09-14T18:32:40.099525] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-09-14T18:32:40.099808] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-09-14T18:32:40.100298] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-09-14T18:32:40.100440] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-09-14T18:32:40.101521] [DEBUG] [LOCAL ] IDT: Trimmed 18012 records to 13144 (keeping 150 days of data) [2025-09-14T18:32:40.190824] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-14T18:32:40.219693] [DEBUG] [LOCAL ] IDT: Primary data saved (13144 records). [2025-09-14T18:32:40.219879] [INFO ] [MAIN ] IDT: Full history saved. [2025-09-14T18:32:40.219991] [INFO ] [MAIN ] Update Progress: 1090/2370 symbols completed. IDT took 27.0s. Estimated remaining: 2h 15m 36s. Rate: 9.4 symbols/min [2025-09-14T18:32:40.391041] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:32:40.401573] [DEBUG] [LOCAL ] IFS: Loaded 9357 existing records from primary storage. [2025-09-14T18:32:40.401737] [INFO ] [MAIN ] IFS: Loaded 9357 existing records. [2025-09-14T18:32:40.563440] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-09-14T18:32:40.586735] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:32:40.587793] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-09-14T18:32:40.587857] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-09-14T18:32:40.588200] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-09-14T18:32:40.588260] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-09-14T18:32:40.886141] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T18:32:40.969258] [INFO ] [REMOTE ] IFS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:32:41.358895] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-09-14T18:32:42.158833] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-09-14T18:32:42.212596] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-14T18:32:42.240065] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-14T18:32:42.958812] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-09-14T18:32:43.066029] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T18:32:43.758836] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-09-14T18:32:44.200416] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-14T18:32:44.558905] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-09-14T18:32:44.978870] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-14T18:32:45.358882] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-09-14T18:32:45.831531] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-14T18:32:46.158841] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-09-14T18:32:46.657065] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-14T18:32:46.958875] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-09-14T18:32:47.139774] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-14T18:32:47.758891] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-09-14T18:32:48.558882] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-09-14T18:32:48.744267] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T18:32:49.111882] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T18:32:49.358879] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-09-14T18:32:49.384433] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T18:32:50.158857] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-09-14T18:32:50.353830] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-14T18:32:50.355965] [INFO ] [REMOTE ] IFN: Full fetch complete (20539 records). [2025-09-14T18:32:50.356056] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-09-14T18:32:50.733623] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-09-14T18:32:50.733864] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-09-14T18:32:50.734418] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-09-14T18:32:50.734480] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-09-14T18:32:50.735503] [DEBUG] [LOCAL ] IFN: Trimmed 20539 records to 13786 (keeping 150 days of data) [2025-09-14T18:32:50.824185] [DEBUG] [LOCAL ] IFN: Primary data saved (13786 records). [2025-09-14T18:32:50.824369] [INFO ] [MAIN ] IFN: Full history saved. [2025-09-14T18:32:50.824474] [INFO ] [MAIN ] Update Progress: 1091/2370 symbols completed. IFN took 19.5s. Estimated remaining: 2h 15m 35s. Rate: 9.4 symbols/min [2025-09-14T18:32:50.966766] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-09-14T18:32:51.000469] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:32:51.007146] [DEBUG] [LOCAL ] IGA: Loaded 4546 existing records from primary storage. [2025-09-14T18:32:51.007294] [INFO ] [MAIN ] IGA: Loaded 4546 existing records. [2025-09-14T18:32:51.187213] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:32:51.187500] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-09-14T18:32:51.187582] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-09-14T18:32:51.188037] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-09-14T18:32:51.188104] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-09-14T18:32:51.544462] [INFO ] [REMOTE ] IGA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:32:51.706365] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T18:32:51.758803] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-09-14T18:32:52.198848] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-14T18:32:52.558846] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-09-14T18:32:53.284722] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-14T18:32:53.358863] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-09-14T18:32:53.677365] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-14T18:32:54.162225] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-09-14T18:32:54.163228] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-14T18:32:54.958812] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-09-14T18:32:55.281100] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T18:32:55.758889] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-09-14T18:32:55.986056] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-14T18:32:56.558842] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-09-14T18:32:56.894815] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-14T18:32:56.900046] [INFO ] [REMOTE ] IEX: Full fetch complete (41274 records). [2025-09-14T18:32:56.900342] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-09-14T18:32:57.286296] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-09-14T18:32:57.286485] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-09-14T18:32:57.287391] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-09-14T18:32:57.287487] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-09-14T18:32:57.289225] [DEBUG] [LOCAL ] IEX: Trimmed 41274 records to 28982 (keeping 150 days of data) [2025-09-14T18:32:57.381891] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-09-14T18:32:57.448601] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T18:32:57.525979] [DEBUG] [LOCAL ] IEX: Primary data saved (28982 records). [2025-09-14T18:32:57.526204] [INFO ] [MAIN ] IEX: Full history saved. [2025-09-14T18:32:57.526371] [INFO ] [MAIN ] Update Progress: 1092/2370 symbols completed. IEX took 36.1s. Estimated remaining: 2h 15m 29s. Rate: 9.4 symbols/min [2025-09-14T18:32:57.702557] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:32:57.713726] [DEBUG] [LOCAL ] IGD: Loaded 8924 existing records from primary storage. [2025-09-14T18:32:57.713893] [INFO ] [MAIN ] IGD: Loaded 8924 existing records. [2025-09-14T18:32:57.911893] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:32:57.912292] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-09-14T18:32:57.912365] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-09-14T18:32:57.912838] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-09-14T18:32:57.912903] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-09-14T18:32:58.166169] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-09-14T18:32:58.293453] [INFO ] [REMOTE ] IGD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:32:58.539449] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-14T18:32:58.928146] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:32:58.934058] [INFO ] [REMOTE ] IFF: Full fetch complete (55300 records). [2025-09-14T18:32:58.934306] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-09-14T18:32:58.965668] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-09-14T18:32:59.330051] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-09-14T18:32:59.330346] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-09-14T18:32:59.331410] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-09-14T18:32:59.331484] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-09-14T18:32:59.333030] [DEBUG] [LOCAL ] IFF: Trimmed 55300 records to 38270 (keeping 150 days of data) [2025-09-14T18:32:59.590674] [DEBUG] [LOCAL ] IFF: Primary data saved (38270 records). [2025-09-14T18:32:59.590862] [INFO ] [MAIN ] IFF: Full history saved. [2025-09-14T18:32:59.590985] [INFO ] [MAIN ] Update Progress: 1093/2370 symbols completed. IFF took 33.4s. Estimated remaining: 2h 15m 18s. Rate: 9.4 symbols/min [2025-09-14T18:32:59.763940] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-09-14T18:32:59.765776] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:32:59.771918] [DEBUG] [LOCAL ] IGI: Loaded 2169 existing records from primary storage. [2025-09-14T18:32:59.772227] [INFO ] [MAIN ] IGI: Loaded 2169 existing records. [2025-09-14T18:32:59.961068] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:32:59.961367] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-09-14T18:32:59.961503] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-09-14T18:32:59.961893] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-09-14T18:32:59.961967] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-09-14T18:33:00.350355] [INFO ] [REMOTE ] IGI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:33:00.351828] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T18:33:00.558844] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-09-14T18:33:00.709664] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-14T18:33:00.712724] [INFO ] [REMOTE ] IFS: Full fetch complete (25152 records). [2025-09-14T18:33:00.712856] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-09-14T18:33:01.094787] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-09-14T18:33:01.094980] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-09-14T18:33:01.096280] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-09-14T18:33:01.096350] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-09-14T18:33:01.097433] [DEBUG] [LOCAL ] IFS: Trimmed 25152 records to 16626 (keeping 150 days of data) [2025-09-14T18:33:01.198390] [DEBUG] [LOCAL ] IFS: Primary data saved (16626 records). [2025-09-14T18:33:01.198601] [INFO ] [MAIN ] IFS: Full history saved. [2025-09-14T18:33:01.198748] [INFO ] [MAIN ] Update Progress: 1094/2370 symbols completed. IFS took 21.0s. Estimated remaining: 2h 15m 6s. Rate: 9.4 symbols/min [2025-09-14T18:33:01.370239] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-09-14T18:33:01.373539] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:33:01.390665] [DEBUG] [LOCAL ] IGR: Loaded 14800 existing records from primary storage. [2025-09-14T18:33:01.390848] [INFO ] [MAIN ] IGR: Loaded 14800 existing records. [2025-09-14T18:33:01.571242] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:33:01.571511] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-09-14T18:33:01.571579] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-09-14T18:33:01.572234] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-09-14T18:33:01.572300] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-09-14T18:33:01.932031] [INFO ] [REMOTE ] IGR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:33:02.158832] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-09-14T18:33:02.174447] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-14T18:33:02.958855] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-09-14T18:33:03.758837] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-09-14T18:33:04.569694] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-14T18:33:04.570966] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-09-14T18:33:04.589550] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (3.22 seconds). [2025-09-14T18:33:05.245131] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (3.09 seconds). [2025-09-14T18:33:05.294012] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-14T18:33:05.358837] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-09-14T18:33:05.924990] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (2.97 seconds). [2025-09-14T18:33:05.945987] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-14T18:33:06.158859] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-09-14T18:33:06.958844] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-09-14T18:33:07.028245] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T18:33:07.758804] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-09-14T18:33:08.075717] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T18:33:08.558867] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-09-14T18:33:08.706754] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-14T18:33:09.358867] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-09-14T18:33:09.915503] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-14T18:33:10.048531] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-14T18:33:10.158834] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-09-14T18:33:10.958851] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-09-14T18:33:11.095072] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-14T18:33:11.758826] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-09-14T18:33:11.863377] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T18:33:12.422138] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-14T18:33:12.558851] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-09-14T18:33:13.286678] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-14T18:33:13.358841] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-09-14T18:33:14.027011] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-14T18:33:14.158814] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-09-14T18:33:14.650622] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-14T18:33:14.651922] [INFO ] [REMOTE ] IGI: Full fetch complete (3965 records). [2025-09-14T18:33:14.652048] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-09-14T18:33:14.963974] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-09-14T18:33:15.031582] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-09-14T18:33:15.031730] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-09-14T18:33:15.031889] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-09-14T18:33:15.031939] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-09-14T18:33:15.032376] [DEBUG] [LOCAL ] IGI: Trimmed 3965 records to 2744 (keeping 150 days of data) [2025-09-14T18:33:15.050505] [DEBUG] [LOCAL ] IGI: Primary data saved (2744 records). [2025-09-14T18:33:15.050617] [INFO ] [MAIN ] IGI: Full history saved. [2025-09-14T18:33:15.050767] [INFO ] [MAIN ] Update Progress: 1095/2370 symbols completed. IGI took 15.5s. Estimated remaining: 2h 15m 8s. Rate: 9.4 symbols/min [2025-09-14T18:33:15.234511] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:33:15.237911] [DEBUG] [LOCAL ] IH: Loaded 1551 existing records from primary storage. [2025-09-14T18:33:15.238005] [INFO ] [MAIN ] IH: Loaded 1551 existing records. [2025-09-14T18:33:15.421004] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:33:15.421304] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-09-14T18:33:15.421441] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-09-14T18:33:15.421686] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-09-14T18:33:15.421748] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-09-14T18:33:15.768349] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-09-14T18:33:15.947417] [INFO ] [REMOTE ] IH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:33:16.558884] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-09-14T18:33:17.252018] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-14T18:33:17.342430] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-14T18:33:17.344217] [INFO ] [REMOTE ] IGA: Full fetch complete (10309 records). [2025-09-14T18:33:17.344305] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-09-14T18:33:17.365044] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-09-14T18:33:17.674395] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-09-14T18:33:17.745512] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-09-14T18:33:17.745689] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-09-14T18:33:17.746005] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-09-14T18:33:17.746095] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-09-14T18:33:17.746729] [DEBUG] [LOCAL ] IGA: Trimmed 10309 records to 6969 (keeping 150 days of data) [2025-09-14T18:33:17.798918] [DEBUG] [LOCAL ] IGA: Primary data saved (6969 records). [2025-09-14T18:33:17.799116] [INFO ] [MAIN ] IGA: Full history saved. [2025-09-14T18:33:17.799252] [INFO ] [MAIN ] Update Progress: 1096/2370 symbols completed. IGA took 27.0s. Estimated remaining: 2h 14m 57s. Rate: 9.4 symbols/min [2025-09-14T18:33:17.973161] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:33:17.978118] [DEBUG] [LOCAL ] IHD: Loaded 2954 existing records from primary storage. [2025-09-14T18:33:17.978232] [INFO ] [MAIN ] IHD: Loaded 2954 existing records. [2025-09-14T18:33:18.153667] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:33:18.153935] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-09-14T18:33:18.153996] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-09-14T18:33:18.154262] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-09-14T18:33:18.154322] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-09-14T18:33:18.165452] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-09-14T18:33:18.535091] [INFO ] [REMOTE ] IHD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:33:18.958801] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-09-14T18:33:18.995467] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T18:33:19.045214] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T18:33:19.758843] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-09-14T18:33:20.159537] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-14T18:33:20.558823] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-09-14T18:33:20.959242] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-14T18:33:21.358841] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-09-14T18:33:21.402188] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-14T18:33:21.404262] [INFO ] [REMOTE ] IGD: Full fetch complete (21153 records). [2025-09-14T18:33:21.404428] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-09-14T18:33:21.791496] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-09-14T18:33:21.791627] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-09-14T18:33:21.792345] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-09-14T18:33:21.792417] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-09-14T18:33:21.793424] [DEBUG] [LOCAL ] IGD: Trimmed 21153 records to 14033 (keeping 150 days of data) [2025-09-14T18:33:21.886293] [DEBUG] [LOCAL ] IGD: Primary data saved (14033 records). [2025-09-14T18:33:21.886488] [INFO ] [MAIN ] IGD: Full history saved. [2025-09-14T18:33:21.886625] [INFO ] [MAIN ] Update Progress: 1097/2370 symbols completed. IGD took 24.4s. Estimated remaining: 2h 14m 48s. Rate: 9.4 symbols/min [2025-09-14T18:33:21.997006] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-14T18:33:22.070125] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:33:22.082681] [DEBUG] [LOCAL ] IHG: Loaded 10248 existing records from primary storage. [2025-09-14T18:33:22.082843] [INFO ] [MAIN ] IHG: Loaded 10248 existing records. [2025-09-14T18:33:22.164178] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-09-14T18:33:22.272553] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:33:22.272867] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-09-14T18:33:22.272963] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-09-14T18:33:22.273454] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-09-14T18:33:22.273525] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-09-14T18:33:22.650320] [INFO ] [REMOTE ] IHG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:33:22.958831] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-09-14T18:33:23.099051] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-14T18:33:23.758908] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-09-14T18:33:24.202086] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T18:33:24.558876] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-09-14T18:33:24.956038] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T18:33:25.358821] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-09-14T18:33:25.395877] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-14T18:33:26.158877] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-09-14T18:33:26.939376] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-14T18:33:26.958777] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-09-14T18:33:26.996160] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T18:33:27.758828] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-09-14T18:33:27.941502] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-14T18:33:28.558924] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-09-14T18:33:29.358841] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-09-14T18:33:29.909042] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-14T18:33:29.911229] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-14T18:33:30.158828] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-09-14T18:33:30.408152] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-14T18:33:30.958851] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-09-14T18:33:31.372795] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-14T18:33:31.376333] [INFO ] [REMOTE ] IGR: Full fetch complete (33338 records). [2025-09-14T18:33:31.376467] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-09-14T18:33:31.478484] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-14T18:33:31.763134] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-09-14T18:33:31.763593] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-09-14T18:33:31.763900] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-09-14T18:33:31.765090] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-09-14T18:33:31.766251] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-09-14T18:33:31.767633] [DEBUG] [LOCAL ] IGR: Trimmed 33338 records to 22791 (keeping 150 days of data) [2025-09-14T18:33:31.902995] [DEBUG] [LOCAL ] IGR: Primary data saved (22791 records). [2025-09-14T18:33:31.903154] [INFO ] [MAIN ] IGR: Full history saved. [2025-09-14T18:33:31.903265] [INFO ] [MAIN ] Update Progress: 1098/2370 symbols completed. IGR took 30.7s. Estimated remaining: 2h 14m 46s. Rate: 9.4 symbols/min [2025-09-14T18:33:32.074895] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:33:32.094512] [DEBUG] [LOCAL ] IHS: Loaded 16979 existing records from primary storage. [2025-09-14T18:33:32.094727] [INFO ] [MAIN ] IHS: Loaded 16979 existing records. [2025-09-14T18:33:32.272500] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:33:32.272814] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-09-14T18:33:32.272875] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-09-14T18:33:32.273409] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-09-14T18:33:32.273471] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-09-14T18:33:32.564002] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-09-14T18:33:32.628519] [INFO ] [REMOTE ] IHS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:33:33.254228] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-14T18:33:33.358793] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-09-14T18:33:33.509774] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-14T18:33:34.158831] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-09-14T18:33:34.835442] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-14T18:33:34.958816] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-09-14T18:33:34.992067] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-14T18:33:35.758836] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-09-14T18:33:36.260919] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-14T18:33:36.317818] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-14T18:33:36.558825] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-09-14T18:33:37.358785] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-09-14T18:33:37.746889] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-14T18:33:37.848836] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-14T18:33:38.158834] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-09-14T18:33:38.930430] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T18:33:38.931865] [INFO ] [REMOTE ] IHD: Full fetch complete (8097 records). [2025-09-14T18:33:38.931952] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-09-14T18:33:38.963909] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-09-14T18:33:39.295303] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-09-14T18:33:39.295442] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-09-14T18:33:39.295728] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-09-14T18:33:39.295793] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-09-14T18:33:39.296414] [DEBUG] [LOCAL ] IHD: Trimmed 8097 records to 5208 (keeping 150 days of data) [2025-09-14T18:33:39.328310] [DEBUG] [LOCAL ] IHD: Primary data saved (5208 records). [2025-09-14T18:33:39.328494] [INFO ] [MAIN ] IHD: Full history saved. [2025-09-14T18:33:39.328662] [INFO ] [MAIN ] Update Progress: 1099/2370 symbols completed. IHD took 21.5s. Estimated remaining: 2h 14m 41s. Rate: 9.4 symbols/min [2025-09-14T18:33:39.505706] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:33:39.510023] [DEBUG] [LOCAL ] IIF: Loaded 2345 existing records from primary storage. [2025-09-14T18:33:39.510147] [INFO ] [MAIN ] IIF: Loaded 2345 existing records. [2025-09-14T18:33:39.712578] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:33:39.712868] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-09-14T18:33:39.712931] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-09-14T18:33:39.713206] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-09-14T18:33:39.713277] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-09-14T18:33:39.763942] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-09-14T18:33:40.088220] [INFO ] [REMOTE ] IIF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:33:40.311441] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T18:33:40.364152] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-14T18:33:40.558856] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-09-14T18:33:41.358881] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-09-14T18:33:41.392945] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T18:33:42.158885] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-09-14T18:33:42.792233] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-14T18:33:42.820597] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-14T18:33:42.958879] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-09-14T18:33:43.756119] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-14T18:33:43.759166] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-09-14T18:33:44.453125] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-14T18:33:44.558842] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-09-14T18:33:45.358860] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-09-14T18:33:45.499265] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-14T18:33:45.993756] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T18:33:45.994727] [INFO ] [REMOTE ] IH: Full fetch complete (4209 records). [2025-09-14T18:33:45.994809] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-09-14T18:33:46.167872] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-09-14T18:33:46.353684] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-09-14T18:33:46.353790] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-09-14T18:33:46.353942] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-09-14T18:33:46.353994] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-09-14T18:33:46.354382] [DEBUG] [LOCAL ] IH: Trimmed 4209 records to 2015 (keeping 150 days of data) [2025-09-14T18:33:46.366299] [DEBUG] [LOCAL ] IH: Primary data saved (2015 records). [2025-09-14T18:33:46.366376] [INFO ] [MAIN ] IH: Full history saved. [2025-09-14T18:33:46.366462] [INFO ] [MAIN ] Update Progress: 1100/2370 symbols completed. IH took 31.3s. Estimated remaining: 2h 14m 36s. Rate: 9.4 symbols/min [2025-09-14T18:33:46.541408] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:33:46.550751] [DEBUG] [LOCAL ] IIIN: Loaded 6713 existing records from primary storage. [2025-09-14T18:33:46.550915] [INFO ] [MAIN ] IIIN: Loaded 6713 existing records. [2025-09-14T18:33:46.727977] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:33:46.728249] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-09-14T18:33:46.728311] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-09-14T18:33:46.728685] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-09-14T18:33:46.728749] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-09-14T18:33:46.967405] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-09-14T18:33:47.060219] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-14T18:33:47.101371] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:33:47.758847] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-09-14T18:33:48.545276] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-14T18:33:48.558769] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-09-14T18:33:49.137173] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-14T18:33:49.358837] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-09-14T18:33:49.613377] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-14T18:33:49.616065] [INFO ] [REMOTE ] IHG: Full fetch complete (27459 records). [2025-09-14T18:33:49.616159] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-09-14T18:33:49.999304] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-09-14T18:33:49.999409] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-09-14T18:33:50.000011] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-09-14T18:33:50.000070] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-09-14T18:33:50.000923] [DEBUG] [LOCAL ] IHG: Trimmed 27459 records to 18114 (keeping 150 days of data) [2025-09-14T18:33:50.132498] [DEBUG] [LOCAL ] IHG: Primary data saved (18114 records). [2025-09-14T18:33:50.132727] [INFO ] [MAIN ] IHG: Full history saved. [2025-09-14T18:33:50.132881] [INFO ] [MAIN ] Update Progress: 1101/2370 symbols completed. IHG took 28.2s. Estimated remaining: 2h 14m 26s. Rate: 9.4 symbols/min [2025-09-14T18:33:50.167389] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-09-14T18:33:50.317282] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:33:50.326720] [DEBUG] [LOCAL ] IIM: Loaded 7522 existing records from primary storage. [2025-09-14T18:33:50.326894] [INFO ] [MAIN ] IIM: Loaded 7522 existing records. [2025-09-14T18:33:50.510065] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:33:50.510321] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-09-14T18:33:50.510381] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-09-14T18:33:50.510725] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-09-14T18:33:50.510811] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-09-14T18:33:50.897354] [INFO ] [REMOTE ] IIM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:33:50.907851] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T18:33:50.958773] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-09-14T18:33:51.199185] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-14T18:33:51.758851] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-09-14T18:33:52.156029] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-14T18:33:52.507911] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-14T18:33:52.558810] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-09-14T18:33:53.358854] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-09-14T18:33:53.652520] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-14T18:33:53.917335] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T18:33:53.918499] [INFO ] [REMOTE ] IIF: Full fetch complete (6586 records). [2025-09-14T18:33:53.918589] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-09-14T18:33:54.163984] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-09-14T18:33:54.287772] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-09-14T18:33:54.288096] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-09-14T18:33:54.288382] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-09-14T18:33:54.288439] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-09-14T18:33:54.289184] [DEBUG] [LOCAL ] IIF: Trimmed 6586 records to 4212 (keeping 150 days of data) [2025-09-14T18:33:54.315924] [DEBUG] [LOCAL ] IIF: Primary data saved (4212 records). [2025-09-14T18:33:54.316028] [INFO ] [MAIN ] IIF: Full history saved. [2025-09-14T18:33:54.316177] [INFO ] [MAIN ] Update Progress: 1102/2370 symbols completed. IIF took 15.0s. Estimated remaining: 2h 14m 17s. Rate: 9.4 symbols/min [2025-09-14T18:33:54.486340] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:33:54.503501] [DEBUG] [LOCAL ] IIPR: Loaded 13132 existing records from primary storage. [2025-09-14T18:33:54.503671] [INFO ] [MAIN ] IIPR: Loaded 13132 existing records. [2025-09-14T18:33:54.678124] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:33:54.678393] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-09-14T18:33:54.678456] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-09-14T18:33:54.678931] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-09-14T18:33:54.678998] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-09-14T18:33:54.963196] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-09-14T18:33:55.043336] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:33:55.243594] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T18:33:55.758845] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-09-14T18:33:56.558839] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-09-14T18:33:56.695339] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T18:33:57.214893] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T18:33:57.358819] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-09-14T18:33:57.989323] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-14T18:33:58.158838] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-09-14T18:33:58.725756] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-14T18:33:58.958883] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-09-14T18:33:59.135825] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-14T18:33:59.758844] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-09-14T18:34:00.083818] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T18:34:00.558805] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-09-14T18:34:00.626693] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T18:34:01.358838] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-09-14T18:34:01.713032] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-14T18:34:02.158860] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-09-14T18:34:02.958853] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-09-14T18:34:03.276496] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T18:34:03.334106] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T18:34:03.758872] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-09-14T18:34:04.558192] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-14T18:34:04.566418] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-09-14T18:34:05.115285] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-14T18:34:05.358852] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-09-14T18:34:05.595007] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-14T18:34:06.158871] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-09-14T18:34:06.671698] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-14T18:34:06.959197] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-09-14T18:34:07.359609] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T18:34:07.758922] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-09-14T18:34:08.558929] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-09-14T18:34:08.678540] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T18:34:09.239583] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T18:34:09.358801] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-09-14T18:34:09.650247] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-14T18:34:09.652784] [INFO ] [REMOTE ] IIM: Full fetch complete (18362 records). [2025-09-14T18:34:09.652873] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-09-14T18:34:10.027772] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-09-14T18:34:10.027891] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-09-14T18:34:10.028588] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-09-14T18:34:10.028687] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-09-14T18:34:10.029308] [DEBUG] [LOCAL ] IIM: Trimmed 18362 records to 11433 (keeping 150 days of data) [2025-09-14T18:34:10.108136] [DEBUG] [LOCAL ] IIM: Primary data saved (11433 records). [2025-09-14T18:34:10.108305] [INFO ] [MAIN ] IIM: Full history saved. [2025-09-14T18:34:10.108417] [INFO ] [MAIN ] Update Progress: 1103/2370 symbols completed. IIM took 20.0s. Estimated remaining: 2h 14m 22s. Rate: 9.4 symbols/min [2025-09-14T18:34:10.163980] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-09-14T18:34:10.280932] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:34:10.301838] [DEBUG] [LOCAL ] IMAX: Loaded 19584 existing records from primary storage. [2025-09-14T18:34:10.301998] [INFO ] [MAIN ] IMAX: Loaded 19584 existing records. [2025-09-14T18:34:10.476767] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:34:10.477009] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-09-14T18:34:10.477070] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-09-14T18:34:10.477586] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-09-14T18:34:10.477670] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-09-14T18:34:10.833137] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:34:10.958821] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-09-14T18:34:10.994340] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T18:34:11.503818] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-14T18:34:11.758847] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-09-14T18:34:12.558835] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-09-14T18:34:12.780426] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-14T18:34:13.032729] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T18:34:13.036430] [INFO ] [REMOTE ] IIIN: Full fetch complete (18489 records). [2025-09-14T18:34:13.036564] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-09-14T18:34:13.364987] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-09-14T18:34:13.414193] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-09-14T18:34:13.414427] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-09-14T18:34:13.416164] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-09-14T18:34:13.416670] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-09-14T18:34:13.417904] [DEBUG] [LOCAL ] IIIN: Trimmed 18489 records to 12082 (keeping 150 days of data) [2025-09-14T18:34:13.482992] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T18:34:13.535383] [DEBUG] [LOCAL ] IIIN: Primary data saved (12082 records). [2025-09-14T18:34:13.535601] [INFO ] [MAIN ] IIIN: Full history saved. [2025-09-14T18:34:13.535731] [INFO ] [MAIN ] Update Progress: 1104/2370 symbols completed. IIIN took 27.2s. Estimated remaining: 2h 14m 12s. Rate: 9.4 symbols/min [2025-09-14T18:34:13.710305] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:34:13.734084] [DEBUG] [LOCAL ] INFA: Loaded 22154 existing records from primary storage. [2025-09-14T18:34:13.734248] [INFO ] [MAIN ] INFA: Loaded 22154 existing records. [2025-09-14T18:34:13.916764] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:34:13.917068] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-09-14T18:34:13.917134] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-09-14T18:34:13.917895] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-09-14T18:34:13.917959] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-09-14T18:34:14.168358] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-09-14T18:34:14.284572] [INFO ] [REMOTE ] INFA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:34:14.958833] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-09-14T18:34:15.089166] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T18:34:15.552149] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-14T18:34:15.556510] [INFO ] [REMOTE ] IHS: Full fetch complete (41214 records). [2025-09-14T18:34:15.556696] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-09-14T18:34:15.764031] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-09-14T18:34:15.958259] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-09-14T18:34:15.958379] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-09-14T18:34:15.959178] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-09-14T18:34:15.959239] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-09-14T18:34:15.960229] [DEBUG] [LOCAL ] IHS: Trimmed 41214 records to 29543 (keeping 150 days of data) [2025-09-14T18:34:16.138869] [DEBUG] [LOCAL ] IHS: Primary data saved (29543 records). [2025-09-14T18:34:16.139047] [INFO ] [MAIN ] IHS: Full history saved. [2025-09-14T18:34:16.139157] [INFO ] [MAIN ] Update Progress: 1105/2370 symbols completed. IHS took 44.2s. Estimated remaining: 2h 14m 2s. Rate: 9.4 symbols/min [2025-09-14T18:34:16.307286] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:34:16.331575] [DEBUG] [LOCAL ] INFY: Loaded 24015 existing records from primary storage. [2025-09-14T18:34:16.331759] [INFO ] [MAIN ] INFY: Loaded 24015 existing records. [2025-09-14T18:34:16.514846] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:34:16.517298] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T18:34:16.517411] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-09-14T18:34:16.517608] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-09-14T18:34:16.521161] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-09-14T18:34:16.521239] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-09-14T18:34:16.551685] [INFO ] [REMOTE ] IIPR: Full fetch complete (32100 records). [2025-09-14T18:34:16.573739] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-09-14T18:34:16.583515] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-09-14T18:34:17.113512] [INFO ] [REMOTE ] INFY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:34:17.290082] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-09-14T18:34:17.291745] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-14T18:34:17.290782] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-09-14T18:34:17.292843] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-09-14T18:34:17.302673] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-09-14T18:34:17.303857] [DEBUG] [LOCAL ] IIPR: Trimmed 32100 records to 20957 (keeping 150 days of data) [2025-09-14T18:34:17.360929] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-09-14T18:34:17.446429] [DEBUG] [LOCAL ] IIPR: Primary data saved (20957 records). [2025-09-14T18:34:17.446676] [INFO ] [MAIN ] IIPR: Full history saved. [2025-09-14T18:34:17.446807] [INFO ] [MAIN ] Update Progress: 1106/2370 symbols completed. IIPR took 23.1s. Estimated remaining: 2h 13m 49s. Rate: 9.4 symbols/min [2025-09-14T18:34:17.631374] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:34:17.656347] [DEBUG] [LOCAL ] ING: Loaded 22777 existing records from primary storage. [2025-09-14T18:34:17.656594] [INFO ] [MAIN ] ING: Loaded 22777 existing records. [2025-09-14T18:34:17.856343] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:34:17.856866] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-09-14T18:34:17.856950] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-09-14T18:34:17.857934] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-09-14T18:34:17.858036] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-09-14T18:34:18.170627] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-09-14T18:34:18.257465] [INFO ] [REMOTE ] ING: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:34:18.290974] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T18:34:18.340621] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-14T18:34:18.958868] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-09-14T18:34:19.758846] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-09-14T18:34:19.943995] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T18:34:20.322566] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-14T18:34:20.448190] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-14T18:34:20.558872] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-09-14T18:34:21.358840] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-09-14T18:34:21.484340] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-14T18:34:21.841020] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-14T18:34:22.158830] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-09-14T18:34:22.958884] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-09-14T18:34:23.129656] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-14T18:34:23.758846] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-09-14T18:34:24.418356] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T18:34:24.527250] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-14T18:34:24.558791] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-09-14T18:34:25.358891] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-09-14T18:34:25.456823] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-14T18:34:26.158827] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-09-14T18:34:26.958833] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-09-14T18:34:27.045886] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T18:34:27.171982] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-14T18:34:27.758840] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-09-14T18:34:28.466933] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T18:34:28.558955] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-09-14T18:34:29.365200] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-09-14T18:34:29.397635] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T18:34:29.548234] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T18:34:30.158874] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-09-14T18:34:30.958921] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-09-14T18:34:31.075262] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-14T18:34:31.408091] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-14T18:34:31.413714] [INFO ] [REMOTE ] IMAX: Full fetch complete (46154 records). [2025-09-14T18:34:31.413989] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-09-14T18:34:31.761330] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-09-14T18:34:31.794776] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-09-14T18:34:31.794954] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-09-14T18:34:31.796170] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-09-14T18:34:31.796401] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-09-14T18:34:31.798176] [DEBUG] [LOCAL ] IMAX: Trimmed 46154 records to 32221 (keeping 150 days of data) [2025-09-14T18:34:31.937152] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-14T18:34:32.052869] [DEBUG] [LOCAL ] IMAX: Primary data saved (32221 records). [2025-09-14T18:34:32.053058] [INFO ] [MAIN ] IMAX: Full history saved. [2025-09-14T18:34:32.053175] [INFO ] [MAIN ] Update Progress: 1107/2370 symbols completed. IMAX took 21.9s. Estimated remaining: 2h 13m 53s. Rate: 9.4 symbols/min [2025-09-14T18:34:32.227499] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:34:32.240787] [DEBUG] [LOCAL ] INGM: Loaded 12297 existing records from primary storage. [2025-09-14T18:34:32.240944] [INFO ] [MAIN ] INGM: Loaded 12297 existing records. [2025-09-14T18:34:32.418457] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:34:32.418735] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-09-14T18:34:32.418801] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-09-14T18:34:32.419247] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-09-14T18:34:32.419314] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-09-14T18:34:32.568725] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-09-14T18:34:32.776171] [INFO ] [REMOTE ] INGM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:34:33.358841] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-09-14T18:34:33.520572] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-14T18:34:33.690951] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T18:34:34.158867] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-09-14T18:34:34.615486] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-14T18:34:34.958841] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-09-14T18:34:35.088521] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T18:34:35.758824] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-09-14T18:34:36.397272] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-14T18:34:36.506370] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-14T18:34:36.558812] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-09-14T18:34:37.260581] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T18:34:37.266174] [INFO ] [REMOTE ] INFY: Full fetch complete (58269 records). [2025-09-14T18:34:37.266312] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-09-14T18:34:37.363995] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-09-14T18:34:37.655182] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-09-14T18:34:37.655341] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-09-14T18:34:37.656220] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-09-14T18:34:37.656281] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-09-14T18:34:37.657478] [DEBUG] [LOCAL ] INFY: Trimmed 58269 records to 40348 (keeping 150 days of data) [2025-09-14T18:34:37.921588] [DEBUG] [LOCAL ] INFY: Primary data saved (40348 records). [2025-09-14T18:34:37.921768] [INFO ] [MAIN ] INFY: Full history saved. [2025-09-14T18:34:37.921866] [INFO ] [MAIN ] Update Progress: 1108/2370 symbols completed. INFY took 21.8s. Estimated remaining: 2h 13m 46s. Rate: 9.4 symbols/min [2025-09-14T18:34:38.092625] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:34:38.109026] [DEBUG] [LOCAL ] INGR: Loaded 14773 existing records from primary storage. [2025-09-14T18:34:38.109202] [INFO ] [MAIN ] INGR: Loaded 14773 existing records. [2025-09-14T18:34:38.164328] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-09-14T18:34:38.288126] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:34:38.288393] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-09-14T18:34:38.288470] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-09-14T18:34:38.289092] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-09-14T18:34:38.289169] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-09-14T18:34:38.675712] [INFO ] [REMOTE ] INGR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:34:38.958852] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-09-14T18:34:39.094214] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-14T18:34:39.227774] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T18:34:39.758870] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-09-14T18:34:40.366470] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-14T18:34:40.558825] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-09-14T18:34:41.143208] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-14T18:34:41.358855] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-09-14T18:34:42.158845] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-09-14T18:34:42.210222] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-14T18:34:42.679254] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-14T18:34:42.958844] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-09-14T18:34:43.207374] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-14T18:34:43.214747] [INFO ] [REMOTE ] INFA: Full fetch complete (54640 records). [2025-09-14T18:34:43.215015] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-09-14T18:34:43.602111] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-09-14T18:34:43.602240] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-09-14T18:34:43.603142] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-09-14T18:34:43.603208] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-09-14T18:34:43.604614] [DEBUG] [LOCAL ] INFA: Trimmed 54640 records to 37626 (keeping 150 days of data) [2025-09-14T18:34:43.780109] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-09-14T18:34:43.852888] [DEBUG] [LOCAL ] INFA: Primary data saved (37626 records). [2025-09-14T18:34:43.853095] [INFO ] [MAIN ] INFA: Full history saved. [2025-09-14T18:34:43.853204] [INFO ] [MAIN ] Update Progress: 1109/2370 symbols completed. INFA took 30.3s. Estimated remaining: 2h 13m 39s. Rate: 9.4 symbols/min [2025-09-14T18:34:44.025342] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:34:44.043612] [DEBUG] [LOCAL ] INN: Loaded 18348 existing records from primary storage. [2025-09-14T18:34:44.043796] [INFO ] [MAIN ] INN: Loaded 18348 existing records. [2025-09-14T18:34:44.222586] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:34:44.222920] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-09-14T18:34:44.223001] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-09-14T18:34:44.223702] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-09-14T18:34:44.223786] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-09-14T18:34:44.561479] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-09-14T18:34:44.605789] [INFO ] [REMOTE ] INN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:34:44.630314] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T18:34:44.969075] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T18:34:45.349493] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-14T18:34:45.354786] [INFO ] [REMOTE ] ING: Full fetch complete (55229 records). [2025-09-14T18:34:45.354930] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-09-14T18:34:45.366683] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-09-14T18:34:45.769350] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-09-14T18:34:45.769539] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-09-14T18:34:45.770535] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-09-14T18:34:45.770596] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-09-14T18:34:45.772492] [DEBUG] [LOCAL ] ING: Trimmed 55229 records to 38033 (keeping 150 days of data) [2025-09-14T18:34:46.034656] [DEBUG] [LOCAL ] ING: Primary data saved (38033 records). [2025-09-14T18:34:46.034850] [INFO ] [MAIN ] ING: Full history saved. [2025-09-14T18:34:46.034959] [INFO ] [MAIN ] Update Progress: 1110/2370 symbols completed. ING took 28.6s. Estimated remaining: 2h 13m 28s. Rate: 9.4 symbols/min [2025-09-14T18:34:46.163973] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-09-14T18:34:46.219560] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:34:46.233371] [DEBUG] [LOCAL ] INR: Loaded 12353 existing records from primary storage. [2025-09-14T18:34:46.233523] [INFO ] [MAIN ] INR: Loaded 12353 existing records. [2025-09-14T18:34:46.415760] [WARN ] [MAIN ] INR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:34:46.416029] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-09-14T18:34:46.416090] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-14T18:34:46.416680] [DEBUG] [LOCAL ] INR: Deleted primary data file. [2025-09-14T18:34:46.416742] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-09-14T18:34:46.766066] [INFO ] [REMOTE ] INR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:34:46.784889] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-14T18:34:46.958808] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-09-14T18:34:47.758883] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-09-14T18:34:47.916557] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-14T18:34:47.996249] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-14T18:34:48.558794] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-09-14T18:34:48.816905] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-14T18:34:49.358883] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-09-14T18:34:49.744051] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T18:34:50.158915] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-09-14T18:34:50.335041] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T18:34:50.339433] [INFO ] [REMOTE ] INGM: Full fetch complete (31601 records). [2025-09-14T18:34:50.339616] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-09-14T18:34:50.729176] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-09-14T18:34:50.729278] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-09-14T18:34:50.729898] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-09-14T18:34:50.729954] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-09-14T18:34:50.730798] [DEBUG] [LOCAL ] INGM: Trimmed 31601 records to 20645 (keeping 150 days of data) [2025-09-14T18:34:50.862716] [DEBUG] [LOCAL ] INGM: Primary data saved (20645 records). [2025-09-14T18:34:50.862885] [INFO ] [MAIN ] INGM: Full history saved. [2025-09-14T18:34:50.862995] [INFO ] [MAIN ] Update Progress: 1111/2370 symbols completed. INGM took 18.8s. Estimated remaining: 2h 13m 20s. Rate: 9.4 symbols/min [2025-09-14T18:34:50.968001] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-09-14T18:34:51.042709] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:34:51.060999] [DEBUG] [LOCAL ] INSP: Loaded 18199 existing records from primary storage. [2025-09-14T18:34:51.061151] [INFO ] [MAIN ] INSP: Loaded 18199 existing records. [2025-09-14T18:34:51.234795] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:34:51.235014] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-09-14T18:34:51.235072] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-09-14T18:34:51.235703] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-09-14T18:34:51.235767] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-09-14T18:34:51.586022] [INFO ] [REMOTE ] INSP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:34:51.674868] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T18:34:51.758779] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-09-14T18:34:52.401276] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T18:34:52.558873] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-09-14T18:34:53.221079] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T18:34:53.358845] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-09-14T18:34:53.787126] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T18:34:54.158797] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-09-14T18:34:54.860582] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-14T18:34:54.958775] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-09-14T18:34:55.675595] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T18:34:55.758772] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-09-14T18:34:56.264817] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-14T18:34:56.558874] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-09-14T18:34:57.244243] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-14T18:34:57.358833] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-09-14T18:34:58.002614] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T18:34:58.158825] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-09-14T18:34:58.840180] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-14T18:34:58.958818] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-09-14T18:34:59.574429] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-14T18:34:59.758887] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-09-14T18:35:00.159800] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T18:35:00.175941] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-14T18:35:00.179747] [INFO ] [REMOTE ] INGR: Full fetch complete (36752 records). [2025-09-14T18:35:00.179849] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-09-14T18:35:00.559792] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-09-14T18:35:00.560023] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-09-14T18:35:00.560142] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-09-14T18:35:00.561095] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-09-14T18:35:00.561816] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-09-14T18:35:00.562842] [DEBUG] [LOCAL ] INGR: Trimmed 36752 records to 24281 (keeping 150 days of data) [2025-09-14T18:35:00.726399] [DEBUG] [LOCAL ] INGR: Primary data saved (24281 records). [2025-09-14T18:35:00.726574] [INFO ] [MAIN ] INGR: Full history saved. [2025-09-14T18:35:00.726695] [INFO ] [MAIN ] Update Progress: 1112/2370 symbols completed. INGR took 22.8s. Estimated remaining: 2h 13m 17s. Rate: 9.4 symbols/min [2025-09-14T18:35:00.896375] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:35:00.913855] [DEBUG] [LOCAL ] INSW: Loaded 17408 existing records from primary storage. [2025-09-14T18:35:00.914018] [INFO ] [MAIN ] INSW: Loaded 17408 existing records. [2025-09-14T18:35:01.095459] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:35:01.095821] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-09-14T18:35:01.095890] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-09-14T18:35:01.096521] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-09-14T18:35:01.096583] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-09-14T18:35:01.363915] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-09-14T18:35:01.473859] [INFO ] [REMOTE ] INSW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:35:02.136321] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T18:35:02.158785] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-09-14T18:35:02.860505] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T18:35:02.958863] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-09-14T18:35:03.758927] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-09-14T18:35:03.989731] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-14T18:35:04.558847] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-09-14T18:35:04.933277] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-14T18:35:05.358878] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-09-14T18:35:05.869146] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-14T18:35:06.163981] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-09-14T18:35:06.176729] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T18:35:06.183237] [INFO ] [REMOTE ] INSP: Full fetch complete (39610 records). [2025-09-14T18:35:06.183391] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-09-14T18:35:06.569239] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-09-14T18:35:06.569436] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-09-14T18:35:06.570438] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-09-14T18:35:06.570618] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-09-14T18:35:06.596075] [DEBUG] [LOCAL ] INSP: Trimmed 39610 records to 28161 (keeping 150 days of data) [2025-09-14T18:35:06.597271] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-14T18:35:06.788274] [DEBUG] [LOCAL ] INSP: Primary data saved (28161 records). [2025-09-14T18:35:06.788471] [INFO ] [MAIN ] INSP: Full history saved. [2025-09-14T18:35:06.788601] [INFO ] [MAIN ] Update Progress: 1113/2370 symbols completed. INSP took 15.9s. Estimated remaining: 2h 13m 10s. Rate: 9.4 symbols/min [2025-09-14T18:35:06.957694] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:35:06.958813] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-09-14T18:35:06.982288] [DEBUG] [LOCAL ] INVH: Loaded 23770 existing records from primary storage. [2025-09-14T18:35:06.982456] [INFO ] [MAIN ] INVH: Loaded 23770 existing records. [2025-09-14T18:35:07.159555] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:35:07.159829] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-09-14T18:35:07.159911] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-09-14T18:35:07.160842] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-09-14T18:35:07.160916] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-09-14T18:35:07.514436] [INFO ] [REMOTE ] INVH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:35:07.549938] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T18:35:07.758990] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-09-14T18:35:08.558840] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-09-14T18:35:08.801118] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T18:35:09.358830] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-09-14T18:35:09.404564] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-14T18:35:09.894780] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T18:35:10.158829] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-09-14T18:35:10.958798] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-09-14T18:35:11.060748] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T18:35:11.758894] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-09-14T18:35:11.959511] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T18:35:12.310062] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T18:35:12.558871] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-09-14T18:35:13.358797] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-09-14T18:35:13.612333] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-14T18:35:13.709823] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-14T18:35:14.158792] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-09-14T18:35:14.427688] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-14T18:35:14.430726] [INFO ] [REMOTE ] INR: Full fetch complete (29891 records). [2025-09-14T18:35:14.430830] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-09-14T18:35:14.800505] [DEBUG] [VALIDATOR ] INR: All expected trading days are present. [2025-09-14T18:35:14.800623] [DEBUG] [VALIDATOR ] INR: Primary data validation passed. [2025-09-14T18:35:14.801244] [INFO ] [MAIN ] INR: Fetched primary data is valid. [2025-09-14T18:35:14.801300] [DEBUG] [LOCAL ] INR: Saving primary data. [2025-09-14T18:35:14.802103] [DEBUG] [LOCAL ] INR: Trimmed 29891 records to 19412 (keeping 150 days of data) [2025-09-14T18:35:14.926985] [DEBUG] [LOCAL ] INR: Primary data saved (19412 records). [2025-09-14T18:35:14.927241] [INFO ] [MAIN ] INR: Full history saved. [2025-09-14T18:35:14.927403] [INFO ] [MAIN ] Update Progress: 1114/2370 symbols completed. INR took 28.9s. Estimated remaining: 2h 13m 6s. Rate: 9.4 symbols/min [2025-09-14T18:35:14.963949] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-09-14T18:35:15.105059] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:35:15.117800] [DEBUG] [LOCAL ] INVX: Loaded 12520 existing records from primary storage. [2025-09-14T18:35:15.117945] [INFO ] [MAIN ] INVX: Loaded 12520 existing records. [2025-09-14T18:35:15.294331] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:35:15.294579] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-09-14T18:35:15.294639] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-09-14T18:35:15.295104] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-09-14T18:35:15.295166] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-09-14T18:35:15.649625] [INFO ] [REMOTE ] INVX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:35:15.758851] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-09-14T18:35:16.072344] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-14T18:35:16.558885] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-09-14T18:35:16.624453] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T18:35:17.183943] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T18:35:17.358859] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-09-14T18:35:18.158816] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-09-14T18:35:18.647688] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-14T18:35:18.860392] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-14T18:35:18.958795] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-09-14T18:35:19.421370] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-14T18:35:19.631334] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:35:19.635439] [INFO ] [REMOTE ] INN: Full fetch complete (45095 records). [2025-09-14T18:35:19.635607] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-09-14T18:35:19.763974] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-09-14T18:35:20.043746] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-09-14T18:35:20.043864] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-09-14T18:35:20.044796] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-09-14T18:35:20.044873] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-09-14T18:35:20.046077] [DEBUG] [LOCAL ] INN: Trimmed 45095 records to 31920 (keeping 150 days of data) [2025-09-14T18:35:20.251874] [DEBUG] [LOCAL ] INN: Primary data saved (31920 records). [2025-09-14T18:35:20.252088] [INFO ] [MAIN ] INN: Full history saved. [2025-09-14T18:35:20.252295] [INFO ] [MAIN ] Update Progress: 1115/2370 symbols completed. INN took 36.4s. Estimated remaining: 2h 12m 59s. Rate: 9.4 symbols/min [2025-09-14T18:35:20.422237] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:35:20.446112] [DEBUG] [LOCAL ] IONQ: Loaded 24180 existing records from primary storage. [2025-09-14T18:35:20.446294] [INFO ] [MAIN ] IONQ: Loaded 24180 existing records. [2025-09-14T18:35:20.563912] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-09-14T18:35:20.624529] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:35:20.624801] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-09-14T18:35:20.624876] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-09-14T18:35:20.625622] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-09-14T18:35:20.625739] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-09-14T18:35:21.084330] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:35:21.358924] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-09-14T18:35:21.754380] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-14T18:35:22.158947] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-09-14T18:35:22.225150] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T18:35:22.958844] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-09-14T18:35:23.758833] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-09-14T18:35:23.862447] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-14T18:35:24.023565] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-14T18:35:24.090401] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.73 seconds). [2025-09-14T18:35:24.558829] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-09-14T18:35:25.354163] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-14T18:35:25.363010] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-09-14T18:35:26.158813] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-09-14T18:35:26.614031] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-14T18:35:26.958855] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-09-14T18:35:27.758424] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-14T18:35:27.766618] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-09-14T18:35:28.174273] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.81 seconds). [2025-09-14T18:35:28.558798] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-09-14T18:35:28.590326] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T18:35:29.111557] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-14T18:35:29.358820] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-09-14T18:35:30.158889] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-09-14T18:35:30.772622] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-14T18:35:30.906087] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T18:35:30.911588] [INFO ] [REMOTE ] INVH: Full fetch complete (57695 records). [2025-09-14T18:35:30.911740] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-09-14T18:35:30.966212] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-09-14T18:35:31.303238] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-09-14T18:35:31.303352] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-09-14T18:35:31.304201] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-09-14T18:35:31.304258] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-09-14T18:35:31.305588] [DEBUG] [LOCAL ] INVH: Trimmed 57695 records to 39992 (keeping 150 days of data) [2025-09-14T18:35:31.429255] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.87 seconds). [2025-09-14T18:35:31.593213] [DEBUG] [LOCAL ] INVH: Primary data saved (39992 records). [2025-09-14T18:35:31.593409] [INFO ] [MAIN ] INVH: Full history saved. [2025-09-14T18:35:31.593542] [INFO ] [MAIN ] Update Progress: 1116/2370 symbols completed. INVH took 24.8s. Estimated remaining: 2h 12m 58s. Rate: 9.4 symbols/min [2025-09-14T18:35:31.772093] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:35:31.768168] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-09-14T18:35:31.796998] [DEBUG] [LOCAL ] IOT: Loaded 24018 existing records from primary storage. [2025-09-14T18:35:31.797218] [INFO ] [MAIN ] IOT: Loaded 24018 existing records. [2025-09-14T18:35:31.972608] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:35:31.972880] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-09-14T18:35:31.972941] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-09-14T18:35:31.973600] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-09-14T18:35:31.973689] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-09-14T18:35:32.324106] [INFO ] [REMOTE ] IOT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:35:32.340896] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T18:35:32.558818] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-09-14T18:35:33.133392] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-14T18:35:33.137581] [INFO ] [REMOTE ] INVX: Full fetch complete (32011 records). [2025-09-14T18:35:33.137924] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-09-14T18:35:33.363979] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-09-14T18:35:33.546274] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-09-14T18:35:33.546399] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-09-14T18:35:33.547242] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-09-14T18:35:33.547309] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-09-14T18:35:33.548487] [DEBUG] [LOCAL ] INVX: Trimmed 32011 records to 21811 (keeping 150 days of data) [2025-09-14T18:35:33.682595] [DEBUG] [LOCAL ] INVX: Primary data saved (21811 records). [2025-09-14T18:35:33.682787] [INFO ] [MAIN ] INVX: Full history saved. [2025-09-14T18:35:33.682934] [INFO ] [MAIN ] Update Progress: 1117/2370 symbols completed. INVX took 18.8s. Estimated remaining: 2h 12m 47s. Rate: 9.4 symbols/min [2025-09-14T18:35:34.158873] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-09-14T18:35:34.606577] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-09-14T18:35:34.630308] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T18:35:34.634521] [INFO ] [REMOTE ] INSW: Full fetch complete (44624 records). [2025-09-14T18:35:34.634687] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-09-14T18:35:34.963943] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-09-14T18:35:35.011991] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-09-14T18:35:35.012118] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-09-14T18:35:35.012878] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-09-14T18:35:35.012945] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-09-14T18:35:35.013914] [DEBUG] [LOCAL ] INSW: Trimmed 44624 records to 29866 (keeping 150 days of data) [2025-09-14T18:35:35.223183] [DEBUG] [LOCAL ] INSW: Primary data saved (29866 records). [2025-09-14T18:35:35.223374] [INFO ] [MAIN ] INSW: Full history saved. [2025-09-14T18:35:35.223494] [INFO ] [MAIN ] Update Progress: 1118/2370 symbols completed. INSW took 34.5s. Estimated remaining: 2h 12m 35s. Rate: 9.4 symbols/min [2025-09-14T18:35:35.395343] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-14T18:35:35.758843] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-09-14T18:35:37.579198] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T18:35:37.591191] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-09-14T18:35:37.803531] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.84 seconds). [2025-09-14T18:35:37.814862] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-09-14T18:35:39.566955] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T18:35:39.578709] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-09-14T18:35:39.910315] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-14T18:35:39.922937] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-09-14T18:35:41.354013] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T18:35:41.365590] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-09-14T18:35:42.826795] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.90 seconds). [2025-09-14T18:35:42.839136] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-09-14T18:35:42.915618] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T18:35:42.926894] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-09-14T18:35:44.789943] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T18:35:44.801940] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-09-14T18:35:45.331449] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-14T18:35:45.337335] [INFO ] [REMOTE ] IONQ: Full fetch complete (58468 records). [2025-09-14T18:35:45.337576] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-09-14T18:35:45.729610] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-09-14T18:35:45.729757] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-09-14T18:35:45.730717] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-09-14T18:35:45.730781] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-09-14T18:35:45.735426] [DEBUG] [LOCAL ] IONQ: Trimmed 58468 records to 40528 (keeping 150 days of data) [2025-09-14T18:35:46.006963] [DEBUG] [LOCAL ] IONQ: Primary data saved (40528 records). [2025-09-14T18:35:46.007130] [INFO ] [MAIN ] IONQ: Full history saved. [2025-09-14T18:35:46.007251] [INFO ] [MAIN ] Update Progress: 1119/2370 symbols completed. IONQ took 25.8s. Estimated remaining: 2h 12m 34s. Rate: 9.4 symbols/min [2025-09-14T18:35:46.924421] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-14T18:35:46.936395] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-09-14T18:35:48.759442] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-14T18:35:48.764888] [INFO ] [REMOTE ] IOT: Full fetch complete (58129 records). [2025-09-14T18:35:48.765008] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-09-14T18:35:49.159103] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-09-14T18:35:49.159296] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-09-14T18:35:49.160308] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-09-14T18:35:49.160443] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-09-14T18:35:49.164517] [DEBUG] [LOCAL ] IOT: Trimmed 58129 records to 40234 (keeping 150 days of data) [2025-09-14T18:35:49.437757] [DEBUG] [LOCAL ] IOT: Primary data saved (40234 records). [2025-09-14T18:35:49.437978] [INFO ] [MAIN ] IOT: Full history saved. [2025-09-14T18:35:49.438223] [INFO ] [MAIN ] Update Progress: 1120/2370 symbols completed. IOT took 17.8s. Estimated remaining: 2h 12m 24s. Rate: 9.4 symbols/min [2025-09-14T18:35:50.028893] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:35:50.074224] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:35:50.163058] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:35:50.183486] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:35:50.190112] [DEBUG] [LOCAL ] IPI: Loaded 8688 existing records from primary storage. [2025-09-14T18:35:50.190427] [INFO ] [MAIN ] IPI: Loaded 8688 existing records. [2025-09-14T18:35:50.326466] [DEBUG] [LOCAL ] IQI: Loaded 8665 existing records from primary storage. [2025-09-14T18:35:50.330928] [DEBUG] [LOCAL ] IPG: Loaded 23811 existing records from primary storage. [2025-09-14T18:35:50.337391] [INFO ] [MAIN ] IQI: Loaded 8665 existing records. [2025-09-14T18:35:50.342846] [INFO ] [MAIN ] IPG: Loaded 23811 existing records. [2025-09-14T18:35:50.540330] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:35:50.565811] [DEBUG] [LOCAL ] IP: Loaded 23828 existing records from primary storage. [2025-09-14T18:35:50.581687] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-09-14T18:35:50.632795] [INFO ] [MAIN ] IP: Loaded 23828 existing records. [2025-09-14T18:35:50.632681] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-09-14T18:35:50.674836] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-09-14T18:35:50.704290] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-09-14T18:35:50.896378] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:35:50.906764] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:35:50.956983] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-09-14T18:35:50.988991] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-09-14T18:35:51.007523] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-09-14T18:35:51.007859] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-09-14T18:35:51.013252] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-09-14T18:35:51.013175] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-09-14T18:35:51.122785] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-09-14T18:35:51.175855] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-09-14T18:35:51.181119] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:35:51.249950] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-09-14T18:35:51.341176] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-09-14T18:35:51.359990] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-09-14T18:35:51.395393] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-09-14T18:35:51.997530] [INFO ] [REMOTE ] IPI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:35:52.062353] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-09-14T18:35:52.407856] [INFO ] [REMOTE ] IPG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:35:52.462380] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-09-14T18:35:52.500387] [INFO ] [REMOTE ] IQI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:35:52.528266] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-09-14T18:35:52.557457] [INFO ] [REMOTE ] IP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:35:52.558463] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-09-14T18:35:53.451942] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T18:35:53.462220] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-09-14T18:35:53.495365] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T18:35:53.499582] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-09-14T18:35:54.028163] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-14T18:35:54.033191] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-09-14T18:35:54.450382] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-14T18:35:54.463573] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-09-14T18:35:54.568446] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-14T18:35:54.582951] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-09-14T18:35:54.626687] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-14T18:35:54.632121] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-09-14T18:35:55.044774] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-14T18:35:55.048936] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-09-14T18:35:55.364453] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-14T18:35:55.376233] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-09-14T18:35:55.520614] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-14T18:35:55.526169] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-09-14T18:35:55.812985] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-14T18:35:55.824494] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-09-14T18:35:56.254616] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-14T18:35:56.260749] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-09-14T18:35:56.527198] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-14T18:35:56.539519] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-09-14T18:35:56.565982] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-14T18:35:56.572185] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-09-14T18:35:56.640520] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T18:35:57.100781] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-14T18:35:57.358852] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-09-14T18:35:57.396181] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T18:35:58.158851] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-09-14T18:35:58.401053] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-14T18:35:58.457776] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T18:35:58.958862] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-09-14T18:35:59.271439] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T18:35:59.758890] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-09-14T18:36:00.558881] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-09-14T18:36:00.762042] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-14T18:36:00.849774] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-14T18:36:01.358858] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-09-14T18:36:01.892039] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-14T18:36:02.158876] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-09-14T18:36:02.958865] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-09-14T18:36:03.758884] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-09-14T18:36:12.574375] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (8.82 seconds). [2025-09-14T18:36:12.579683] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-09-14T18:36:13.026535] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (11.67 seconds). [2025-09-14T18:36:13.037814] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-09-14T18:36:13.108912] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (10.15 seconds). [2025-09-14T18:36:13.121009] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-09-14T18:36:13.274618] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (11.12 seconds). [2025-09-14T18:36:13.280116] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-09-14T18:36:14.151921] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-14T18:36:14.159223] [INFO ] [REMOTE ] IP: Full fetch complete (58005 records). [2025-09-14T18:36:14.159502] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-09-14T18:36:14.729098] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-09-14T18:36:14.736088] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-09-14T18:36:14.738252] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-09-14T18:36:14.737105] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-14T18:36:14.738536] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-09-14T18:36:14.742050] [INFO ] [REMOTE ] IPI: Full fetch complete (22843 records). [2025-09-14T18:36:14.742207] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-09-14T18:36:14.825294] [DEBUG] [LOCAL ] IP: Trimmed 58005 records to 40086 (keeping 150 days of data) [2025-09-14T18:36:15.221137] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-09-14T18:36:15.228845] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-09-14T18:36:15.229082] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-09-14T18:36:15.233531] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-09-14T18:36:15.234084] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-09-14T18:36:15.234807] [INFO ] [REMOTE ] IQI: Full fetch complete (20187 records). [2025-09-14T18:36:15.238530] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-09-14T18:36:15.241124] [DEBUG] [LOCAL ] IPI: Trimmed 22843 records to 15746 (keeping 150 days of data) [2025-09-14T18:36:15.709229] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-09-14T18:36:15.798763] [DEBUG] [LOCAL ] IPI: Primary data saved (15746 records). [2025-09-14T18:36:15.818606] [INFO ] [MAIN ] IPI: Full history saved. [2025-09-14T18:36:15.819330] [INFO ] [MAIN ] Update Progress: 1121/2370 symbols completed. IPI took 26.4s. Estimated remaining: 2h 12m 40s. Rate: 9.4 symbols/min [2025-09-14T18:36:15.819160] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-09-14T18:36:16.007206] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-09-14T18:36:16.018302] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-09-14T18:36:16.030720] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-09-14T18:36:16.044781] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-09-14T18:36:16.092380] [DEBUG] [LOCAL ] IQI: Trimmed 20187 records to 13766 (keeping 150 days of data) [2025-09-14T18:36:16.167150] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:36:16.255189] [DEBUG] [LOCAL ] IP: Primary data saved (40086 records). [2025-09-14T18:36:16.256737] [INFO ] [MAIN ] IP: Full history saved. [2025-09-14T18:36:16.258557] [INFO ] [MAIN ] Update Progress: 1122/2370 symbols completed. IP took 26.8s. Estimated remaining: 2h 12m 27s. Rate: 9.4 symbols/min [2025-09-14T18:36:16.273478] [DEBUG] [LOCAL ] IQV: Loaded 22064 existing records from primary storage. [2025-09-14T18:36:16.297012] [INFO ] [MAIN ] IQV: Loaded 22064 existing records. [2025-09-14T18:36:16.606137] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:36:16.661171] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:36:16.662707] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-09-14T18:36:16.663081] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-09-14T18:36:16.664879] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-09-14T18:36:16.665469] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-09-14T18:36:16.698924] [DEBUG] [LOCAL ] IQI: Primary data saved (13766 records). [2025-09-14T18:36:16.731344] [INFO ] [MAIN ] IQI: Full history saved. [2025-09-14T18:36:16.759596] [INFO ] [MAIN ] Update Progress: 1123/2370 symbols completed. IQI took 27.3s. Estimated remaining: 2h 12m 14s. Rate: 9.4 symbols/min [2025-09-14T18:36:16.963491] [DEBUG] [LOCAL ] IR: Loaded 23456 existing records from primary storage. [2025-09-14T18:36:16.993200] [INFO ] [MAIN ] IR: Loaded 23456 existing records. [2025-09-14T18:36:17.271983] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:36:17.383966] [INFO ] [REMOTE ] IQV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:36:17.389865] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-09-14T18:36:17.433360] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:36:17.433715] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-09-14T18:36:17.433787] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-09-14T18:36:17.434588] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-09-14T18:36:17.434685] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-09-14T18:36:17.612614] [DEBUG] [LOCAL ] IRM: Loaded 21556 existing records from primary storage. [2025-09-14T18:36:17.637548] [INFO ] [MAIN ] IRM: Loaded 21556 existing records. [2025-09-14T18:36:17.997057] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:36:18.000958] [INFO ] [REMOTE ] IR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:36:18.001813] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-09-14T18:36:18.001943] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-09-14T18:36:18.001704] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-09-14T18:36:18.003056] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-09-14T18:36:18.003313] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-09-14T18:36:18.362280] [INFO ] [REMOTE ] IRM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:36:18.362681] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-09-14T18:36:19.081016] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (3.26 seconds). [2025-09-14T18:36:19.092681] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-09-14T18:36:19.959539] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T18:36:19.981921] [INFO ] [REMOTE ] IPG: Full fetch complete (58004 records). [2025-09-14T18:36:19.995738] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-09-14T18:36:20.005286] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-09-14T18:36:20.090368] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-09-14T18:36:20.395825] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-09-14T18:36:20.396262] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-09-14T18:36:20.397608] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-09-14T18:36:20.397753] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-09-14T18:36:20.425841] [DEBUG] [LOCAL ] IPG: Trimmed 58004 records to 40092 (keeping 150 days of data) [2025-09-14T18:36:20.428150] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-14T18:36:20.439126] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-09-14T18:36:20.719422] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-14T18:36:20.741353] [DEBUG] [LOCAL ] IPG: Primary data saved (40092 records). [2025-09-14T18:36:20.751667] [INFO ] [MAIN ] IPG: Full history saved. [2025-09-14T18:36:20.751805] [INFO ] [MAIN ] Update Progress: 1124/2370 symbols completed. IPG took 31.3s. Estimated remaining: 2h 12m 5s. Rate: 9.4 symbols/min [2025-09-14T18:36:20.751589] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-09-14T18:36:20.921241] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:36:20.933731] [DEBUG] [LOCAL ] IRS: Loaded 10380 existing records from primary storage. [2025-09-14T18:36:20.933890] [INFO ] [MAIN ] IRS: Loaded 10380 existing records. [2025-09-14T18:36:21.106623] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:36:21.106912] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-09-14T18:36:21.106971] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-09-14T18:36:21.107376] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-09-14T18:36:21.107434] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-09-14T18:36:21.453175] [INFO ] [REMOTE ] IRS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:36:21.453517] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-09-14T18:36:22.073409] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-14T18:36:22.084487] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-09-14T18:36:22.573602] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-14T18:36:22.585286] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-09-14T18:36:22.619217] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-14T18:36:22.630796] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-09-14T18:36:22.878485] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-14T18:36:22.883055] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-09-14T18:36:23.854654] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T18:36:23.875753] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-09-14T18:36:23.877603] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-14T18:36:23.882318] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-09-14T18:36:24.245035] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-14T18:36:24.256014] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-09-14T18:36:24.597800] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-14T18:36:24.609546] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-09-14T18:36:24.634505] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-14T18:36:24.639241] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-09-14T18:36:25.797822] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-14T18:36:25.816952] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-09-14T18:36:25.830951] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-14T18:36:25.836277] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-09-14T18:36:25.872920] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-14T18:36:25.884299] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-09-14T18:36:26.919510] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-14T18:36:26.930916] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-09-14T18:36:27.342359] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T18:36:27.347448] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-09-14T18:36:27.894569] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-14T18:36:27.905319] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-09-14T18:36:28.164332] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-14T18:36:28.175164] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-09-14T18:36:28.992837] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-14T18:36:28.998081] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-09-14T18:36:29.295397] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-14T18:36:29.306381] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-09-14T18:36:29.709192] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T18:36:29.720880] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-09-14T18:36:29.761580] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T18:36:29.990590] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T18:36:30.158838] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-09-14T18:36:30.958805] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-09-14T18:36:31.200583] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-14T18:36:31.367248] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-14T18:36:31.666869] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-14T18:36:31.722587] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:36:31.726268] [INFO ] [REMOTE ] IRS: Full fetch complete (22865 records). [2025-09-14T18:36:31.726360] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-09-14T18:36:31.763998] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-09-14T18:36:32.088446] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-09-14T18:36:32.088558] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-09-14T18:36:32.089174] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-09-14T18:36:32.089256] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-09-14T18:36:32.089979] [DEBUG] [LOCAL ] IRS: Trimmed 22865 records to 16383 (keeping 150 days of data) [2025-09-14T18:36:32.190381] [DEBUG] [LOCAL ] IRS: Primary data saved (16383 records). [2025-09-14T18:36:32.191030] [INFO ] [MAIN ] IRS: Full history saved. [2025-09-14T18:36:32.191133] [INFO ] [MAIN ] Update Progress: 1125/2370 symbols completed. IRS took 11.4s. Estimated remaining: 2h 12m 4s. Rate: 9.4 symbols/min [2025-09-14T18:36:32.370585] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:36:32.396750] [DEBUG] [LOCAL ] IRT: Loaded 22787 existing records from primary storage. [2025-09-14T18:36:32.396955] [INFO ] [MAIN ] IRT: Loaded 22787 existing records. [2025-09-14T18:36:32.582670] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:36:32.578104] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-09-14T18:36:32.583121] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-09-14T18:36:32.584015] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-09-14T18:36:32.584686] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-09-14T18:36:32.584859] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-09-14T18:36:32.663274] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-14T18:36:32.704856] [INFO ] [REMOTE ] IQV: Full fetch complete (54933 records). [2025-09-14T18:36:32.730753] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-09-14T18:36:33.162144] [INFO ] [REMOTE ] IRT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:36:33.351741] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-09-14T18:36:33.351878] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-09-14T18:36:33.352691] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-09-14T18:36:33.352750] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-09-14T18:36:33.354041] [DEBUG] [LOCAL ] IQV: Trimmed 54933 records to 37989 (keeping 150 days of data) [2025-09-14T18:36:33.358854] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-09-14T18:36:33.602174] [DEBUG] [LOCAL ] IQV: Primary data saved (37989 records). [2025-09-14T18:36:33.602376] [INFO ] [MAIN ] IQV: Full history saved. [2025-09-14T18:36:33.602484] [INFO ] [MAIN ] Update Progress: 1126/2370 symbols completed. IQV took 17.8s. Estimated remaining: 2h 11m 52s. Rate: 9.4 symbols/min [2025-09-14T18:36:33.790954] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:36:33.800382] [DEBUG] [LOCAL ] ISD: Loaded 6734 existing records from primary storage. [2025-09-14T18:36:33.800557] [INFO ] [MAIN ] ISD: Loaded 6734 existing records. [2025-09-14T18:36:33.987892] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:36:33.988192] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-09-14T18:36:33.988263] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-09-14T18:36:33.988717] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-09-14T18:36:33.988785] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-09-14T18:36:34.166608] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-09-14T18:36:34.360689] [INFO ] [REMOTE ] ISD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:36:34.421675] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T18:36:34.964171] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-09-14T18:36:34.972736] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T18:36:34.978226] [INFO ] [REMOTE ] IRM: Full fetch complete (54086 records). [2025-09-14T18:36:34.978341] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-09-14T18:36:35.358327] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-09-14T18:36:35.358506] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-09-14T18:36:35.359393] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-09-14T18:36:35.359513] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-09-14T18:36:35.384197] [DEBUG] [LOCAL ] IRM: Trimmed 54086 records to 36689 (keeping 150 days of data) [2025-09-14T18:36:35.385716] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-14T18:36:35.640953] [DEBUG] [LOCAL ] IRM: Primary data saved (36689 records). [2025-09-14T18:36:35.641135] [INFO ] [MAIN ] IRM: Full history saved. [2025-09-14T18:36:35.641237] [INFO ] [MAIN ] Update Progress: 1127/2370 symbols completed. IRM took 18.9s. Estimated remaining: 2h 11m 41s. Rate: 9.4 symbols/min [2025-09-14T18:36:35.763615] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-09-14T18:36:35.815484] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:36:35.831286] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T18:36:35.837420] [INFO ] [REMOTE ] IR: Full fetch complete (57334 records). [2025-09-14T18:36:35.837555] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-09-14T18:36:35.972786] [DEBUG] [LOCAL ] IT: Loaded 19899 existing records from primary storage. [2025-09-14T18:36:36.002294] [INFO ] [MAIN ] IT: Loaded 19899 existing records. [2025-09-14T18:36:36.408381] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:36:36.425948] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-09-14T18:36:36.426207] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-09-14T18:36:36.426287] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-09-14T18:36:36.426425] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-09-14T18:36:36.427271] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-09-14T18:36:36.427469] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-09-14T18:36:36.428108] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-09-14T18:36:36.428337] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-09-14T18:36:36.471156] [DEBUG] [LOCAL ] IR: Trimmed 57334 records to 39643 (keeping 150 days of data) [2025-09-14T18:36:36.586858] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-09-14T18:36:36.906563] [INFO ] [REMOTE ] IT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:36:37.032510] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-14T18:36:37.080243] [DEBUG] [LOCAL ] IR: Primary data saved (39643 records). [2025-09-14T18:36:37.080427] [INFO ] [MAIN ] IR: Full history saved. [2025-09-14T18:36:37.080533] [INFO ] [MAIN ] Update Progress: 1128/2370 symbols completed. IR took 20.8s. Estimated remaining: 2h 11m 30s. Rate: 9.4 symbols/min [2025-09-14T18:36:37.262571] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:36:37.276893] [DEBUG] [LOCAL ] ITGR: Loaded 12464 existing records from primary storage. [2025-09-14T18:36:37.277076] [INFO ] [MAIN ] ITGR: Loaded 12464 existing records. [2025-09-14T18:36:37.364079] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-09-14T18:36:37.466900] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:36:37.467219] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-09-14T18:36:37.467300] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-09-14T18:36:37.467870] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-09-14T18:36:37.467958] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-09-14T18:36:37.837746] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:36:38.158836] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-09-14T18:36:38.468826] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-14T18:36:38.740092] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-14T18:36:38.958875] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-09-14T18:36:39.275134] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-14T18:36:39.758836] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-09-14T18:36:40.205183] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-14T18:36:40.558954] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-09-14T18:36:40.927316] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T18:36:41.358882] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-09-14T18:36:41.990162] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T18:36:42.158848] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-09-14T18:36:42.958834] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-09-14T18:36:43.239239] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T18:36:43.758885] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-09-14T18:36:43.967952] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T18:36:44.018176] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-14T18:36:44.558821] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-09-14T18:36:45.358879] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-09-14T18:36:45.418840] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T18:36:46.146752] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-14T18:36:46.158768] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-09-14T18:36:46.435911] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-14T18:36:46.958854] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-09-14T18:36:47.725723] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T18:36:47.758791] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-09-14T18:36:48.483205] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-14T18:36:48.558828] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-09-14T18:36:49.358851] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-09-14T18:36:49.494479] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T18:36:50.019849] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-14T18:36:50.078408] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-14T18:36:50.158825] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-09-14T18:36:50.958850] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-09-14T18:36:51.758898] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-09-14T18:36:51.927932] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T18:36:52.558886] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-09-14T18:36:52.686175] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-14T18:36:52.833489] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-14T18:36:53.217464] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:36:53.222429] [INFO ] [REMOTE ] IT: Full fetch complete (43617 records). [2025-09-14T18:36:53.222565] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-09-14T18:36:53.363982] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-09-14T18:36:53.607664] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-09-14T18:36:53.607791] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-09-14T18:36:53.609088] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-09-14T18:36:53.609182] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-09-14T18:36:53.610507] [DEBUG] [LOCAL ] IT: Trimmed 43617 records to 31043 (keeping 150 days of data) [2025-09-14T18:36:53.813762] [DEBUG] [LOCAL ] IT: Primary data saved (31043 records). [2025-09-14T18:36:53.813976] [INFO ] [MAIN ] IT: Full history saved. [2025-09-14T18:36:53.814091] [INFO ] [MAIN ] Update Progress: 1129/2370 symbols completed. IT took 18.2s. Estimated remaining: 2h 11m 35s. Rate: 9.4 symbols/min [2025-09-14T18:36:53.999037] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:36:54.014361] [DEBUG] [LOCAL ] ITT: Loaded 12496 existing records from primary storage. [2025-09-14T18:36:54.014534] [INFO ] [MAIN ] ITT: Loaded 12496 existing records. [2025-09-14T18:36:54.166293] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-09-14T18:36:54.194284] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:36:54.194466] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-09-14T18:36:54.194526] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-09-14T18:36:54.195019] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-09-14T18:36:54.195082] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-09-14T18:36:54.552703] [INFO ] [REMOTE ] ITT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:36:54.750698] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T18:36:54.958793] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-09-14T18:36:55.251850] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T18:36:55.758850] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-09-14T18:36:56.558858] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-09-14T18:36:56.653909] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T18:36:57.196565] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T18:36:57.358816] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-09-14T18:36:58.056690] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-14T18:36:58.158836] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-09-14T18:36:58.928897] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-14T18:36:58.941949] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-14T18:36:58.943839] [INFO ] [REMOTE ] ISD: Full fetch complete (17298 records). [2025-09-14T18:36:58.943926] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-09-14T18:36:58.965317] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-09-14T18:36:59.351170] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-09-14T18:36:59.351302] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-09-14T18:36:59.351785] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-09-14T18:36:59.351846] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-09-14T18:36:59.352587] [DEBUG] [LOCAL ] ISD: Trimmed 17298 records to 11353 (keeping 150 days of data) [2025-09-14T18:36:59.431203] [DEBUG] [LOCAL ] ISD: Primary data saved (11353 records). [2025-09-14T18:36:59.431389] [INFO ] [MAIN ] ISD: Full history saved. [2025-09-14T18:36:59.431506] [INFO ] [MAIN ] Update Progress: 1130/2370 symbols completed. ISD took 25.8s. Estimated remaining: 2h 11m 27s. Rate: 9.4 symbols/min [2025-09-14T18:36:59.606618] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:36:59.629818] [DEBUG] [LOCAL ] ITUB: Loaded 23909 existing records from primary storage. [2025-09-14T18:36:59.629997] [INFO ] [MAIN ] ITUB: Loaded 23909 existing records. [2025-09-14T18:36:59.764055] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-09-14T18:36:59.820174] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:36:59.820509] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-09-14T18:36:59.820571] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-09-14T18:36:59.821383] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-09-14T18:36:59.821448] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-09-14T18:37:00.198416] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:37:00.271027] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-14T18:37:00.558885] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-09-14T18:37:01.358847] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-09-14T18:37:01.604841] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-14T18:37:01.608284] [INFO ] [REMOTE ] ITGR: Full fetch complete (33792 records). [2025-09-14T18:37:01.608427] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-09-14T18:37:02.011996] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-09-14T18:37:02.028077] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-09-14T18:37:02.041180] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-09-14T18:37:02.041452] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-09-14T18:37:02.043501] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-14T18:37:02.055190] [DEBUG] [LOCAL ] ITGR: Trimmed 33792 records to 22907 (keeping 150 days of data) [2025-09-14T18:37:02.159041] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-09-14T18:37:02.207705] [DEBUG] [LOCAL ] ITGR: Primary data saved (22907 records). [2025-09-14T18:37:02.207897] [INFO ] [MAIN ] ITGR: Full history saved. [2025-09-14T18:37:02.208019] [INFO ] [MAIN ] Update Progress: 1131/2370 symbols completed. ITGR took 25.1s. Estimated remaining: 2h 11m 17s. Rate: 9.4 symbols/min [2025-09-14T18:37:02.378963] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:37:02.398351] [DEBUG] [LOCAL ] ITW: Loaded 20232 existing records from primary storage. [2025-09-14T18:37:02.398537] [INFO ] [MAIN ] ITW: Loaded 20232 existing records. [2025-09-14T18:37:02.578779] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:37:02.579069] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-09-14T18:37:02.579138] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-09-14T18:37:02.579815] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-09-14T18:37:02.579880] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-09-14T18:37:02.933087] [INFO ] [REMOTE ] ITW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:37:02.946884] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-14T18:37:02.952198] [INFO ] [REMOTE ] IRT: Full fetch complete (54780 records). [2025-09-14T18:37:02.952362] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-09-14T18:37:02.964205] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-09-14T18:37:03.333729] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-09-14T18:37:03.333931] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-09-14T18:37:03.334869] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-09-14T18:37:03.334939] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-09-14T18:37:03.351898] [DEBUG] [LOCAL ] IRT: Trimmed 54780 records to 37875 (keeping 150 days of data) [2025-09-14T18:37:03.366719] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-14T18:37:03.619308] [DEBUG] [LOCAL ] IRT: Primary data saved (37875 records). [2025-09-14T18:37:03.619482] [INFO ] [MAIN ] IRT: Full history saved. [2025-09-14T18:37:03.619598] [INFO ] [MAIN ] Update Progress: 1132/2370 symbols completed. IRT took 31.4s. Estimated remaining: 2h 11m 5s. Rate: 9.4 symbols/min [2025-09-14T18:37:03.761831] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-09-14T18:37:03.791852] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:37:03.813262] [DEBUG] [LOCAL ] IVR: Loaded 21303 existing records from primary storage. [2025-09-14T18:37:03.813423] [INFO ] [MAIN ] IVR: Loaded 21303 existing records. [2025-09-14T18:37:03.991927] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:37:03.992224] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-09-14T18:37:03.992289] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-09-14T18:37:03.992917] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-09-14T18:37:03.992979] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-09-14T18:37:04.343326] [INFO ] [REMOTE ] IVR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:37:04.558835] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-09-14T18:37:05.219334] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-14T18:37:05.358914] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-09-14T18:37:05.470841] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-14T18:37:06.158912] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-09-14T18:37:06.612762] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-14T18:37:06.958917] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-09-14T18:37:07.242618] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T18:37:07.307773] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-14T18:37:07.758862] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-09-14T18:37:08.558844] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-09-14T18:37:08.770806] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T18:37:09.358948] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-09-14T18:37:09.687283] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T18:37:09.824060] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-14T18:37:10.158862] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-09-14T18:37:10.958817] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-09-14T18:37:11.176458] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-14T18:37:11.758808] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-09-14T18:37:12.095023] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T18:37:12.558865] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-09-14T18:37:13.063961] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-14T18:37:13.358842] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-09-14T18:37:13.954350] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-14T18:37:14.158840] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-09-14T18:37:14.223068] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T18:37:14.958794] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-09-14T18:37:15.042873] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T18:37:15.758854] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-09-14T18:37:16.080865] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-14T18:37:16.558835] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-09-14T18:37:16.708265] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T18:37:17.358880] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-09-14T18:37:17.527987] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-14T18:37:17.984074] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-14T18:37:18.158871] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-09-14T18:37:18.934928] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-14T18:37:18.938019] [INFO ] [REMOTE ] ITT: Full fetch complete (36525 records). [2025-09-14T18:37:18.938120] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-09-14T18:37:18.968962] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-09-14T18:37:19.339934] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-09-14T18:37:19.340114] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-09-14T18:37:19.341563] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-09-14T18:37:19.341776] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-09-14T18:37:19.343835] [DEBUG] [LOCAL ] ITT: Trimmed 36525 records to 24053 (keeping 150 days of data) [2025-09-14T18:37:19.444791] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-14T18:37:19.561035] [DEBUG] [LOCAL ] ITT: Primary data saved (24053 records). [2025-09-14T18:37:19.561267] [INFO ] [MAIN ] ITT: Full history saved. [2025-09-14T18:37:19.561410] [INFO ] [MAIN ] Update Progress: 1133/2370 symbols completed. ITT took 25.7s. Estimated remaining: 2h 11m 9s. Rate: 9.4 symbols/min [2025-09-14T18:37:19.743157] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:37:19.759476] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-09-14T18:37:19.761129] [DEBUG] [LOCAL ] IVT: Loaded 13702 existing records from primary storage. [2025-09-14T18:37:19.761329] [INFO ] [MAIN ] IVT: Loaded 13702 existing records. [2025-09-14T18:37:19.937209] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:37:19.937472] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-09-14T18:37:19.937531] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-09-14T18:37:19.938109] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-09-14T18:37:19.938172] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-09-14T18:37:20.286511] [INFO ] [REMOTE ] IVT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:37:20.558779] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-09-14T18:37:20.726881] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T18:37:21.358832] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-09-14T18:37:21.626503] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-14T18:37:22.156944] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-14T18:37:22.166328] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-09-14T18:37:22.778068] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-14T18:37:22.958844] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-09-14T18:37:23.677216] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T18:37:23.758842] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-09-14T18:37:24.112365] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-14T18:37:24.117026] [INFO ] [REMOTE ] ITW: Full fetch complete (50652 records). [2025-09-14T18:37:24.117154] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-09-14T18:37:24.433316] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-14T18:37:24.456151] [INFO ] [REMOTE ] IVR: Full fetch complete (51785 records). [2025-09-14T18:37:24.488577] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-09-14T18:37:24.564741] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-09-14T18:37:24.565709] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-09-14T18:37:24.565784] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-09-14T18:37:24.593821] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-09-14T18:37:24.621699] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-09-14T18:37:24.691592] [DEBUG] [LOCAL ] ITW: Trimmed 50652 records to 34479 (keeping 150 days of data) [2025-09-14T18:37:25.010958] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-09-14T18:37:25.011552] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-09-14T18:37:25.013556] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-09-14T18:37:25.013851] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-09-14T18:37:25.016930] [DEBUG] [LOCAL ] IVR: Trimmed 51785 records to 35633 (keeping 150 days of data) [2025-09-14T18:37:25.335845] [DEBUG] [LOCAL ] IVR: Primary data saved (35633 records). [2025-09-14T18:37:25.336031] [INFO ] [MAIN ] IVR: Full history saved. [2025-09-14T18:37:25.336155] [INFO ] [MAIN ] Update Progress: 1134/2370 symbols completed. IVR took 21.7s. Estimated remaining: 2h 11m 2s. Rate: 9.4 symbols/min [2025-09-14T18:37:25.367841] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-09-14T18:37:25.514931] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:37:25.523126] [DEBUG] [LOCAL ] ITW: Primary data saved (34479 records). [2025-09-14T18:37:25.523295] [INFO ] [MAIN ] ITW: Full history saved. [2025-09-14T18:37:25.523496] [INFO ] [MAIN ] Update Progress: 1135/2370 symbols completed. ITW took 23.3s. Estimated remaining: 2h 10m 49s. Rate: 9.4 symbols/min [2025-09-14T18:37:25.636976] [DEBUG] [LOCAL ] IVZ: Loaded 23728 existing records from primary storage. [2025-09-14T18:37:25.652617] [INFO ] [MAIN ] IVZ: Loaded 23728 existing records. [2025-09-14T18:37:25.785454] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:37:25.884894] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:37:25.888658] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-09-14T18:37:25.888743] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-09-14T18:37:25.888932] [DEBUG] [LOCAL ] IX: Loaded 8945 existing records from primary storage. [2025-09-14T18:37:25.889089] [INFO ] [MAIN ] IX: Loaded 8945 existing records. [2025-09-14T18:37:25.894981] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-09-14T18:37:25.950606] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-09-14T18:37:26.202927] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:37:26.226306] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-09-14T18:37:26.266341] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-09-14T18:37:26.310238] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-09-14T18:37:26.354265] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-09-14T18:37:26.537090] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:37:26.537759] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-09-14T18:37:26.794819] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-14T18:37:26.821867] [INFO ] [REMOTE ] IX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:37:26.872386] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T18:37:26.958800] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-09-14T18:37:27.758876] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-09-14T18:37:28.203998] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-14T18:37:28.319929] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T18:37:28.558825] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-09-14T18:37:28.588394] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T18:37:29.358844] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-09-14T18:37:30.158829] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-09-14T18:37:30.444430] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-14T18:37:30.958816] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-09-14T18:37:31.275699] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-14T18:37:31.320677] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T18:37:31.758839] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-09-14T18:37:32.558861] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-09-14T18:37:32.997692] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-14T18:37:33.019290] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-14T18:37:33.358850] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-09-14T18:37:34.158885] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-09-14T18:37:34.216248] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-14T18:37:34.222069] [INFO ] [REMOTE ] ITUB: Full fetch complete (57969 records). [2025-09-14T18:37:34.222197] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-09-14T18:37:34.624438] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-09-14T18:37:34.624567] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-09-14T18:37:34.625858] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-09-14T18:37:34.626092] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-09-14T18:37:34.630711] [DEBUG] [LOCAL ] ITUB: Trimmed 57969 records to 40153 (keeping 150 days of data) [2025-09-14T18:37:34.756298] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-14T18:37:34.929469] [DEBUG] [LOCAL ] ITUB: Primary data saved (40153 records). [2025-09-14T18:37:34.929665] [INFO ] [MAIN ] ITUB: Full history saved. [2025-09-14T18:37:34.929801] [INFO ] [MAIN ] Update Progress: 1136/2370 symbols completed. ITUB took 35.5s. Estimated remaining: 2h 10m 46s. Rate: 9.4 symbols/min [2025-09-14T18:37:34.963916] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-09-14T18:37:35.108151] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:37:35.129627] [DEBUG] [LOCAL ] J: Loaded 17340 existing records from primary storage. [2025-09-14T18:37:35.129875] [INFO ] [MAIN ] J: Loaded 17340 existing records. [2025-09-14T18:37:35.323144] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:37:35.323506] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-09-14T18:37:35.323713] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-09-14T18:37:35.324489] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-09-14T18:37:35.324566] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-09-14T18:37:35.612703] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-14T18:37:35.734313] [INFO ] [REMOTE ] J: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:37:35.758833] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-09-14T18:37:36.558819] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-09-14T18:37:36.638011] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-14T18:37:37.314917] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T18:37:37.358801] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-09-14T18:37:37.553047] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T18:37:38.158931] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-09-14T18:37:38.958838] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-09-14T18:37:39.061138] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T18:37:39.423594] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T18:37:39.758858] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-09-14T18:37:40.427517] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-14T18:37:40.558840] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-09-14T18:37:41.358817] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-09-14T18:37:41.424706] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T18:37:41.912560] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T18:37:42.158831] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-09-14T18:37:42.958806] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-09-14T18:37:42.998532] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T18:37:43.347166] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-14T18:37:43.350412] [INFO ] [REMOTE ] IVT: Full fetch complete (33844 records). [2025-09-14T18:37:43.350523] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-09-14T18:37:43.729443] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-09-14T18:37:43.729614] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-09-14T18:37:43.730438] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-09-14T18:37:43.730506] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-09-14T18:37:43.732442] [DEBUG] [LOCAL ] IVT: Trimmed 33844 records to 22821 (keeping 150 days of data) [2025-09-14T18:37:43.792781] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-09-14T18:37:43.882242] [DEBUG] [LOCAL ] IVT: Primary data saved (22821 records). [2025-09-14T18:37:43.882414] [INFO ] [MAIN ] IVT: Full history saved. [2025-09-14T18:37:43.882539] [INFO ] [MAIN ] Update Progress: 1137/2370 symbols completed. IVT took 24.3s. Estimated remaining: 2h 10m 43s. Rate: 9.4 symbols/min [2025-09-14T18:37:44.058088] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:37:44.078252] [DEBUG] [LOCAL ] JBGS: Loaded 18567 existing records from primary storage. [2025-09-14T18:37:44.078449] [INFO ] [MAIN ] JBGS: Loaded 18567 existing records. [2025-09-14T18:37:44.272040] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:37:44.272326] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-09-14T18:37:44.272404] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-09-14T18:37:44.273025] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-09-14T18:37:44.273093] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-09-14T18:37:44.567692] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-09-14T18:37:44.663488] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:37:44.719462] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-14T18:37:45.358870] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-09-14T18:37:45.918351] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T18:37:45.964205] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-14T18:37:46.158843] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-09-14T18:37:46.958919] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-09-14T18:37:47.074110] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-14T18:37:47.758866] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-09-14T18:37:48.028742] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T18:37:48.558844] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-09-14T18:37:48.726872] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T18:37:48.748480] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T18:37:49.227361] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:37:49.236376] [INFO ] [REMOTE ] IVZ: Full fetch complete (57723 records). [2025-09-14T18:37:49.236695] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-09-14T18:37:49.363893] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-09-14T18:37:49.653999] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-09-14T18:37:49.654112] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-09-14T18:37:49.655097] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-09-14T18:37:49.655179] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-09-14T18:37:49.656444] [DEBUG] [LOCAL ] IVZ: Trimmed 57723 records to 39955 (keeping 150 days of data) [2025-09-14T18:37:49.940288] [DEBUG] [LOCAL ] IVZ: Primary data saved (39955 records). [2025-09-14T18:37:49.940547] [INFO ] [MAIN ] IVZ: Full history saved. [2025-09-14T18:37:49.940792] [INFO ] [MAIN ] Update Progress: 1138/2370 symbols completed. IVZ took 24.6s. Estimated remaining: 2h 10m 36s. Rate: 9.4 symbols/min [2025-09-14T18:37:50.118430] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:37:50.127072] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:37:50.130422] [INFO ] [REMOTE ] IX: Full fetch complete (23694 records). [2025-09-14T18:37:50.130530] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-09-14T18:37:50.164091] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-09-14T18:37:50.254657] [DEBUG] [LOCAL ] JBI: Loaded 18248 existing records from primary storage. [2025-09-14T18:37:50.301296] [INFO ] [MAIN ] JBI: Loaded 18248 existing records. [2025-09-14T18:37:50.730088] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:37:50.736309] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-09-14T18:37:50.736715] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-09-14T18:37:50.736638] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-09-14T18:37:50.737396] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-09-14T18:37:50.737526] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-09-14T18:37:50.737592] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-09-14T18:37:50.738367] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-09-14T18:37:50.738541] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-09-14T18:37:50.770279] [DEBUG] [LOCAL ] IX: Trimmed 23694 records to 16716 (keeping 150 days of data) [2025-09-14T18:37:50.968800] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-09-14T18:37:51.185764] [INFO ] [REMOTE ] JBI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:37:51.208723] [DEBUG] [LOCAL ] IX: Primary data saved (16716 records). [2025-09-14T18:37:51.208926] [INFO ] [MAIN ] IX: Full history saved. [2025-09-14T18:37:51.209056] [INFO ] [MAIN ] Update Progress: 1139/2370 symbols completed. IX took 25.7s. Estimated remaining: 2h 10m 24s. Rate: 9.4 symbols/min [2025-09-14T18:37:51.385385] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:37:51.407514] [DEBUG] [LOCAL ] JBL: Loaded 21764 existing records from primary storage. [2025-09-14T18:37:51.407729] [INFO ] [MAIN ] JBL: Loaded 21764 existing records. [2025-09-14T18:37:51.586883] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:37:51.587165] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-09-14T18:37:51.587223] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-09-14T18:37:51.587884] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-09-14T18:37:51.587946] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-09-14T18:37:51.764541] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-09-14T18:37:51.965398] [INFO ] [REMOTE ] JBL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:37:51.990889] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T18:37:52.558796] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-09-14T18:37:52.590379] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-14T18:37:53.358828] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-09-14T18:37:53.626277] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T18:37:54.158799] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-09-14T18:37:54.546142] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-14T18:37:54.861491] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-14T18:37:54.958827] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-09-14T18:37:55.758837] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-09-14T18:37:55.837398] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-14T18:37:56.558829] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-09-14T18:37:56.924127] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-14T18:37:57.358833] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-09-14T18:37:57.413779] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-14T18:37:58.158827] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-09-14T18:37:58.277588] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-14T18:37:58.816322] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:37:58.820852] [INFO ] [REMOTE ] J: Full fetch complete (44417 records). [2025-09-14T18:37:58.820981] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-09-14T18:37:58.967303] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-09-14T18:37:59.207151] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-09-14T18:37:59.207338] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-09-14T18:37:59.208173] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-09-14T18:37:59.208303] [DEBUG] [LOCAL ] J: Saving primary data. [2025-09-14T18:37:59.209698] [DEBUG] [LOCAL ] J: Trimmed 44417 records to 29890 (keeping 150 days of data) [2025-09-14T18:37:59.344010] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-14T18:37:59.464636] [DEBUG] [LOCAL ] J: Primary data saved (29890 records). [2025-09-14T18:37:59.464876] [INFO ] [MAIN ] J: Full history saved. [2025-09-14T18:37:59.464981] [INFO ] [MAIN ] Update Progress: 1140/2370 symbols completed. J took 24.5s. Estimated remaining: 2h 10m 20s. Rate: 9.4 symbols/min [2025-09-14T18:37:59.639924] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:37:59.658071] [DEBUG] [LOCAL ] JBND: Loaded 12005 existing records from primary storage. [2025-09-14T18:37:59.658347] [INFO ] [MAIN ] JBND: Loaded 12005 existing records. [2025-09-14T18:37:59.764009] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-09-14T18:37:59.861112] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:37:59.861529] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-09-14T18:37:59.861611] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-09-14T18:37:59.862264] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-09-14T18:37:59.862501] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-09-14T18:38:00.230740] [INFO ] [REMOTE ] JBND: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:38:00.558855] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-09-14T18:38:00.719143] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-14T18:38:01.358884] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-09-14T18:38:01.706569] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-14T18:38:01.963614] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-14T18:38:02.158881] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-09-14T18:38:02.942231] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-14T18:38:02.958783] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-09-14T18:38:03.552414] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T18:38:03.758848] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-09-14T18:38:04.558834] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-09-14T18:38:04.610071] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-14T18:38:05.358804] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-09-14T18:38:05.822797] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-14T18:38:05.848538] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-14T18:38:06.158843] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-09-14T18:38:06.735883] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-14T18:38:06.958927] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-09-14T18:38:07.010843] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-14T18:38:07.758829] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-09-14T18:38:08.558861] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-09-14T18:38:08.940971] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-14T18:38:08.973122] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-14T18:38:09.358901] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-09-14T18:38:09.887875] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-14T18:38:09.892404] [INFO ] [REMOTE ] JBI: Full fetch complete (48166 records). [2025-09-14T18:38:09.892596] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-09-14T18:38:10.164009] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-09-14T18:38:10.288431] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-09-14T18:38:10.288535] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-09-14T18:38:10.289321] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-09-14T18:38:10.289377] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-09-14T18:38:10.290424] [DEBUG] [LOCAL ] JBI: Trimmed 48166 records to 32393 (keeping 150 days of data) [2025-09-14T18:38:10.481445] [DEBUG] [LOCAL ] JBI: Primary data saved (32393 records). [2025-09-14T18:38:10.481617] [INFO ] [MAIN ] JBI: Full history saved. [2025-09-14T18:38:10.481751] [INFO ] [MAIN ] Update Progress: 1141/2370 symbols completed. JBI took 20.5s. Estimated remaining: 2h 10m 19s. Rate: 9.4 symbols/min [2025-09-14T18:38:10.654322] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:38:10.668460] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-14T18:38:10.692250] [DEBUG] [LOCAL ] JBS: Loaded 23682 existing records from primary storage. [2025-09-14T18:38:10.692398] [INFO ] [MAIN ] JBS: Loaded 23682 existing records. [2025-09-14T18:38:10.884211] [WARN ] [MAIN ] JBS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:38:10.884467] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-09-14T18:38:10.884527] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-14T18:38:10.885208] [DEBUG] [LOCAL ] JBS: Deleted primary data file. [2025-09-14T18:38:10.885271] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-09-14T18:38:10.964352] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-09-14T18:38:11.244025] [INFO ] [REMOTE ] JBS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:38:11.758903] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-09-14T18:38:12.115730] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-14T18:38:12.558902] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-09-14T18:38:12.762655] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T18:38:12.990222] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-14T18:38:13.270934] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T18:38:13.276021] [INFO ] [REMOTE ] JBL: Full fetch complete (52422 records). [2025-09-14T18:38:13.276179] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-09-14T18:38:13.364000] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-09-14T18:38:13.655275] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-09-14T18:38:13.655398] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-09-14T18:38:13.656301] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-09-14T18:38:13.656378] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-09-14T18:38:13.657576] [DEBUG] [LOCAL ] JBL: Trimmed 52422 records to 35773 (keeping 150 days of data) [2025-09-14T18:38:13.906724] [DEBUG] [LOCAL ] JBL: Primary data saved (35773 records). [2025-09-14T18:38:13.906914] [INFO ] [MAIN ] JBL: Full history saved. [2025-09-14T18:38:13.907061] [INFO ] [MAIN ] Update Progress: 1142/2370 symbols completed. JBL took 22.7s. Estimated remaining: 2h 10m 9s. Rate: 9.4 symbols/min [2025-09-14T18:38:14.079151] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:38:14.095152] [DEBUG] [LOCAL ] JBTM: Loaded 14015 existing records from primary storage. [2025-09-14T18:38:14.095312] [INFO ] [MAIN ] JBTM: Loaded 14015 existing records. [2025-09-14T18:38:14.168005] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-02. [2025-09-14T18:38:14.273483] [WARN ] [MAIN ] JBTM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:38:14.273798] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-09-14T18:38:14.273866] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-14T18:38:14.274428] [DEBUG] [LOCAL ] JBTM: Deleted primary data file. [2025-09-14T18:38:14.274493] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-09-14T18:38:14.508625] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:38:14.560084] [WARN ] [REMOTE ] JBS: No data returned for month 2025-02 [2025-09-14T18:38:14.648169] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:38:14.802367] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T18:38:14.958865] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-09-14T18:38:15.758842] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-09-14T18:38:16.147690] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-14T18:38:16.151329] [INFO ] [REMOTE ] JBND: Full fetch complete (26273 records). [2025-09-14T18:38:16.151423] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-09-14T18:38:16.524063] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-09-14T18:38:16.524178] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-09-14T18:38:16.524835] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-09-14T18:38:16.524896] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-09-14T18:38:16.525748] [DEBUG] [LOCAL ] JBND: Trimmed 26273 records to 19070 (keeping 150 days of data) [2025-09-14T18:38:16.577239] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-09-14T18:38:16.645609] [DEBUG] [LOCAL ] JBND: Primary data saved (19070 records). [2025-09-14T18:38:16.645802] [INFO ] [MAIN ] JBND: Full history saved. [2025-09-14T18:38:16.645966] [INFO ] [MAIN ] Update Progress: 1143/2370 symbols completed. JBND took 17.2s. Estimated remaining: 2h 9m 59s. Rate: 9.4 symbols/min [2025-09-14T18:38:16.815134] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:38:16.820345] [DEBUG] [LOCAL ] JCE: Loaded 3260 existing records from primary storage. [2025-09-14T18:38:16.820461] [INFO ] [MAIN ] JCE: Loaded 3260 existing records. [2025-09-14T18:38:16.998914] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:38:16.999202] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-09-14T18:38:16.999280] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-09-14T18:38:16.999684] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-09-14T18:38:16.999765] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-09-14T18:38:17.372186] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-03. [2025-09-14T18:38:17.372090] [INFO ] [REMOTE ] JCE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:38:17.403087] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T18:38:17.663322] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:38:17.663771] [WARN ] [REMOTE ] JBS: No data returned for month 2025-03 [2025-09-14T18:38:18.129464] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T18:38:18.158778] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-09-14T18:38:18.958899] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-09-14T18:38:19.054201] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-14T18:38:19.758900] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-09-14T18:38:20.490633] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-14T18:38:20.533883] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T18:38:20.558802] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-09-14T18:38:21.214896] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:38:21.219747] [INFO ] [REMOTE ] JBGS: Full fetch complete (45761 records). [2025-09-14T18:38:21.219928] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-09-14T18:38:21.364682] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-09-14T18:38:21.643581] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-09-14T18:38:21.643749] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-09-14T18:38:21.644526] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-09-14T18:38:21.644587] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-09-14T18:38:21.645848] [DEBUG] [LOCAL ] JBGS: Trimmed 45761 records to 31869 (keeping 150 days of data) [2025-09-14T18:38:21.857655] [DEBUG] [LOCAL ] JBGS: Primary data saved (31869 records). [2025-09-14T18:38:21.857833] [INFO ] [MAIN ] JBGS: Full history saved. [2025-09-14T18:38:21.857962] [INFO ] [MAIN ] Update Progress: 1144/2370 symbols completed. JBGS took 38.0s. Estimated remaining: 2h 9m 51s. Rate: 9.4 symbols/min [2025-09-14T18:38:22.031386] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:38:22.058470] [DEBUG] [LOCAL ] JCI: Loaded 23970 existing records from primary storage. [2025-09-14T18:38:22.058627] [INFO ] [MAIN ] JCI: Loaded 23970 existing records. [2025-09-14T18:38:22.159160] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-04. [2025-09-14T18:38:22.239456] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:38:22.239847] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-09-14T18:38:22.240042] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-09-14T18:38:22.245541] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-09-14T18:38:22.246557] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-09-14T18:38:22.246477] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-14T18:38:22.481621] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:38:22.541786] [WARN ] [REMOTE ] JBS: No data returned for month 2025-04 [2025-09-14T18:38:22.623388] [INFO ] [REMOTE ] JCI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:38:22.958836] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-05. [2025-09-14T18:38:23.220864] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:38:23.221202] [WARN ] [REMOTE ] JBS: No data returned for month 2025-05 [2025-09-14T18:38:23.758844] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-09-14T18:38:24.558830] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-09-14T18:38:25.147011] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-14T18:38:25.190318] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-14T18:38:25.358846] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-09-14T18:38:26.158832] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-09-14T18:38:26.189395] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T18:38:26.958827] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-09-14T18:38:27.719810] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-14T18:38:27.746035] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T18:38:27.758771] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-09-14T18:38:28.558830] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-09-14T18:38:29.060884] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-14T18:38:29.292453] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-14T18:38:29.358786] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-06. [2025-09-14T18:38:30.158775] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-09-14T18:38:30.546493] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-14T18:38:30.832225] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:38:30.833851] [INFO ] [REMOTE ] JCE: Full fetch complete (6569 records). [2025-09-14T18:38:30.833939] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-09-14T18:38:30.972256] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-07. [2025-09-14T18:38:31.200628] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-09-14T18:38:31.200971] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-09-14T18:38:31.201192] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-09-14T18:38:31.201275] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-09-14T18:38:31.201822] [DEBUG] [LOCAL ] JCE: Trimmed 6569 records to 4706 (keeping 150 days of data) [2025-09-14T18:38:31.230312] [DEBUG] [LOCAL ] JCE: Primary data saved (4706 records). [2025-09-14T18:38:31.230419] [INFO ] [MAIN ] JCE: Full history saved. [2025-09-14T18:38:31.230527] [INFO ] [MAIN ] Update Progress: 1145/2370 symbols completed. JCE took 14.6s. Estimated remaining: 2h 9m 48s. Rate: 9.4 symbols/min [2025-09-14T18:38:31.399197] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:38:31.425548] [DEBUG] [LOCAL ] JEF: Loaded 22051 existing records from primary storage. [2025-09-14T18:38:31.425752] [INFO ] [MAIN ] JEF: Loaded 22051 existing records. [2025-09-14T18:38:31.605703] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:38:31.605974] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-09-14T18:38:31.606033] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-09-14T18:38:31.606992] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-09-14T18:38:31.607057] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-09-14T18:38:31.778268] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-09-14T18:38:31.964379] [INFO ] [REMOTE ] JEF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:38:32.558782] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-09-14T18:38:33.100212] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-14T18:38:33.358883] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-09-14T18:38:34.005258] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-14T18:38:34.145460] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-14T18:38:34.158758] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-09-14T18:38:34.720725] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-14T18:38:34.958823] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-09-14T18:38:35.758894] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-08. [2025-09-14T18:38:36.287385] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-14T18:38:36.558830] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-09-14T18:38:36.944365] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-14T18:38:37.358814] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-09-14T18:38:37.530706] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T18:38:38.158814] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-09. [2025-09-14T18:38:38.216711] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T18:38:38.929419] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-14T18:38:38.958793] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-09-14T18:38:39.758834] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-09-14T18:38:39.797138] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-14T18:38:39.802495] [INFO ] [REMOTE ] JBS: Full fetch complete (23682 records). [2025-09-14T18:38:39.802594] [DEBUG] [VALIDATOR ] JBS: Validating primary data. [2025-09-14T18:38:39.994756] [WARN ] [VALIDATOR ] JBS: Validation failed - insufficient historical data. Have 62 unique days, need 150 days [2025-09-14T18:38:39.995145] [FATAL] [MAIN ] JBS: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:38:39.995204] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:38:39.995281] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-14T18:38:39.995370] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-14T18:38:39.995428] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-09-14T18:38:39.995521] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-09-14T18:38:39.995668] [INFO ] [MAIN ] Update Progress: 1146/2370 symbols completed. JBS took 29.5s. Estimated remaining: 2h 9m 44s. Rate: 9.4 symbols/min [2025-09-14T18:38:40.172430] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:38:40.192401] [DEBUG] [LOCAL ] JELD: Loaded 20114 existing records from primary storage. [2025-09-14T18:38:40.192558] [INFO ] [MAIN ] JELD: Loaded 20114 existing records. [2025-09-14T18:38:40.327215] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T18:38:40.399956] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:38:40.400198] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-09-14T18:38:40.400258] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-09-14T18:38:40.400791] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-09-14T18:38:40.400852] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-09-14T18:38:40.558913] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-09-14T18:38:40.757247] [INFO ] [REMOTE ] JELD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:38:41.364592] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-09-14T18:38:41.369228] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T18:38:41.373055] [INFO ] [REMOTE ] JBTM: Full fetch complete (35011 records). [2025-09-14T18:38:41.373148] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-09-14T18:38:41.747832] [DEBUG] [VALIDATOR ] JBTM: All expected trading days are present. [2025-09-14T18:38:41.747957] [DEBUG] [VALIDATOR ] JBTM: Primary data validation passed. [2025-09-14T18:38:41.748710] [INFO ] [MAIN ] JBTM: Fetched primary data is valid. [2025-09-14T18:38:41.748771] [DEBUG] [LOCAL ] JBTM: Saving primary data. [2025-09-14T18:38:41.749697] [DEBUG] [LOCAL ] JBTM: Trimmed 35011 records to 24291 (keeping 150 days of data) [2025-09-14T18:38:41.885448] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-14T18:38:41.948444] [DEBUG] [LOCAL ] JBTM: Primary data saved (24291 records). [2025-09-14T18:38:41.948632] [INFO ] [MAIN ] JBTM: Full history saved. [2025-09-14T18:38:41.948802] [INFO ] [MAIN ] Update Progress: 1147/2370 symbols completed. JBTM took 28.0s. Estimated remaining: 2h 9m 33s. Rate: 9.4 symbols/min [2025-09-14T18:38:42.121350] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:38:42.126826] [DEBUG] [LOCAL ] JEQ: Loaded 3748 existing records from primary storage. [2025-09-14T18:38:42.126948] [INFO ] [MAIN ] JEQ: Loaded 3748 existing records. [2025-09-14T18:38:42.163954] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-09-14T18:38:42.303627] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:38:42.303881] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-09-14T18:38:42.303949] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-09-14T18:38:42.304222] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-09-14T18:38:42.304281] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-09-14T18:38:42.658004] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:38:42.958846] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-09-14T18:38:43.062314] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T18:38:43.758889] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-09-14T18:38:43.776993] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-14T18:38:43.961566] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-14T18:38:44.558841] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-09-14T18:38:45.350725] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T18:38:45.359922] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-09-14T18:38:45.481841] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-14T18:38:46.158834] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-09-14T18:38:46.958859] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-09-14T18:38:47.398935] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-14T18:38:47.758853] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-09-14T18:38:47.969700] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T18:38:48.558854] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-09-14T18:38:48.727997] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T18:38:49.358847] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-09-14T18:38:49.714750] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-14T18:38:50.158844] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-09-14T18:38:50.299002] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T18:38:50.958855] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-09-14T18:38:51.034525] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T18:38:51.758851] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-09-14T18:38:51.799742] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-14T18:38:51.942347] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-14T18:38:52.558810] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-09-14T18:38:53.151116] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T18:38:53.354719] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-14T18:38:53.358760] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-09-14T18:38:54.027205] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-14T18:38:54.158816] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-09-14T18:38:54.958862] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-09-14T18:38:55.758924] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-09-14T18:38:55.894661] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-14T18:38:56.181576] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-14T18:38:56.430688] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-14T18:38:56.558875] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-09-14T18:38:57.358830] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-09-14T18:38:58.158862] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-09-14T18:38:58.196447] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-14T18:38:58.453422] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T18:38:58.958895] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-09-14T18:38:59.668778] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T18:38:59.670004] [INFO ] [REMOTE ] JEQ: Full fetch complete (9301 records). [2025-09-14T18:38:59.670100] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-09-14T18:38:59.766960] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-09-14T18:39:00.040385] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-09-14T18:39:00.040753] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-09-14T18:39:00.041025] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-09-14T18:39:00.041175] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-09-14T18:39:00.042063] [DEBUG] [LOCAL ] JEQ: Trimmed 9301 records to 5984 (keeping 150 days of data) [2025-09-14T18:39:00.101514] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-14T18:39:00.120351] [DEBUG] [LOCAL ] JEQ: Primary data saved (5984 records). [2025-09-14T18:39:00.120932] [INFO ] [MAIN ] JEQ: Full history saved. [2025-09-14T18:39:00.121056] [INFO ] [MAIN ] Update Progress: 1148/2370 symbols completed. JEQ took 18.2s. Estimated remaining: 2h 9m 40s. Rate: 9.4 symbols/min [2025-09-14T18:39:00.287993] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:39:00.303230] [DEBUG] [LOCAL ] JFR: Loaded 13627 existing records from primary storage. [2025-09-14T18:39:00.303384] [INFO ] [MAIN ] JFR: Loaded 13627 existing records. [2025-09-14T18:39:00.479840] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:39:00.480214] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-09-14T18:39:00.480318] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-09-14T18:39:00.486054] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-09-14T18:39:00.493293] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T18:39:00.493362] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-09-14T18:39:00.566816] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-09-14T18:39:00.529610] [INFO ] [REMOTE ] JEF: Full fetch complete (54481 records). [2025-09-14T18:39:00.598303] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-09-14T18:39:01.150332] [INFO ] [REMOTE ] JFR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:39:01.238822] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-09-14T18:39:01.238935] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-09-14T18:39:01.239786] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-09-14T18:39:01.239847] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-09-14T18:39:01.241065] [DEBUG] [LOCAL ] JEF: Trimmed 54481 records to 37153 (keeping 150 days of data) [2025-09-14T18:39:01.359024] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-09-14T18:39:01.488986] [DEBUG] [LOCAL ] JEF: Primary data saved (37153 records). [2025-09-14T18:39:01.489210] [INFO ] [MAIN ] JEF: Full history saved. [2025-09-14T18:39:01.489381] [INFO ] [MAIN ] Update Progress: 1149/2370 symbols completed. JEF took 30.3s. Estimated remaining: 2h 9m 28s. Rate: 9.4 symbols/min [2025-09-14T18:39:01.666591] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:39:01.682949] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-14T18:39:01.693881] [INFO ] [REMOTE ] JCI: Full fetch complete (58229 records). [2025-09-14T18:39:01.694150] [DEBUG] [LOCAL ] JGH: Loaded 5404 existing records from primary storage. [2025-09-14T18:39:01.694494] [INFO ] [MAIN ] JGH: Loaded 5404 existing records. [2025-09-14T18:39:01.694420] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-09-14T18:39:02.046575] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:39:02.080477] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-09-14T18:39:02.130037] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-09-14T18:39:02.163735] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-09-14T18:39:02.192316] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-09-14T18:39:02.205042] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-09-14T18:39:02.431184] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-09-14T18:39:02.467270] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-09-14T18:39:02.537580] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-09-14T18:39:02.585568] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-09-14T18:39:02.670096] [DEBUG] [LOCAL ] JCI: Trimmed 58229 records to 40310 (keeping 150 days of data) [2025-09-14T18:39:02.674258] [INFO ] [REMOTE ] JGH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:39:02.959476] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-09-14T18:39:02.960116] [DEBUG] [LOCAL ] JCI: Primary data saved (40310 records). [2025-09-14T18:39:02.961166] [INFO ] [MAIN ] JCI: Full history saved. [2025-09-14T18:39:02.961304] [INFO ] [MAIN ] Update Progress: 1150/2370 symbols completed. JCI took 41.1s. Estimated remaining: 2h 9m 16s. Rate: 9.4 symbols/min [2025-09-14T18:39:03.135199] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:39:03.156072] [DEBUG] [LOCAL ] JHG: Loaded 20795 existing records from primary storage. [2025-09-14T18:39:03.156284] [INFO ] [MAIN ] JHG: Loaded 20795 existing records. [2025-09-14T18:39:03.336523] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:39:03.336821] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-09-14T18:39:03.336919] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-09-14T18:39:03.337526] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-09-14T18:39:03.337590] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-09-14T18:39:03.714263] [INFO ] [REMOTE ] JHG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:39:03.758791] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-09-14T18:39:04.954974] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (3.60 seconds). [2025-09-14T18:39:04.960132] [INFO ] [REMOTE ] JELD: Full fetch complete (49987 records). [2025-09-14T18:39:04.960299] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-09-14T18:39:05.297022] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-14T18:39:05.346576] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-09-14T18:39:05.349114] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-09-14T18:39:05.349189] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-09-14T18:39:05.350980] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-09-14T18:39:05.351128] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-09-14T18:39:05.352247] [DEBUG] [LOCAL ] JELD: Trimmed 49987 records to 34820 (keeping 150 days of data) [2025-09-14T18:39:05.556560] [DEBUG] [LOCAL ] JELD: Primary data saved (34820 records). [2025-09-14T18:39:05.556764] [INFO ] [MAIN ] JELD: Full history saved. [2025-09-14T18:39:05.556886] [INFO ] [MAIN ] Update Progress: 1151/2370 symbols completed. JELD took 25.6s. Estimated remaining: 2h 9m 6s. Rate: 9.4 symbols/min [2025-09-14T18:39:05.724534] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:39:05.727781] [DEBUG] [LOCAL ] JHI: Loaded 1417 existing records from primary storage. [2025-09-14T18:39:05.727879] [INFO ] [MAIN ] JHI: Loaded 1417 existing records. [2025-09-14T18:39:05.905951] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:39:05.906507] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-09-14T18:39:05.906699] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-09-14T18:39:05.907050] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-09-14T18:39:05.907194] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-09-14T18:39:06.085859] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-14T18:39:06.093569] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (3.93 seconds). [2025-09-14T18:39:06.124450] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-09-14T18:39:06.160113] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-09-14T18:39:06.258232] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-14T18:39:06.347151] [INFO ] [REMOTE ] JHI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:39:06.958855] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-09-14T18:39:07.145553] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-14T18:39:07.258851] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-14T18:39:07.758867] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-09-14T18:39:08.436793] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-14T18:39:08.558829] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-09-14T18:39:09.278297] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-14T18:39:09.279143] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-14T18:39:09.358806] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-09-14T18:39:10.158828] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-09-14T18:39:10.598557] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-14T18:39:10.958870] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-09-14T18:39:11.758860] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-09-14T18:39:11.929948] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T18:39:11.959159] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-14T18:39:12.371692] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-14T18:39:12.558916] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-09-14T18:39:13.358906] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-09-14T18:39:14.164299] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-09-14T18:39:14.173917] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-14T18:39:14.436102] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T18:39:14.958865] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-09-14T18:39:15.758909] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-09-14T18:39:16.210257] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-14T18:39:16.558920] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-09-14T18:39:16.688662] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-09-14T18:39:17.191624] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-14T18:39:17.358856] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-09-14T18:39:17.436229] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T18:39:18.158816] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-09-14T18:39:18.358423] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-14T18:39:18.786163] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-14T18:39:18.958811] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-09-14T18:39:19.758839] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-09-14T18:39:19.823684] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-14T18:39:20.558848] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-09-14T18:39:21.358862] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-09-14T18:39:21.424672] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T18:39:21.426951] [INFO ] [REMOTE ] JGH: Full fetch complete (11413 records). [2025-09-14T18:39:21.427050] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-09-14T18:39:21.788955] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-09-14T18:39:21.802588] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-14T18:39:21.808027] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-09-14T18:39:21.823792] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-09-14T18:39:21.823934] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-09-14T18:39:21.826361] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-14T18:39:21.836776] [DEBUG] [LOCAL ] JGH: Trimmed 11413 records to 8181 (keeping 150 days of data) [2025-09-14T18:39:21.893447] [DEBUG] [LOCAL ] JGH: Primary data saved (8181 records). [2025-09-14T18:39:21.893687] [INFO ] [MAIN ] JGH: Full history saved. [2025-09-14T18:39:21.893805] [INFO ] [MAIN ] Update Progress: 1152/2370 symbols completed. JGH took 20.4s. Estimated remaining: 2h 9m 10s. Rate: 9.4 symbols/min [2025-09-14T18:39:22.066915] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:39:22.070971] [DEBUG] [LOCAL ] JHS: Loaded 1573 existing records from primary storage. [2025-09-14T18:39:22.071097] [INFO ] [MAIN ] JHS: Loaded 1573 existing records. [2025-09-14T18:39:22.164044] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-09-14T18:39:22.249542] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:39:22.249813] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-09-14T18:39:22.249874] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-09-14T18:39:22.250083] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-09-14T18:39:22.250147] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-09-14T18:39:22.596794] [INFO ] [REMOTE ] JHS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:39:22.958842] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-09-14T18:39:23.758863] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-09-14T18:39:23.857151] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-14T18:39:23.896378] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-14T18:39:24.230382] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T18:39:24.232227] [INFO ] [REMOTE ] JHI: Full fetch complete (3943 records). [2025-09-14T18:39:24.232368] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-09-14T18:39:24.563952] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-09-14T18:39:24.619425] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-09-14T18:39:24.619530] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-09-14T18:39:24.619730] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-09-14T18:39:24.619786] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-09-14T18:39:24.620154] [DEBUG] [LOCAL ] JHI: Trimmed 3943 records to 2528 (keeping 150 days of data) [2025-09-14T18:39:24.636823] [DEBUG] [LOCAL ] JHI: Primary data saved (2528 records). [2025-09-14T18:39:24.636907] [INFO ] [MAIN ] JHI: Full history saved. [2025-09-14T18:39:24.637012] [INFO ] [MAIN ] Update Progress: 1153/2370 symbols completed. JHI took 19.1s. Estimated remaining: 2h 8m 60s. Rate: 9.4 symbols/min [2025-09-14T18:39:24.810014] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:39:24.840962] [DEBUG] [LOCAL ] JHX: Loaded 23886 existing records from primary storage. [2025-09-14T18:39:24.841134] [INFO ] [MAIN ] JHX: Loaded 23886 existing records. [2025-09-14T18:39:25.020421] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:39:25.020697] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-09-14T18:39:25.020779] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-09-14T18:39:25.021423] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-09-14T18:39:25.021490] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-09-14T18:39:25.371722] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-09-14T18:39:25.376023] [INFO ] [REMOTE ] JHX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:39:25.925184] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-14T18:39:25.959667] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-14T18:39:26.158858] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-09-14T18:39:26.958842] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-09-14T18:39:27.481700] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-14T18:39:27.485178] [INFO ] [REMOTE ] JFR: Full fetch complete (34737 records). [2025-09-14T18:39:27.485315] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-09-14T18:39:27.763940] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-09-14T18:39:27.870302] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-09-14T18:39:27.870421] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-09-14T18:39:27.871125] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-09-14T18:39:27.871184] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-09-14T18:39:27.872199] [DEBUG] [LOCAL ] JFR: Trimmed 34737 records to 21807 (keeping 150 days of data) [2025-09-14T18:39:28.025719] [DEBUG] [LOCAL ] JFR: Primary data saved (21807 records). [2025-09-14T18:39:28.025889] [INFO ] [MAIN ] JFR: Full history saved. [2025-09-14T18:39:28.026014] [INFO ] [MAIN ] Update Progress: 1154/2370 symbols completed. JFR took 27.9s. Estimated remaining: 2h 8m 50s. Rate: 9.4 symbols/min [2025-09-14T18:39:28.196157] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:39:28.205603] [DEBUG] [LOCAL ] JILL: Loaded 6963 existing records from primary storage. [2025-09-14T18:39:28.205754] [INFO ] [MAIN ] JILL: Loaded 6963 existing records. [2025-09-14T18:39:28.384517] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:39:28.384819] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-09-14T18:39:28.384883] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-09-14T18:39:28.385216] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-09-14T18:39:28.385274] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-09-14T18:39:28.564288] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-09-14T18:39:28.751110] [INFO ] [REMOTE ] JILL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:39:28.803620] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-14T18:39:28.866900] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T18:39:29.358861] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-09-14T18:39:30.158835] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-09-14T18:39:30.322317] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T18:39:30.522183] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-14T18:39:30.657688] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-14T18:39:30.958846] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-09-14T18:39:31.648942] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-14T18:39:31.758851] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-09-14T18:39:32.558829] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-09-14T18:39:32.775006] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T18:39:33.358824] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-09-14T18:39:34.158827] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-09-14T18:39:34.320267] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-14T18:39:34.373836] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-14T18:39:34.958830] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-09-14T18:39:35.596083] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T18:39:35.601841] [INFO ] [REMOTE ] JHG: Full fetch complete (52103 records). [2025-09-14T18:39:35.602268] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-09-14T18:39:35.768483] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-09-14T18:39:36.038580] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-09-14T18:39:36.038741] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-09-14T18:39:36.039766] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-09-14T18:39:36.039850] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-09-14T18:39:36.041521] [DEBUG] [LOCAL ] JHG: Trimmed 52103 records to 35896 (keeping 150 days of data) [2025-09-14T18:39:36.189673] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-14T18:39:36.310575] [DEBUG] [LOCAL ] JHG: Primary data saved (35896 records). [2025-09-14T18:39:36.310766] [INFO ] [MAIN ] JHG: Full history saved. [2025-09-14T18:39:36.310895] [INFO ] [MAIN ] Update Progress: 1155/2370 symbols completed. JHG took 33.3s. Estimated remaining: 2h 8m 46s. Rate: 9.4 symbols/min [2025-09-14T18:39:36.480856] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:39:36.504735] [DEBUG] [LOCAL ] JKS: Loaded 17278 existing records from primary storage. [2025-09-14T18:39:36.504954] [INFO ] [MAIN ] JKS: Loaded 17278 existing records. [2025-09-14T18:39:36.568975] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-09-14T18:39:36.620337] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-14T18:39:36.698394] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:39:36.698632] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-09-14T18:39:36.698708] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-09-14T18:39:36.699240] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-09-14T18:39:36.699303] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-09-14T18:39:37.067466] [INFO ] [REMOTE ] JKS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:39:37.358850] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-09-14T18:39:37.704248] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-14T18:39:38.158864] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-09-14T18:39:38.958869] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-09-14T18:39:39.180360] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-14T18:39:39.758893] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-09-14T18:39:39.961151] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-14T18:39:39.986146] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T18:39:40.374843] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-14T18:39:40.558889] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-09-14T18:39:41.358873] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-09-14T18:39:41.939571] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T18:39:41.940825] [INFO ] [REMOTE ] JHS: Full fetch complete (3250 records). [2025-09-14T18:39:41.940908] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-09-14T18:39:42.164013] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-09-14T18:39:42.312347] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-09-14T18:39:42.312464] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-09-14T18:39:42.312728] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-09-14T18:39:42.312795] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-09-14T18:39:42.313443] [DEBUG] [LOCAL ] JHS: Trimmed 3250 records to 2243 (keeping 150 days of data) [2025-09-14T18:39:42.352205] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T18:39:42.364540] [DEBUG] [LOCAL ] JHS: Primary data saved (2243 records). [2025-09-14T18:39:42.364673] [INFO ] [MAIN ] JHS: Full history saved. [2025-09-14T18:39:42.364781] [INFO ] [MAIN ] Update Progress: 1156/2370 symbols completed. JHS took 20.5s. Estimated remaining: 2h 8m 39s. Rate: 9.4 symbols/min [2025-09-14T18:39:42.542669] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:39:42.566688] [DEBUG] [LOCAL ] JLL: Loaded 14877 existing records from primary storage. [2025-09-14T18:39:42.566926] [INFO ] [MAIN ] JLL: Loaded 14877 existing records. [2025-09-14T18:39:42.763551] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:39:42.763977] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-09-14T18:39:42.764143] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-09-14T18:39:42.764869] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-09-14T18:39:42.764951] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-09-14T18:39:42.970398] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-09-14T18:39:43.119713] [INFO ] [REMOTE ] JLL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:39:43.306270] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-14T18:39:43.758887] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-09-14T18:39:44.558834] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-09-14T18:39:44.869461] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-14T18:39:45.358897] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-09-14T18:39:45.443096] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T18:39:45.597717] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-14T18:39:46.158860] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-09-14T18:39:46.958859] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-09-14T18:39:47.040451] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-14T18:39:47.653762] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-14T18:39:47.758839] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-09-14T18:39:48.558884] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-09-14T18:39:48.823590] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T18:39:49.358844] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-09-14T18:39:49.490504] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-14T18:39:49.705406] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-14T18:39:50.158832] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-09-14T18:39:50.958885] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-09-14T18:39:51.067626] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-14T18:39:51.711305] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T18:39:51.758777] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-09-14T18:39:52.558820] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-09-14T18:39:52.703541] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-14T18:39:52.709117] [INFO ] [REMOTE ] JHX: Full fetch complete (49137 records). [2025-09-14T18:39:52.709250] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-09-14T18:39:53.103298] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-09-14T18:39:53.103512] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-09-14T18:39:53.104472] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-09-14T18:39:53.104617] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-09-14T18:39:53.106262] [DEBUG] [LOCAL ] JHX: Trimmed 49137 records to 39971 (keeping 150 days of data) [2025-09-14T18:39:53.207176] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:39:53.229699] [INFO ] [REMOTE ] JILL: Full fetch complete (17701 records). [2025-09-14T18:39:53.235309] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-09-14T18:39:53.268577] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T18:39:53.361234] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-09-14T18:39:53.777150] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-09-14T18:39:53.778733] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-09-14T18:39:53.779963] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-09-14T18:39:53.780989] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-09-14T18:39:53.784806] [DEBUG] [LOCAL ] JILL: Trimmed 17701 records to 11746 (keeping 150 days of data) [2025-09-14T18:39:53.866521] [DEBUG] [LOCAL ] JILL: Primary data saved (11746 records). [2025-09-14T18:39:53.867579] [INFO ] [MAIN ] JILL: Full history saved. [2025-09-14T18:39:53.868344] [INFO ] [MAIN ] Update Progress: 1157/2370 symbols completed. JILL took 25.8s. Estimated remaining: 2h 8m 39s. Rate: 9.4 symbols/min [2025-09-14T18:39:53.873675] [DEBUG] [LOCAL ] JHX: Primary data saved (39971 records). [2025-09-14T18:39:53.873902] [INFO ] [MAIN ] JHX: Full history saved. [2025-09-14T18:39:53.874016] [INFO ] [MAIN ] Update Progress: 1158/2370 symbols completed. JHX took 29.2s. Estimated remaining: 2h 8m 25s. Rate: 9.4 symbols/min [2025-09-14T18:39:54.158904] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-09-14T18:39:54.949662] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-14T18:39:54.958764] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-09-14T18:39:55.518587] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-14T18:39:55.758817] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-09-14T18:39:56.621245] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-14T18:39:56.630350] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-09-14T18:39:57.201418] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T18:39:57.358858] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-09-14T18:39:58.083534] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-14T18:39:58.158782] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-09-14T18:39:58.538967] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T18:39:58.958818] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-09-14T18:39:59.509918] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-14T18:39:59.514267] [INFO ] [REMOTE ] JKS: Full fetch complete (43917 records). [2025-09-14T18:39:59.514371] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-09-14T18:39:59.816192] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-14T18:39:59.838594] [INFO ] [REMOTE ] JLL: Full fetch complete (35293 records). [2025-09-14T18:39:59.874390] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-09-14T18:39:59.969220] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-09-14T18:39:59.983266] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-09-14T18:40:00.014049] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-09-14T18:40:00.043917] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-09-14T18:40:00.105946] [DEBUG] [LOCAL ] JKS: Trimmed 43917 records to 28986 (keeping 150 days of data) [2025-09-14T18:40:00.416184] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-09-14T18:40:00.417030] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-09-14T18:40:00.418502] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-09-14T18:40:00.418907] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-09-14T18:40:00.422208] [DEBUG] [LOCAL ] JLL: Trimmed 35293 records to 24398 (keeping 150 days of data) [2025-09-14T18:40:00.632295] [DEBUG] [LOCAL ] JKS: Primary data saved (28986 records). [2025-09-14T18:40:00.634781] [INFO ] [MAIN ] JKS: Full history saved. [2025-09-14T18:40:00.634985] [INFO ] [MAIN ] Update Progress: 1159/2370 symbols completed. JKS took 24.3s. Estimated remaining: 2h 8m 20s. Rate: 9.4 symbols/min [2025-09-14T18:40:00.662542] [DEBUG] [LOCAL ] JLL: Primary data saved (24398 records). [2025-09-14T18:40:00.662744] [INFO ] [MAIN ] JLL: Full history saved. [2025-09-14T18:40:00.662874] [INFO ] [MAIN ] Update Progress: 1160/2370 symbols completed. JLL took 18.3s. Estimated remaining: 2h 8m 7s. Rate: 9.4 symbols/min [2025-09-14T18:40:01.176569] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:40:01.244809] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:40:01.382112] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:40:01.406715] [DEBUG] [LOCAL ] JLS: Loaded 1639 existing records from primary storage. [2025-09-14T18:40:01.404051] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:40:01.407283] [INFO ] [MAIN ] JLS: Loaded 1639 existing records. [2025-09-14T18:40:01.491878] [DEBUG] [LOCAL ] JMM: Loaded 795 existing records from primary storage. [2025-09-14T18:40:01.524320] [INFO ] [MAIN ] JMM: Loaded 795 existing records. [2025-09-14T18:40:01.614794] [DEBUG] [LOCAL ] JMIA: Loaded 23232 existing records from primary storage. [2025-09-14T18:40:01.677528] [DEBUG] [LOCAL ] JNJ: Loaded 24164 existing records from primary storage. [2025-09-14T18:40:01.677667] [INFO ] [MAIN ] JMIA: Loaded 23232 existing records. [2025-09-14T18:40:01.746739] [INFO ] [MAIN ] JNJ: Loaded 24164 existing records. [2025-09-14T18:40:01.762383] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:40:01.891583] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-09-14T18:40:01.966615] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-09-14T18:40:02.073929] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-09-14T18:40:02.160299] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-09-14T18:40:02.145169] [WARN ] [MAIN ] JMM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:40:02.224075] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:40:02.241339] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-14T18:40:02.275339] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-09-14T18:40:02.291478] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:40:02.291336] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-14T18:40:02.310292] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-09-14T18:40:02.326343] [DEBUG] [LOCAL ] JMM: Deleted primary data file. [2025-09-14T18:40:02.326429] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-09-14T18:40:02.343364] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-14T18:40:02.354084] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-09-14T18:40:02.364510] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-09-14T18:40:02.411671] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-09-14T18:40:02.512362] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-09-14T18:40:02.578307] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-09-14T18:40:03.544800] [INFO ] [REMOTE ] JLS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:40:03.565860] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-09-14T18:40:03.644752] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:40:03.671821] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-09-14T18:40:03.755070] [INFO ] [REMOTE ] JMM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:40:03.792910] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-14T18:40:03.792448] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:40:03.793976] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-09-14T18:40:04.619843] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-14T18:40:04.621287] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-09-14T18:40:04.631347] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-14T18:40:04.632355] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-14T18:40:05.075323] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-14T18:40:05.077019] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-14T18:40:05.151948] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-14T18:40:05.358906] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-09-14T18:40:05.914045] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-14T18:40:05.984294] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-14T18:40:06.072046] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-14T18:40:06.090210] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-14T18:40:06.158875] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-14T18:40:06.732178] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-14T18:40:06.958841] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-09-14T18:40:07.758852] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-09-14T18:40:08.558929] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-09-14T18:40:08.884812] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T18:40:09.199664] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-14T18:40:09.358871] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-09-14T18:40:09.991738] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-14T18:40:10.158791] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-09-14T18:40:10.190268] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-09-14T18:40:10.890227] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-14T18:40:10.958801] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-09-14T18:40:11.758875] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-14T18:40:12.207410] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-14T18:40:12.558803] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-14T18:40:12.891481] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-14T18:40:13.112594] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-14T18:40:13.358885] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-09-14T18:40:14.158942] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-14T18:40:14.692091] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-14T18:40:14.958888] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-14T18:40:15.758839] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-09-14T18:40:15.841228] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T18:40:15.842105] [INFO ] [REMOTE ] JMM: Full fetch complete (1963 records). [2025-09-14T18:40:15.842195] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-09-14T18:40:16.036132] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-14T18:40:16.068964] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-14T18:40:16.069627] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:40:16.070096] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:40:16.070156] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-14T18:40:16.070240] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-14T18:40:16.070294] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-09-14T18:40:16.070366] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-09-14T18:40:16.070456] [INFO ] [MAIN ] Update Progress: 1161/2370 symbols completed. JMM took 15.4s. Estimated remaining: 2h 8m 10s. Rate: 9.4 symbols/min [2025-09-14T18:40:16.238900] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:40:16.263810] [DEBUG] [LOCAL ] JOBY: Loaded 24178 existing records from primary storage. [2025-09-14T18:40:16.263981] [INFO ] [MAIN ] JOBY: Loaded 24178 existing records. [2025-09-14T18:40:16.441496] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:40:16.441818] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-09-14T18:40:16.441903] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-09-14T18:40:16.442568] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-09-14T18:40:16.442638] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-09-14T18:40:16.563988] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-09-14T18:40:16.830173] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:40:17.358875] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-09-14T18:40:17.456703] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T18:40:18.158929] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-09-14T18:40:18.267084] [DEBUG] [REMOTE ] JMIA: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-14T18:40:18.267598] [WARN ] [REMOTE ] JMIA: No data returned for month 2025-06 [2025-09-14T18:40:18.958862] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-09-14T18:40:19.320064] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.76 seconds). [2025-09-14T18:40:19.758888] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-09-14T18:40:19.877987] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-09-14T18:40:20.558835] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-09-14T18:40:20.912148] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-14T18:40:21.358910] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-09-14T18:40:21.960467] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-14T18:40:22.158891] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-09-14T18:40:22.897567] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-14T18:40:22.958768] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-09-14T18:40:23.486656] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-14T18:40:23.758858] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-09-14T18:40:24.392905] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-14T18:40:24.558851] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-09-14T18:40:25.358846] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-09-14T18:40:25.452756] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-14T18:40:25.514321] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-14T18:40:25.520135] [INFO ] [REMOTE ] JMIA: Full fetch complete (47403 records). [2025-09-14T18:40:25.520300] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-09-14T18:40:25.707976] [WARN ] [VALIDATOR ] JMIA: Validation failed - insufficient historical data. Have 130 unique days, need 150 days [2025-09-14T18:40:25.708611] [FATAL] [MAIN ] JMIA: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:40:25.708728] [WARN ] [MAIN ] JMIA: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:40:25.708788] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-09-14T18:40:25.708866] [DEBUG] [LOCAL ] JMIA: No primary data file found to delete. [2025-09-14T18:40:25.708915] [INFO ] [LOCAL ] JMIA: Starting deletion of derivative data. [2025-09-14T18:40:25.708969] [DEBUG] [LOCAL ] JMIA: No derivative data file found to delete. [2025-09-14T18:40:25.709061] [INFO ] [MAIN ] Update Progress: 1162/2370 symbols completed. JMIA took 25.0s. Estimated remaining: 2h 8m 7s. Rate: 9.4 symbols/min [2025-09-14T18:40:25.892170] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:40:25.904316] [DEBUG] [LOCAL ] JOE: Loaded 10211 existing records from primary storage. [2025-09-14T18:40:25.904484] [INFO ] [MAIN ] JOE: Loaded 10211 existing records. [2025-09-14T18:40:26.084839] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-14T18:40:26.090082] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:40:26.092081] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-09-14T18:40:26.092147] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-09-14T18:40:26.092699] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-09-14T18:40:26.092761] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-09-14T18:40:26.168684] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-09-14T18:40:26.453171] [INFO ] [REMOTE ] JOE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:40:26.759309] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T18:40:26.760537] [INFO ] [REMOTE ] JLS: Full fetch complete (4391 records). [2025-09-14T18:40:26.760657] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-09-14T18:40:26.963950] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-09-14T18:40:27.157465] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-09-14T18:40:27.228949] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-09-14T18:40:27.229075] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-09-14T18:40:27.229573] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-09-14T18:40:27.229632] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-09-14T18:40:27.230212] [DEBUG] [LOCAL ] JLS: Trimmed 4391 records to 2934 (keeping 150 days of data) [2025-09-14T18:40:27.250444] [DEBUG] [LOCAL ] JLS: Primary data saved (2934 records). [2025-09-14T18:40:27.250590] [INFO ] [MAIN ] JLS: Full history saved. [2025-09-14T18:40:27.250758] [INFO ] [MAIN ] Update Progress: 1163/2370 symbols completed. JLS took 26.6s. Estimated remaining: 2h 7m 55s. Rate: 9.4 symbols/min [2025-09-14T18:40:27.417003] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:40:27.422409] [DEBUG] [LOCAL ] JOF: Loaded 3354 existing records from primary storage. [2025-09-14T18:40:27.422516] [INFO ] [MAIN ] JOF: Loaded 3354 existing records. [2025-09-14T18:40:27.594366] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:40:27.594624] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-09-14T18:40:27.594701] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-09-14T18:40:27.595024] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-09-14T18:40:27.595084] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-09-14T18:40:27.763128] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-09-14T18:40:27.946432] [INFO ] [REMOTE ] JOF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:40:28.558846] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-09-14T18:40:29.358795] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-09-14T18:40:29.491181] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T18:40:29.555058] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-14T18:40:29.672878] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-09-14T18:40:30.029686] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:40:30.035303] [INFO ] [REMOTE ] JNJ: Full fetch complete (58433 records). [2025-09-14T18:40:30.035438] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-09-14T18:40:30.174590] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-09-14T18:40:30.413854] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-09-14T18:40:30.413954] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-09-14T18:40:30.414813] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-09-14T18:40:30.414876] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-09-14T18:40:30.416124] [DEBUG] [LOCAL ] JNJ: Trimmed 58433 records to 40493 (keeping 150 days of data) [2025-09-14T18:40:30.678473] [DEBUG] [LOCAL ] JNJ: Primary data saved (40493 records). [2025-09-14T18:40:30.678627] [INFO ] [MAIN ] JNJ: Full history saved. [2025-09-14T18:40:30.678735] [INFO ] [MAIN ] Update Progress: 1164/2370 symbols completed. JNJ took 30.0s. Estimated remaining: 2h 7m 46s. Rate: 9.4 symbols/min [2025-09-14T18:40:30.849752] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:40:30.866737] [DEBUG] [LOCAL ] JPC: Loaded 16463 existing records from primary storage. [2025-09-14T18:40:30.866896] [INFO ] [MAIN ] JPC: Loaded 16463 existing records. [2025-09-14T18:40:30.964372] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-09-14T18:40:31.040685] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:40:31.040937] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-09-14T18:40:31.041005] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-09-14T18:40:31.041669] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-09-14T18:40:31.041734] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-09-14T18:40:31.387517] [INFO ] [REMOTE ] JPC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:40:31.590128] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-14T18:40:31.758826] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-09-14T18:40:31.914945] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-14T18:40:32.558821] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-09-14T18:40:33.358824] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-09-14T18:40:33.393318] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-14T18:40:33.516065] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T18:40:34.158828] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-09-14T18:40:34.839543] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-14T18:40:34.958795] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-09-14T18:40:35.758828] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-09-14T18:40:35.972998] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-09-14T18:40:36.174345] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-14T18:40:36.284059] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-14T18:40:36.558830] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-09-14T18:40:37.319181] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-14T18:40:37.358836] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-09-14T18:40:38.158938] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-09-14T18:40:38.211713] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-14T18:40:38.958865] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-09-14T18:40:39.276198] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T18:40:39.758872] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-09-14T18:40:40.565982] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-09-14T18:40:40.570756] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-14T18:40:41.358864] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-09-14T18:40:41.709133] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-14T18:40:42.072977] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T18:40:42.075117] [INFO ] [REMOTE ] JOF: Full fetch complete (7483 records). [2025-09-14T18:40:42.075232] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-09-14T18:40:42.166305] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-09-14T18:40:42.454989] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-09-14T18:40:42.455119] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-09-14T18:40:42.455347] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-09-14T18:40:42.455407] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-09-14T18:40:42.456636] [DEBUG] [LOCAL ] JOF: Trimmed 7483 records to 5158 (keeping 150 days of data) [2025-09-14T18:40:42.489182] [DEBUG] [LOCAL ] JOF: Primary data saved (5158 records). [2025-09-14T18:40:42.489440] [INFO ] [MAIN ] JOF: Full history saved. [2025-09-14T18:40:42.489575] [INFO ] [MAIN ] Update Progress: 1165/2370 symbols completed. JOF took 15.2s. Estimated remaining: 2h 7m 45s. Rate: 9.4 symbols/min [2025-09-14T18:40:42.660228] [INFO ] [MAIN ] JPI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:40:42.703435] [DEBUG] [LOCAL ] JPI: Loaded 2039 existing records from primary storage. [2025-09-14T18:40:42.703938] [INFO ] [MAIN ] JPI: Loaded 2039 existing records. [2025-09-14T18:40:42.749451] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.99 seconds). [2025-09-14T18:40:42.899466] [WARN ] [MAIN ] JPI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:40:42.899742] [INFO ] [MAIN ] JPI: Wiping existing primary data before full refresh. [2025-09-14T18:40:42.899813] [INFO ] [LOCAL ] JPI: Starting deletion of primary data. [2025-09-14T18:40:42.900063] [DEBUG] [LOCAL ] JPI: Deleted primary data file. [2025-09-14T18:40:42.900123] [INFO ] [MAIN ] JPI: Starting full primary refresh. [2025-09-14T18:40:42.964004] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-09-14T18:40:43.257619] [INFO ] [REMOTE ] JPI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:40:43.481547] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-14T18:40:43.758838] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-02. [2025-09-14T18:40:44.356946] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-14T18:40:44.408031] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-14T18:40:44.558839] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-09-14T18:40:45.358870] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-09-14T18:40:45.767329] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-14T18:40:46.158846] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-09-14T18:40:46.555556] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-14T18:40:46.722344] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T18:40:46.727746] [INFO ] [REMOTE ] JOE: Full fetch complete (27011 records). [2025-09-14T18:40:46.728010] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-09-14T18:40:46.965438] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-03. [2025-09-14T18:40:47.105318] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-09-14T18:40:47.105440] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-09-14T18:40:47.106135] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-09-14T18:40:47.106197] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-09-14T18:40:47.107037] [DEBUG] [LOCAL ] JOE: Trimmed 27011 records to 17984 (keeping 150 days of data) [2025-09-14T18:40:47.218954] [DEBUG] [LOCAL ] JOE: Primary data saved (17984 records). [2025-09-14T18:40:47.219160] [INFO ] [MAIN ] JOE: Full history saved. [2025-09-14T18:40:47.219274] [INFO ] [MAIN ] Update Progress: 1166/2370 symbols completed. JOE took 21.5s. Estimated remaining: 2h 7m 37s. Rate: 9.4 symbols/min [2025-09-14T18:40:47.387776] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:40:47.413697] [DEBUG] [LOCAL ] JPM: Loaded 24205 existing records from primary storage. [2025-09-14T18:40:47.413864] [INFO ] [MAIN ] JPM: Loaded 24205 existing records. [2025-09-14T18:40:47.589805] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:40:47.590078] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-09-14T18:40:47.590139] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-09-14T18:40:47.591002] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-09-14T18:40:47.591087] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-09-14T18:40:47.731977] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-14T18:40:47.778634] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-09-14T18:40:47.961947] [INFO ] [REMOTE ] JPM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:40:48.558860] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-04. [2025-09-14T18:40:49.352504] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T18:40:49.359520] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-09-14T18:40:49.370437] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-14T18:40:50.158845] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-09-14T18:40:50.958899] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-09-14T18:40:51.108746] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-14T18:40:51.758841] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-09-14T18:40:52.189771] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.83 seconds). [2025-09-14T18:40:52.257994] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-14T18:40:52.558788] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-09-14T18:40:52.676556] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-14T18:40:53.358880] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-09-14T18:40:54.158850] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-05. [2025-09-14T18:40:54.853728] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T18:40:54.922000] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-14T18:40:54.958787] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-06. [2025-09-14T18:40:55.030537] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-14T18:40:55.037218] [INFO ] [REMOTE ] JOBY: Full fetch complete (58475 records). [2025-09-14T18:40:55.037424] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-09-14T18:40:55.420056] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-09-14T18:40:55.420169] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-09-14T18:40:55.421079] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-09-14T18:40:55.421144] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-09-14T18:40:55.422446] [DEBUG] [LOCAL ] JOBY: Trimmed 58475 records to 40550 (keeping 150 days of data) [2025-09-14T18:40:55.638874] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-14T18:40:55.679651] [DEBUG] [LOCAL ] JOBY: Primary data saved (40550 records). [2025-09-14T18:40:55.679814] [INFO ] [MAIN ] JOBY: Full history saved. [2025-09-14T18:40:55.679935] [INFO ] [MAIN ] Update Progress: 1167/2370 symbols completed. JOBY took 39.6s. Estimated remaining: 2h 7m 33s. Rate: 9.4 symbols/min [2025-09-14T18:40:55.763966] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-09-14T18:40:55.849100] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:40:55.865146] [DEBUG] [LOCAL ] JQC: Loaded 15015 existing records from primary storage. [2025-09-14T18:40:55.865309] [INFO ] [MAIN ] JQC: Loaded 15015 existing records. [2025-09-14T18:40:56.041504] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:40:56.041792] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-09-14T18:40:56.041856] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-09-14T18:40:56.042351] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-09-14T18:40:56.042420] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-09-14T18:40:56.393152] [INFO ] [REMOTE ] JQC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:40:56.558820] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-07. [2025-09-14T18:40:57.118706] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-14T18:40:57.122793] [INFO ] [REMOTE ] JPC: Full fetch complete (40703 records). [2025-09-14T18:40:57.122892] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-09-14T18:40:57.235340] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-14T18:40:57.364090] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-09-14T18:40:57.514836] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-09-14T18:40:57.514946] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-09-14T18:40:57.515796] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-09-14T18:40:57.515874] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-09-14T18:40:57.516856] [DEBUG] [LOCAL ] JPC: Trimmed 40703 records to 27300 (keeping 150 days of data) [2025-09-14T18:40:57.686949] [DEBUG] [LOCAL ] JPC: Primary data saved (27300 records). [2025-09-14T18:40:57.687122] [INFO ] [MAIN ] JPC: Full history saved. [2025-09-14T18:40:57.687245] [INFO ] [MAIN ] Update Progress: 1168/2370 symbols completed. JPC took 27.0s. Estimated remaining: 2h 7m 22s. Rate: 9.4 symbols/min [2025-09-14T18:40:57.857268] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:40:57.867841] [DEBUG] [LOCAL ] JRI: Loaded 7353 existing records from primary storage. [2025-09-14T18:40:57.868046] [INFO ] [MAIN ] JRI: Loaded 7353 existing records. [2025-09-14T18:40:58.072694] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:40:58.073053] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-09-14T18:40:58.073173] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-09-14T18:40:58.073547] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-09-14T18:40:58.073623] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-09-14T18:40:58.163970] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-08. [2025-09-14T18:40:58.589625] [INFO ] [REMOTE ] JRI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:40:58.651338] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-14T18:40:58.883086] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-14T18:40:58.958910] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-09-14T18:40:59.758859] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-09. [2025-09-14T18:41:00.180299] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-14T18:41:00.373906] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T18:41:00.375175] [INFO ] [REMOTE ] JPI: Full fetch complete (5843 records). [2025-09-14T18:41:00.375268] [DEBUG] [VALIDATOR ] JPI: Validating primary data. [2025-09-14T18:41:00.564867] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-09-14T18:41:00.764480] [DEBUG] [VALIDATOR ] JPI: All expected trading days are present. [2025-09-14T18:41:00.764616] [DEBUG] [VALIDATOR ] JPI: Primary data validation passed. [2025-09-14T18:41:00.764896] [INFO ] [MAIN ] JPI: Fetched primary data is valid. [2025-09-14T18:41:00.764968] [DEBUG] [LOCAL ] JPI: Saving primary data. [2025-09-14T18:41:00.765513] [DEBUG] [LOCAL ] JPI: Trimmed 5843 records to 4000 (keeping 150 days of data) [2025-09-14T18:41:00.791609] [DEBUG] [LOCAL ] JPI: Primary data saved (4000 records). [2025-09-14T18:41:00.791759] [INFO ] [MAIN ] JPI: Full history saved. [2025-09-14T18:41:00.791902] [INFO ] [MAIN ] Update Progress: 1169/2370 symbols completed. JPI took 18.3s. Estimated remaining: 2h 7m 12s. Rate: 9.4 symbols/min [2025-09-14T18:41:00.971140] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:41:00.979500] [DEBUG] [LOCAL ] JRS: Loaded 5500 existing records from primary storage. [2025-09-14T18:41:00.979681] [INFO ] [MAIN ] JRS: Loaded 5500 existing records. [2025-09-14T18:41:01.170804] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:41:01.171141] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-09-14T18:41:01.171204] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-09-14T18:41:01.171550] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-09-14T18:41:01.171611] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-09-14T18:41:01.360726] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-09-14T18:41:01.548079] [INFO ] [REMOTE ] JRS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:41:01.883092] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-14T18:41:02.158880] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-09-14T18:41:02.744113] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-14T18:41:02.958892] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-09-14T18:41:03.575383] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-14T18:41:03.758849] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-09-14T18:41:04.029528] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-14T18:41:04.558871] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-09-14T18:41:05.307116] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T18:41:05.358822] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-09-14T18:41:05.451672] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T18:41:06.158871] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-09-14T18:41:06.922055] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-14T18:41:06.958807] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-09-14T18:41:07.089711] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-14T18:41:07.758863] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-09-14T18:41:08.369016] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-14T18:41:08.558833] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-09-14T18:41:08.568410] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-14T18:41:09.358876] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-09-14T18:41:09.844143] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T18:41:10.031580] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-14T18:41:10.158844] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-09-14T18:41:10.958846] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-09-14T18:41:11.758884] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-09-14T18:41:11.840378] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-14T18:41:11.874541] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T18:41:12.558829] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-09-14T18:41:12.762377] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-14T18:41:13.358832] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-09-14T18:41:13.563355] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-14T18:41:14.050152] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-14T18:41:14.158822] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-09-14T18:41:14.958852] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-09-14T18:41:15.206722] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-14T18:41:15.758861] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-09-14T18:41:16.034143] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-14T18:41:16.558857] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-09-14T18:41:16.996388] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-14T18:41:17.358825] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-09-14T18:41:17.511731] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-14T18:41:18.105463] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T18:41:18.107290] [INFO ] [REMOTE ] JRS: Full fetch complete (11964 records). [2025-09-14T18:41:18.107379] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-09-14T18:41:18.163958] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-09-14T18:41:18.484874] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-09-14T18:41:18.484993] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-09-14T18:41:18.485630] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-09-14T18:41:18.485713] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-09-14T18:41:18.486269] [DEBUG] [LOCAL ] JRS: Trimmed 11964 records to 8399 (keeping 150 days of data) [2025-09-14T18:41:18.537530] [DEBUG] [LOCAL ] JRS: Primary data saved (8399 records). [2025-09-14T18:41:18.537777] [INFO ] [MAIN ] JRS: Full history saved. [2025-09-14T18:41:18.537923] [INFO ] [MAIN ] Update Progress: 1170/2370 symbols completed. JRS took 17.7s. Estimated remaining: 2h 7m 18s. Rate: 9.4 symbols/min [2025-09-14T18:41:18.713390] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:41:18.734525] [DEBUG] [LOCAL ] JXN: Loaded 19441 existing records from primary storage. [2025-09-14T18:41:18.734726] [INFO ] [MAIN ] JXN: Loaded 19441 existing records. [2025-09-14T18:41:18.921382] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:41:18.921760] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-09-14T18:41:18.921828] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-09-14T18:41:18.922422] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-09-14T18:41:18.922491] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-09-14T18:41:18.966100] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-09-14T18:41:19.321904] [INFO ] [REMOTE ] JXN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:41:19.676954] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-14T18:41:19.758853] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-09-14T18:41:19.956970] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-14T18:41:20.558839] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-09-14T18:41:21.256777] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-14T18:41:21.281205] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T18:41:21.286997] [INFO ] [REMOTE ] JPM: Full fetch complete (58473 records). [2025-09-14T18:41:21.287138] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-09-14T18:41:21.363886] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-09-14T18:41:21.675387] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-09-14T18:41:21.675495] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-09-14T18:41:21.676437] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-09-14T18:41:21.676503] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-09-14T18:41:21.677833] [DEBUG] [LOCAL ] JPM: Trimmed 58473 records to 40534 (keeping 150 days of data) [2025-09-14T18:41:21.947925] [DEBUG] [LOCAL ] JPM: Primary data saved (40534 records). [2025-09-14T18:41:21.948093] [INFO ] [MAIN ] JPM: Full history saved. [2025-09-14T18:41:21.948229] [INFO ] [MAIN ] Update Progress: 1171/2370 symbols completed. JPM took 34.7s. Estimated remaining: 2h 7m 8s. Rate: 9.4 symbols/min [2025-09-14T18:41:22.122711] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:41:22.144841] [DEBUG] [LOCAL ] K: Loaded 22655 existing records from primary storage. [2025-09-14T18:41:22.145012] [INFO ] [MAIN ] K: Loaded 22655 existing records. [2025-09-14T18:41:22.165344] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-09-14T18:41:22.330707] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:41:22.331226] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-09-14T18:41:22.338663] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-09-14T18:41:22.339770] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-09-14T18:41:22.339714] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-14T18:41:22.342991] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-09-14T18:41:22.700189] [INFO ] [REMOTE ] K: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:41:22.958828] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-09-14T18:41:23.363975] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-14T18:41:23.367709] [INFO ] [REMOTE ] JQC: Full fetch complete (36773 records). [2025-09-14T18:41:23.367810] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-09-14T18:41:23.742567] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-09-14T18:41:23.742692] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-09-14T18:41:23.743365] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-09-14T18:41:23.743422] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-09-14T18:41:23.744436] [DEBUG] [LOCAL ] JQC: Trimmed 36773 records to 24817 (keeping 150 days of data) [2025-09-14T18:41:23.795516] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-09-14T18:41:23.910547] [DEBUG] [LOCAL ] JQC: Primary data saved (24817 records). [2025-09-14T18:41:23.910791] [INFO ] [MAIN ] JQC: Full history saved. [2025-09-14T18:41:23.910934] [INFO ] [MAIN ] Update Progress: 1172/2370 symbols completed. JQC took 28.2s. Estimated remaining: 2h 6m 58s. Rate: 9.4 symbols/min [2025-09-14T18:41:24.094684] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-14T18:41:24.096071] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:41:24.101105] [INFO ] [REMOTE ] JRI: Full fetch complete (16702 records). [2025-09-14T18:41:24.101300] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-09-14T18:41:24.211775] [DEBUG] [LOCAL ] KAI: Loaded 5480 existing records from primary storage. [2025-09-14T18:41:24.238341] [INFO ] [MAIN ] KAI: Loaded 5480 existing records. [2025-09-14T18:41:24.565860] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-09-14T18:41:24.631323] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:41:24.674499] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-09-14T18:41:24.674728] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-09-14T18:41:24.674776] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-09-14T18:41:24.674947] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-09-14T18:41:24.675379] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-09-14T18:41:24.675426] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-09-14T18:41:24.675882] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-09-14T18:41:24.675999] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-09-14T18:41:24.709133] [DEBUG] [LOCAL ] JRI: Trimmed 16702 records to 11176 (keeping 150 days of data) [2025-09-14T18:41:25.100102] [INFO ] [REMOTE ] KAI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:41:25.116572] [DEBUG] [LOCAL ] JRI: Primary data saved (11176 records). [2025-09-14T18:41:25.116845] [INFO ] [MAIN ] JRI: Full history saved. [2025-09-14T18:41:25.117015] [INFO ] [MAIN ] Update Progress: 1173/2370 symbols completed. JRI took 27.4s. Estimated remaining: 2h 6m 46s. Rate: 9.4 symbols/min [2025-09-14T18:41:25.298223] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:41:25.319233] [DEBUG] [LOCAL ] KAR: Loaded 18280 existing records from primary storage. [2025-09-14T18:41:25.319422] [INFO ] [MAIN ] KAR: Loaded 18280 existing records. [2025-09-14T18:41:25.381368] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-09-14T18:41:25.499046] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:41:25.499314] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-09-14T18:41:25.499378] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-09-14T18:41:25.499971] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-09-14T18:41:25.500048] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-09-14T18:41:25.856820] [INFO ] [REMOTE ] KAR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:41:25.883422] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-14T18:41:26.158855] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-09-14T18:41:26.481927] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-14T18:41:26.750404] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-14T18:41:26.958834] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-09-14T18:41:27.625482] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T18:41:27.758832] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-09-14T18:41:28.558831] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-09-14T18:41:28.772351] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-14T18:41:29.358843] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-09-14T18:41:29.621221] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-14T18:41:29.715519] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-14T18:41:30.158830] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-09-14T18:41:30.765274] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-14T18:41:30.958833] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-09-14T18:41:31.760304] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-09-14T18:41:31.788296] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T18:41:31.808279] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-14T18:41:32.558851] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-09-14T18:41:33.358817] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-09-14T18:41:33.615264] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-14T18:41:33.665871] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T18:41:34.158826] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-09-14T18:41:34.958807] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-09-14T18:41:35.021500] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T18:41:35.758884] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-09-14T18:41:36.025825] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-14T18:41:36.555029] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T18:41:36.563449] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-09-14T18:41:37.006732] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-14T18:41:37.358898] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-09-14T18:41:38.158856] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-09-14T18:41:38.403451] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-14T18:41:38.439222] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-14T18:41:38.958877] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-09-14T18:41:39.766182] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-09-14T18:41:39.771728] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T18:41:40.005311] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-14T18:41:40.558827] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-09-14T18:41:41.369530] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-09-14T18:41:41.376181] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T18:41:41.591400] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-14T18:41:42.158881] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-09-14T18:41:42.802999] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T18:41:42.811900] [INFO ] [REMOTE ] JXN: Full fetch complete (50109 records). [2025-09-14T18:41:42.812101] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-09-14T18:41:42.964680] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-09-14T18:41:43.200980] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-09-14T18:41:43.201155] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-09-14T18:41:43.202102] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-09-14T18:41:43.202171] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-09-14T18:41:43.203597] [DEBUG] [LOCAL ] JXN: Trimmed 50109 records to 33633 (keeping 150 days of data) [2025-09-14T18:41:43.233783] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T18:41:43.456055] [DEBUG] [LOCAL ] JXN: Primary data saved (33633 records). [2025-09-14T18:41:43.456255] [INFO ] [MAIN ] JXN: Full history saved. [2025-09-14T18:41:43.456400] [INFO ] [MAIN ] Update Progress: 1174/2370 symbols completed. JXN took 24.9s. Estimated remaining: 2h 6m 52s. Rate: 9.4 symbols/min [2025-09-14T18:41:43.626368] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:41:43.638210] [DEBUG] [LOCAL ] KB: Loaded 10850 existing records from primary storage. [2025-09-14T18:41:43.638360] [INFO ] [MAIN ] KB: Loaded 10850 existing records. [2025-09-14T18:41:43.763978] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-09-14T18:41:43.831094] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:41:43.831405] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-09-14T18:41:43.831488] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-09-14T18:41:43.831961] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-09-14T18:41:43.832051] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-09-14T18:41:44.214991] [INFO ] [REMOTE ] KB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:41:44.558873] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-09-14T18:41:44.660560] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-14T18:41:44.675771] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-14T18:41:45.241356] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:41:45.247310] [INFO ] [REMOTE ] K: Full fetch complete (54002 records). [2025-09-14T18:41:45.247482] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-09-14T18:41:45.364007] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-09-14T18:41:45.637092] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-09-14T18:41:45.637212] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-09-14T18:41:45.638046] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-09-14T18:41:45.638107] [DEBUG] [LOCAL ] K: Saving primary data. [2025-09-14T18:41:45.639350] [DEBUG] [LOCAL ] K: Trimmed 54002 records to 37697 (keeping 150 days of data) [2025-09-14T18:41:45.881438] [DEBUG] [LOCAL ] K: Primary data saved (37697 records). [2025-09-14T18:41:45.881607] [INFO ] [MAIN ] K: Full history saved. [2025-09-14T18:41:45.881758] [INFO ] [MAIN ] Update Progress: 1175/2370 symbols completed. K took 23.9s. Estimated remaining: 2h 6m 41s. Rate: 9.4 symbols/min [2025-09-14T18:41:46.052731] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:41:46.063551] [DEBUG] [LOCAL ] KBDC: Loaded 9004 existing records from primary storage. [2025-09-14T18:41:46.063712] [INFO ] [MAIN ] KBDC: Loaded 9004 existing records. [2025-09-14T18:41:46.165014] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-09-14T18:41:46.245806] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:41:46.246067] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-09-14T18:41:46.246137] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-09-14T18:41:46.246489] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-09-14T18:41:46.246549] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-09-14T18:41:46.595457] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:41:46.958871] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-09-14T18:41:47.052518] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T18:41:47.433417] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-14T18:41:47.758882] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-09-14T18:41:48.029609] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T18:41:48.558855] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-09-14T18:41:49.152481] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T18:41:49.358822] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-09-14T18:41:49.550301] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-14T18:41:50.001824] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T18:41:50.006775] [INFO ] [REMOTE ] KAR: Full fetch complete (43702 records). [2025-09-14T18:41:50.006948] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-09-14T18:41:50.163948] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-09-14T18:41:50.414317] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-09-14T18:41:50.414457] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-09-14T18:41:50.415469] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-09-14T18:41:50.415563] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-09-14T18:41:50.417038] [DEBUG] [LOCAL ] KAR: Trimmed 43702 records to 29952 (keeping 150 days of data) [2025-09-14T18:41:50.628577] [DEBUG] [LOCAL ] KAR: Primary data saved (29952 records). [2025-09-14T18:41:50.628841] [INFO ] [MAIN ] KAR: Full history saved. [2025-09-14T18:41:50.628982] [INFO ] [MAIN ] Update Progress: 1176/2370 symbols completed. KAR took 25.5s. Estimated remaining: 2h 6m 33s. Rate: 9.4 symbols/min [2025-09-14T18:41:50.805750] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:41:50.811353] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:41:50.813573] [INFO ] [REMOTE ] KAI: Full fetch complete (15371 records). [2025-09-14T18:41:50.814104] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-09-14T18:41:50.959615] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-09-14T18:41:51.142715] [DEBUG] [LOCAL ] KBH: Loaded 22109 existing records from primary storage. [2025-09-14T18:41:51.143270] [INFO ] [MAIN ] KBH: Loaded 22109 existing records. [2025-09-14T18:41:51.334528] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-09-14T18:41:51.340306] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-09-14T18:41:51.351096] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-09-14T18:41:51.356289] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-09-14T18:41:51.415321] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:41:51.415421] [DEBUG] [LOCAL ] KAI: Trimmed 15371 records to 9945 (keeping 150 days of data) [2025-09-14T18:41:51.416058] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-09-14T18:41:51.416317] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-09-14T18:41:51.417153] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-09-14T18:41:51.417225] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-09-14T18:41:51.651432] [DEBUG] [LOCAL ] KAI: Primary data saved (9945 records). [2025-09-14T18:41:51.669700] [INFO ] [MAIN ] KAI: Full history saved. [2025-09-14T18:41:51.679535] [INFO ] [MAIN ] Update Progress: 1177/2370 symbols completed. KAI took 27.8s. Estimated remaining: 2h 6m 22s. Rate: 9.4 symbols/min [2025-09-14T18:41:51.770284] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-09-14T18:41:52.032412] [INFO ] [REMOTE ] KBH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:41:52.063036] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:41:52.081021] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-14T18:41:52.104260] [DEBUG] [LOCAL ] KBR: Loaded 21644 existing records from primary storage. [2025-09-14T18:41:52.104429] [INFO ] [MAIN ] KBR: Loaded 21644 existing records. [2025-09-14T18:41:52.298446] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:41:52.298776] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-09-14T18:41:52.298839] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-09-14T18:41:52.299422] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-09-14T18:41:52.299483] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-09-14T18:41:52.563893] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-09-14T18:41:52.650104] [INFO ] [REMOTE ] KBR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:41:52.798206] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-14T18:41:53.358869] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-09-14T18:41:54.158887] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-09-14T18:41:54.320392] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T18:41:54.958839] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-09-14T18:41:55.291008] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-14T18:41:55.430916] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-14T18:41:55.758853] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-09-14T18:41:56.558877] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-09-14T18:41:56.771825] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-14T18:41:56.812181] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-14T18:41:57.358850] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-09-14T18:41:57.920241] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-14T18:41:58.158781] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-09-14T18:41:58.477445] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T18:41:58.958863] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-09-14T18:41:59.758917] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-09-14T18:42:00.035060] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T18:42:00.079327] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-14T18:42:00.558945] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-09-14T18:42:01.358876] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-09-14T18:42:01.527718] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T18:42:02.158898] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-09-14T18:42:02.419877] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T18:42:02.958898] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-09-14T18:42:03.759015] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-09-14T18:42:05.098300] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (3.74 seconds). [2025-09-14T18:42:05.105115] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-09-14T18:42:05.491632] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-14T18:42:05.497387] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-09-14T18:42:05.856850] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (2.90 seconds). [2025-09-14T18:42:06.158891] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-09-14T18:42:06.335266] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (4.18 seconds). [2025-09-14T18:42:06.367709] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T18:42:06.396429] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T18:42:06.958906] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-09-14T18:42:07.758920] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-09-14T18:42:08.026666] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-14T18:42:08.077217] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-14T18:42:08.080862] [INFO ] [REMOTE ] KBDC: Full fetch complete (21717 records). [2025-09-14T18:42:08.080975] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-09-14T18:42:08.465844] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-09-14T18:42:08.465972] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-09-14T18:42:08.466474] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-09-14T18:42:08.466530] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-09-14T18:42:08.467211] [DEBUG] [LOCAL ] KBDC: Trimmed 21717 records to 14766 (keeping 150 days of data) [2025-09-14T18:42:08.556997] [DEBUG] [LOCAL ] KBDC: Primary data saved (14766 records). [2025-09-14T18:42:08.557182] [INFO ] [MAIN ] KBDC: Full history saved. [2025-09-14T18:42:08.557296] [INFO ] [MAIN ] Update Progress: 1178/2370 symbols completed. KBDC took 22.7s. Estimated remaining: 2h 6m 26s. Rate: 9.4 symbols/min [2025-09-14T18:42:08.568826] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-09-14T18:42:08.732210] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:42:08.740296] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-14T18:42:08.744094] [INFO ] [REMOTE ] KB: Full fetch complete (26867 records). [2025-09-14T18:42:08.744493] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-09-14T18:42:08.928935] [DEBUG] [LOCAL ] KD: Loaded 23562 existing records from primary storage. [2025-09-14T18:42:08.945861] [INFO ] [MAIN ] KD: Loaded 23562 existing records. [2025-09-14T18:42:09.343607] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:42:09.356431] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-09-14T18:42:09.356527] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-09-14T18:42:09.356759] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-09-14T18:42:09.357188] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-09-14T18:42:09.358331] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-09-14T18:42:09.358480] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-09-14T18:42:09.358838] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-09-14T18:42:09.359462] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-09-14T18:42:09.359579] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-09-14T18:42:09.396086] [DEBUG] [LOCAL ] KB: Trimmed 26867 records to 18330 (keeping 150 days of data) [2025-09-14T18:42:09.656110] [DEBUG] [LOCAL ] KB: Primary data saved (18330 records). [2025-09-14T18:42:09.659623] [INFO ] [MAIN ] KB: Full history saved. [2025-09-14T18:42:09.676153] [INFO ] [MAIN ] Update Progress: 1179/2370 symbols completed. KB took 26.2s. Estimated remaining: 2h 6m 14s. Rate: 9.4 symbols/min [2025-09-14T18:42:10.025585] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:42:10.047814] [INFO ] [REMOTE ] KD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:42:10.051658] [DEBUG] [LOCAL ] KEN: Loaded 1983 existing records from primary storage. [2025-09-14T18:42:10.051751] [INFO ] [MAIN ] KEN: Loaded 1983 existing records. [2025-09-14T18:42:10.163880] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-09-14T18:42:10.231435] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:42:10.231972] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-09-14T18:42:10.232035] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-09-14T18:42:10.232278] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-09-14T18:42:10.232337] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-09-14T18:42:10.593484] [INFO ] [REMOTE ] KEN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:42:10.626188] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-14T18:42:10.958905] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-09-14T18:42:11.250876] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-14T18:42:11.481561] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-14T18:42:11.758934] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-09-14T18:42:12.043016] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-14T18:42:12.558848] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-09-14T18:42:13.204717] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-14T18:42:13.358869] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-09-14T18:42:13.526409] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-14T18:42:14.158891] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-09-14T18:42:14.958892] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-09-14T18:42:15.019906] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-14T18:42:15.025788] [INFO ] [REMOTE ] KBH: Full fetch complete (53034 records). [2025-09-14T18:42:15.025949] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-09-14T18:42:15.429459] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-09-14T18:42:15.429586] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-09-14T18:42:15.430443] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-09-14T18:42:15.430502] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-09-14T18:42:15.431672] [DEBUG] [LOCAL ] KBH: Trimmed 53034 records to 36402 (keeping 150 days of data) [2025-09-14T18:42:15.678747] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-14T18:42:15.713060] [DEBUG] [LOCAL ] KBH: Primary data saved (36402 records). [2025-09-14T18:42:15.713232] [INFO ] [MAIN ] KBH: Full history saved. [2025-09-14T18:42:15.713334] [INFO ] [MAIN ] Update Progress: 1180/2370 symbols completed. KBH took 25.1s. Estimated remaining: 2h 6m 8s. Rate: 9.4 symbols/min [2025-09-14T18:42:15.767419] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-09-14T18:42:15.886004] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:42:15.903469] [DEBUG] [LOCAL ] KEP: Loaded 15566 existing records from primary storage. [2025-09-14T18:42:15.903630] [INFO ] [MAIN ] KEP: Loaded 15566 existing records. [2025-09-14T18:42:16.083245] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:42:16.083515] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-09-14T18:42:16.083581] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-09-14T18:42:16.084072] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-09-14T18:42:16.084138] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-09-14T18:42:16.495803] [INFO ] [REMOTE ] KEP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:42:16.502110] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-14T18:42:16.558822] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-09-14T18:42:17.358884] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-09-14T18:42:17.385763] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T18:42:17.863839] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-14T18:42:18.159010] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-09-14T18:42:18.502435] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T18:42:18.752823] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-14T18:42:18.958822] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-09-14T18:42:19.643067] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-14T18:42:19.758818] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-09-14T18:42:20.558871] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-09-14T18:42:21.358845] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-09-14T18:42:21.659327] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-14T18:42:21.700749] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-14T18:42:22.158871] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-09-14T18:42:22.804361] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-14T18:42:22.958830] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-09-14T18:42:23.758869] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-09-14T18:42:23.969949] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T18:42:24.331442] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-14T18:42:24.418506] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:42:24.423823] [INFO ] [REMOTE ] KBR: Full fetch complete (52872 records). [2025-09-14T18:42:24.423995] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-09-14T18:42:24.571221] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-09-14T18:42:24.843216] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-09-14T18:42:24.843354] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-09-14T18:42:24.844226] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-09-14T18:42:24.844290] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-09-14T18:42:24.845781] [DEBUG] [LOCAL ] KBR: Trimmed 52872 records to 36186 (keeping 150 days of data) [2025-09-14T18:42:25.079465] [DEBUG] [LOCAL ] KBR: Primary data saved (36186 records). [2025-09-14T18:42:25.079935] [INFO ] [MAIN ] KBR: Full history saved. [2025-09-14T18:42:25.080144] [INFO ] [MAIN ] Update Progress: 1181/2370 symbols completed. KBR took 33.4s. Estimated remaining: 2h 6m 4s. Rate: 9.4 symbols/min [2025-09-14T18:42:25.255111] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:42:25.275477] [DEBUG] [LOCAL ] KEX: Loaded 17037 existing records from primary storage. [2025-09-14T18:42:25.275703] [INFO ] [MAIN ] KEX: Loaded 17037 existing records. [2025-09-14T18:42:25.364603] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-09-14T18:42:25.468798] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:42:25.469164] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-09-14T18:42:25.469233] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-09-14T18:42:25.469986] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-09-14T18:42:25.470061] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-09-14T18:42:25.832449] [INFO ] [REMOTE ] KEX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:42:26.044501] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T18:42:26.045396] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-14T18:42:26.158796] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-09-14T18:42:26.958900] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-09-14T18:42:27.758834] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-09-14T18:42:27.809355] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-14T18:42:27.810342] [INFO ] [REMOTE ] KEN: Full fetch complete (4845 records). [2025-09-14T18:42:27.810439] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-09-14T18:42:28.172925] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-09-14T18:42:28.173168] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-09-14T18:42:28.173397] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-09-14T18:42:28.192997] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-09-14T18:42:28.194461] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-14T18:42:28.202712] [DEBUG] [LOCAL ] KEN: Trimmed 4845 records to 3435 (keeping 150 days of data) [2025-09-14T18:42:28.223908] [DEBUG] [LOCAL ] KEN: Primary data saved (3435 records). [2025-09-14T18:42:28.224034] [INFO ] [MAIN ] KEN: Full history saved. [2025-09-14T18:42:28.224167] [INFO ] [MAIN ] Update Progress: 1182/2370 symbols completed. KEN took 18.5s. Estimated remaining: 2h 5m 55s. Rate: 9.4 symbols/min [2025-09-14T18:42:28.399963] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:42:28.427154] [DEBUG] [LOCAL ] KEY: Loaded 23624 existing records from primary storage. [2025-09-14T18:42:28.427429] [INFO ] [MAIN ] KEY: Loaded 23624 existing records. [2025-09-14T18:42:28.571143] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-09-14T18:42:28.622568] [WARN ] [MAIN ] KEY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:42:28.622948] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-09-14T18:42:28.623017] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-14T18:42:28.623858] [DEBUG] [LOCAL ] KEY: Deleted primary data file. [2025-09-14T18:42:28.623931] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-09-14T18:42:29.007355] [INFO ] [REMOTE ] KEY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:42:29.358866] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-14T18:42:30.149246] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-09-14T18:42:30.159336] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-09-14T18:42:30.425005] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-14T18:42:30.867057] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T18:42:30.958816] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-14T18:42:31.758850] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-09-14T18:42:31.801516] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T18:42:32.558829] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-09-14T18:42:32.846843] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-14T18:42:33.358936] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-14T18:42:33.728996] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-14T18:42:33.853023] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-14T18:42:34.158841] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-09-14T18:42:34.958848] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-09-14T18:42:35.338694] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T18:42:35.611258] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-14T18:42:35.758801] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-09-14T18:42:36.469047] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-14T18:42:36.558786] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-09-14T18:42:37.032421] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-14T18:42:37.358908] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-14T18:42:37.803061] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-14T18:42:37.806020] [INFO ] [REMOTE ] KEP: Full fetch complete (31963 records). [2025-09-14T18:42:37.806111] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-09-14T18:42:38.170775] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-09-14T18:42:38.185002] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-09-14T18:42:38.185120] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-09-14T18:42:38.185991] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-09-14T18:42:38.186159] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-09-14T18:42:38.187107] [DEBUG] [LOCAL ] KEP: Trimmed 31963 records to 24446 (keeping 150 days of data) [2025-09-14T18:42:38.339137] [DEBUG] [LOCAL ] KEP: Primary data saved (24446 records). [2025-09-14T18:42:38.339306] [INFO ] [MAIN ] KEP: Full history saved. [2025-09-14T18:42:38.339420] [INFO ] [MAIN ] Update Progress: 1183/2370 symbols completed. KEP took 22.6s. Estimated remaining: 2h 5m 52s. Rate: 9.4 symbols/min [2025-09-14T18:42:38.512848] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:42:38.533295] [DEBUG] [LOCAL ] KEYS: Loaded 19057 existing records from primary storage. [2025-09-14T18:42:38.533471] [INFO ] [MAIN ] KEYS: Loaded 19057 existing records. [2025-09-14T18:42:38.718727] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:42:38.719026] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-09-14T18:42:38.719088] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-09-14T18:42:38.719828] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-09-14T18:42:38.719892] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-09-14T18:42:38.973061] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-09-14T18:42:39.110759] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:42:39.328801] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-14T18:42:39.695960] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-14T18:42:39.758818] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-09-14T18:42:40.558834] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-14T18:42:40.700674] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T18:42:41.285670] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T18:42:41.358815] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-09-14T18:42:42.158903] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-09-14T18:42:42.338148] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T18:42:42.490409] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T18:42:42.496589] [INFO ] [REMOTE ] KD: Full fetch complete (56896 records). [2025-09-14T18:42:42.496827] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-09-14T18:42:42.888289] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-09-14T18:42:42.888485] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-09-14T18:42:42.889476] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-09-14T18:42:42.889599] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-09-14T18:42:42.891072] [DEBUG] [LOCAL ] KD: Trimmed 56896 records to 39273 (keeping 150 days of data) [2025-09-14T18:42:42.984023] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-09-14T18:42:43.020634] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T18:42:43.207471] [DEBUG] [LOCAL ] KD: Primary data saved (39273 records). [2025-09-14T18:42:43.207703] [INFO ] [MAIN ] KD: Full history saved. [2025-09-14T18:42:43.207830] [INFO ] [MAIN ] Update Progress: 1184/2370 symbols completed. KD took 34.7s. Estimated remaining: 2h 5m 44s. Rate: 9.4 symbols/min [2025-09-14T18:42:43.374121] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:42:43.376618] [DEBUG] [LOCAL ] KF: Loaded 683 existing records from primary storage. [2025-09-14T18:42:43.376732] [INFO ] [MAIN ] KF: Loaded 683 existing records. [2025-09-14T18:42:43.552393] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:42:43.552722] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-09-14T18:42:43.552794] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-09-14T18:42:43.553011] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-09-14T18:42:43.553069] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-09-14T18:42:43.769591] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-14T18:42:43.924117] [INFO ] [REMOTE ] KF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:42:44.558833] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-09-14T18:42:44.688235] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T18:42:45.358870] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-09-14T18:42:45.741462] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T18:42:45.781538] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-14T18:42:46.072877] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T18:42:46.077962] [INFO ] [REMOTE ] KEX: Full fetch complete (40715 records). [2025-09-14T18:42:46.078160] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-09-14T18:42:46.163908] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-09-14T18:42:46.468005] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-09-14T18:42:46.468161] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-09-14T18:42:46.468907] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-09-14T18:42:46.468970] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-09-14T18:42:46.470138] [DEBUG] [LOCAL ] KEX: Trimmed 40715 records to 28008 (keeping 150 days of data) [2025-09-14T18:42:46.650757] [DEBUG] [LOCAL ] KEX: Primary data saved (28008 records). [2025-09-14T18:42:46.650972] [INFO ] [MAIN ] KEX: Full history saved. [2025-09-14T18:42:46.651128] [INFO ] [MAIN ] Update Progress: 1185/2370 symbols completed. KEX took 21.6s. Estimated remaining: 2h 5m 35s. Rate: 9.4 symbols/min [2025-09-14T18:42:46.813404] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-14T18:42:46.830451] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:42:46.843387] [DEBUG] [LOCAL ] KFRC: Loaded 9789 existing records from primary storage. [2025-09-14T18:42:46.843534] [INFO ] [MAIN ] KFRC: Loaded 9789 existing records. [2025-09-14T18:42:46.964028] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-09-14T18:42:47.027909] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:42:47.028175] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-09-14T18:42:47.028254] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-09-14T18:42:47.028701] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-09-14T18:42:47.028764] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-09-14T18:42:47.381234] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:42:47.652094] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-14T18:42:47.758833] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-09-14T18:42:48.371999] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-14T18:42:48.558830] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-09-14T18:42:49.199897] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-14T18:42:49.358832] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-14T18:42:50.158915] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-09-14T18:42:50.958854] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-09-14T18:42:51.263053] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T18:42:51.522883] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-14T18:42:51.758859] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-14T18:42:51.899479] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-14T18:42:52.432972] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:42:52.438138] [INFO ] [REMOTE ] KEY: Full fetch complete (57927 records). [2025-09-14T18:42:52.438254] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-09-14T18:42:52.563971] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-09-14T18:42:52.632538] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-14T18:42:52.633140] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:42:52.633193] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:42:52.633250] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-14T18:42:52.633319] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-14T18:42:52.633367] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-09-14T18:42:52.633427] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-09-14T18:42:52.633525] [INFO ] [MAIN ] Update Progress: 1186/2370 symbols completed. KEY took 24.4s. Estimated remaining: 2h 5m 28s. Rate: 9.4 symbols/min [2025-09-14T18:42:52.800013] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:42:52.806894] [DEBUG] [LOCAL ] KFS: Loaded 3986 existing records from primary storage. [2025-09-14T18:42:52.807092] [INFO ] [MAIN ] KFS: Loaded 3986 existing records. [2025-09-14T18:42:52.985621] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:42:52.985890] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-09-14T18:42:52.985952] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-09-14T18:42:52.986179] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-09-14T18:42:52.986243] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-09-14T18:42:53.355410] [INFO ] [REMOTE ] KFS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:42:53.358784] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-09-14T18:42:54.158843] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-09-14T18:42:54.329440] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-14T18:42:54.366085] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T18:42:54.669461] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-14T18:42:54.958843] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-09-14T18:42:55.705961] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-14T18:42:55.758836] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-09-14T18:42:56.558812] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-09-14T18:42:57.358839] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-09-14T18:42:57.448911] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-14T18:42:57.614207] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-14T18:42:57.750068] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-14T18:42:57.750895] [INFO ] [REMOTE ] KF: Full fetch complete (2672 records). [2025-09-14T18:42:57.750977] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-09-14T18:42:58.134146] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-09-14T18:42:58.134309] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-09-14T18:42:58.134464] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-09-14T18:42:58.134718] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-09-14T18:42:58.136046] [DEBUG] [LOCAL ] KF: Trimmed 2672 records to 1764 (keeping 150 days of data) [2025-09-14T18:42:58.147692] [DEBUG] [LOCAL ] KF: Primary data saved (1764 records). [2025-09-14T18:42:58.147817] [INFO ] [MAIN ] KF: Full history saved. [2025-09-14T18:42:58.147944] [INFO ] [MAIN ] Update Progress: 1187/2370 symbols completed. KF took 14.9s. Estimated remaining: 2h 5m 21s. Rate: 9.4 symbols/min [2025-09-14T18:42:58.164014] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-09-14T18:42:58.326829] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:42:58.341336] [DEBUG] [LOCAL ] KFY: Loaded 13481 existing records from primary storage. [2025-09-14T18:42:58.341527] [INFO ] [MAIN ] KFY: Loaded 13481 existing records. [2025-09-14T18:42:58.524431] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:42:58.524765] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-09-14T18:42:58.524830] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-09-14T18:42:58.525304] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-09-14T18:42:58.525369] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-09-14T18:42:58.879597] [INFO ] [REMOTE ] KFY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:42:58.958817] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-09-14T18:42:59.758816] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-09-14T18:42:59.835349] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T18:43:00.282185] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-14T18:43:00.558853] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-09-14T18:43:00.706867] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-14T18:43:01.358829] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-09-14T18:43:02.158792] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-09-14T18:43:02.392271] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-14T18:43:02.591459] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-14T18:43:02.958818] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-09-14T18:43:03.062104] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-14T18:43:03.758920] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-09-14T18:43:04.488335] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-14T18:43:04.558889] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-09-14T18:43:05.358850] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-09-14T18:43:05.429430] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T18:43:05.471946] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T18:43:06.158899] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-09-14T18:43:06.896591] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T18:43:06.901664] [INFO ] [REMOTE ] KEYS: Full fetch complete (47520 records). [2025-09-14T18:43:06.901947] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-09-14T18:43:06.927698] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T18:43:06.963931] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-09-14T18:43:07.376274] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-09-14T18:43:07.376400] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-09-14T18:43:07.377319] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-09-14T18:43:07.377389] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-09-14T18:43:07.378512] [DEBUG] [LOCAL ] KEYS: Trimmed 47520 records to 32034 (keeping 150 days of data) [2025-09-14T18:43:07.589140] [DEBUG] [LOCAL ] KEYS: Primary data saved (32034 records). [2025-09-14T18:43:07.589360] [INFO ] [MAIN ] KEYS: Full history saved. [2025-09-14T18:43:07.589487] [INFO ] [MAIN ] Update Progress: 1188/2370 symbols completed. KEYS took 29.2s. Estimated remaining: 2h 5m 18s. Rate: 9.4 symbols/min [2025-09-14T18:43:07.771952] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:43:07.766245] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-09-14T18:43:07.800466] [DEBUG] [LOCAL ] KGC: Loaded 24068 existing records from primary storage. [2025-09-14T18:43:07.800663] [INFO ] [MAIN ] KGC: Loaded 24068 existing records. [2025-09-14T18:43:07.983395] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:43:07.983994] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-09-14T18:43:07.991509] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-09-14T18:43:07.992694] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-14T18:43:07.995231] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-09-14T18:43:07.996216] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-09-14T18:43:08.366866] [INFO ] [REMOTE ] KGC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:43:08.558894] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-09-14T18:43:09.029521] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-14T18:43:09.358887] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-09-14T18:43:10.158888] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-09-14T18:43:10.558420] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-14T18:43:10.779099] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T18:43:10.797102] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-14T18:43:10.958811] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-09-14T18:43:11.758888] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-09-14T18:43:12.412573] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-14T18:43:12.558848] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-09-14T18:43:13.358865] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-09-14T18:43:13.890112] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-14T18:43:14.069545] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-14T18:43:14.158806] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-09-14T18:43:14.167719] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T18:43:14.169218] [INFO ] [REMOTE ] KFS: Full fetch complete (8358 records). [2025-09-14T18:43:14.169313] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-09-14T18:43:14.533445] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-09-14T18:43:14.533546] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-09-14T18:43:14.533805] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-09-14T18:43:14.533868] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-09-14T18:43:14.534312] [DEBUG] [LOCAL ] KFS: Trimmed 8358 records to 6394 (keeping 150 days of data) [2025-09-14T18:43:14.571759] [DEBUG] [LOCAL ] KFS: Primary data saved (6394 records). [2025-09-14T18:43:14.571873] [INFO ] [MAIN ] KFS: Full history saved. [2025-09-14T18:43:14.571997] [INFO ] [MAIN ] Update Progress: 1189/2370 symbols completed. KFS took 21.9s. Estimated remaining: 2h 5m 12s. Rate: 9.4 symbols/min [2025-09-14T18:43:14.742075] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:43:14.762513] [DEBUG] [LOCAL ] KGS: Loaded 21043 existing records from primary storage. [2025-09-14T18:43:14.762690] [INFO ] [MAIN ] KGS: Loaded 21043 existing records. [2025-09-14T18:43:14.944284] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:43:14.944558] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-09-14T18:43:14.944620] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-09-14T18:43:14.945288] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-09-14T18:43:14.945358] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-09-14T18:43:14.965788] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-09-14T18:43:15.320756] [INFO ] [REMOTE ] KGS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:43:15.758841] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-09-14T18:43:16.252815] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-14T18:43:16.442104] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-14T18:43:16.558825] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-09-14T18:43:17.358800] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-09-14T18:43:17.388169] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T18:43:17.616341] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-14T18:43:17.985976] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T18:43:17.989918] [INFO ] [REMOTE ] KFY: Full fetch complete (33193 records). [2025-09-14T18:43:17.990069] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-09-14T18:43:18.171196] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-09-14T18:43:18.377605] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-09-14T18:43:18.377731] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-09-14T18:43:18.378458] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-09-14T18:43:18.378524] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-09-14T18:43:18.380480] [DEBUG] [LOCAL ] KFY: Trimmed 33193 records to 22010 (keeping 150 days of data) [2025-09-14T18:43:18.520927] [DEBUG] [LOCAL ] KFY: Primary data saved (22010 records). [2025-09-14T18:43:18.521096] [INFO ] [MAIN ] KFY: Full history saved. [2025-09-14T18:43:18.521222] [INFO ] [MAIN ] Update Progress: 1190/2370 symbols completed. KFY took 20.4s. Estimated remaining: 2h 5m 3s. Rate: 9.4 symbols/min [2025-09-14T18:43:18.694128] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:43:18.720534] [DEBUG] [LOCAL ] KIM: Loaded 23670 existing records from primary storage. [2025-09-14T18:43:18.720756] [INFO ] [MAIN ] KIM: Loaded 23670 existing records. [2025-09-14T18:43:18.899040] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:43:18.899300] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-09-14T18:43:18.899359] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-09-14T18:43:18.900072] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-09-14T18:43:18.900143] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-09-14T18:43:18.963914] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-09-14T18:43:19.261320] [INFO ] [REMOTE ] KIM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:43:19.377840] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-14T18:43:19.758901] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-09-14T18:43:20.464182] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T18:43:20.558831] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-09-14T18:43:21.358804] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-09-14T18:43:21.456100] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-14T18:43:22.164214] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-09-14T18:43:22.173742] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-14T18:43:22.232036] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T18:43:22.958829] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-09-14T18:43:23.701073] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-14T18:43:23.758803] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-09-14T18:43:24.558833] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-09-14T18:43:25.187472] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-14T18:43:25.358780] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-09-14T18:43:25.711954] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T18:43:26.158842] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-09-14T18:43:26.542626] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-14T18:43:26.958806] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-09-14T18:43:27.386898] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-14T18:43:27.758815] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-09-14T18:43:27.992036] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-14T18:43:27.995050] [INFO ] [REMOTE ] KFRC: Full fetch complete (20121 records). [2025-09-14T18:43:27.995162] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-09-14T18:43:28.312660] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-14T18:43:28.405841] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-09-14T18:43:28.405940] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-09-14T18:43:28.406437] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-09-14T18:43:28.406502] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-09-14T18:43:28.407396] [DEBUG] [LOCAL ] KFRC: Trimmed 20121 records to 14958 (keeping 150 days of data) [2025-09-14T18:43:28.512264] [DEBUG] [LOCAL ] KFRC: Primary data saved (14958 records). [2025-09-14T18:43:28.512431] [INFO ] [MAIN ] KFRC: Full history saved. [2025-09-14T18:43:28.512546] [INFO ] [MAIN ] Update Progress: 1191/2370 symbols completed. KFRC took 41.9s. Estimated remaining: 2h 5m 0s. Rate: 9.4 symbols/min [2025-09-14T18:43:28.566543] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-09-14T18:43:28.688109] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:43:28.700569] [DEBUG] [LOCAL ] KIO: Loaded 9970 existing records from primary storage. [2025-09-14T18:43:28.700740] [INFO ] [MAIN ] KIO: Loaded 9970 existing records. [2025-09-14T18:43:28.879109] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:43:28.879372] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-09-14T18:43:28.879430] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-09-14T18:43:28.879807] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-09-14T18:43:28.879866] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-09-14T18:43:29.227314] [INFO ] [REMOTE ] KIO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:43:29.342623] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T18:43:29.358778] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-09-14T18:43:30.158815] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-09-14T18:43:30.709936] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-14T18:43:30.958852] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-09-14T18:43:31.032059] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T18:43:31.579020] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-14T18:43:31.758834] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-09-14T18:43:32.558832] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-09-14T18:43:33.133755] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-14T18:43:33.358870] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-09-14T18:43:33.653812] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-14T18:43:33.893759] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T18:43:34.158858] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-09-14T18:43:34.958834] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-09-14T18:43:35.251058] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-14T18:43:35.256624] [INFO ] [REMOTE ] KGC: Full fetch complete (58377 records). [2025-09-14T18:43:35.256776] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-09-14T18:43:35.588065] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-14T18:43:35.690432] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-09-14T18:43:35.690591] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-09-14T18:43:35.691855] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-09-14T18:43:35.691925] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-09-14T18:43:35.693682] [DEBUG] [LOCAL ] KGC: Trimmed 58377 records to 40440 (keeping 150 days of data) [2025-09-14T18:43:35.772204] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-09-14T18:43:36.017256] [DEBUG] [LOCAL ] KGC: Primary data saved (40440 records). [2025-09-14T18:43:36.017513] [INFO ] [MAIN ] KGC: Full history saved. [2025-09-14T18:43:36.017804] [INFO ] [MAIN ] Update Progress: 1192/2370 symbols completed. KGC took 28.4s. Estimated remaining: 2h 4m 55s. Rate: 9.4 symbols/min [2025-09-14T18:43:36.204162] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:43:36.229322] [DEBUG] [LOCAL ] KKR: Loaded 23973 existing records from primary storage. [2025-09-14T18:43:36.229507] [INFO ] [MAIN ] KKR: Loaded 23973 existing records. [2025-09-14T18:43:36.405029] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:43:36.405369] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-09-14T18:43:36.405433] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-09-14T18:43:36.406378] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-09-14T18:43:36.406445] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-09-14T18:43:36.560314] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-09-14T18:43:36.761397] [INFO ] [REMOTE ] KKR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:43:36.792618] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T18:43:37.128732] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-14T18:43:37.358781] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-09-14T18:43:37.748085] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T18:43:38.158842] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-09-14T18:43:38.958845] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-09-14T18:43:39.081216] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T18:43:39.105884] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-14T18:43:39.758811] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-09-14T18:43:39.841618] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-14T18:43:40.558856] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-09-14T18:43:41.015579] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-14T18:43:41.020887] [INFO ] [REMOTE ] KGS: Full fetch complete (49537 records). [2025-09-14T18:43:41.021012] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-09-14T18:43:41.381214] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-09-14T18:43:41.398396] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-09-14T18:43:41.398509] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-09-14T18:43:41.399325] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-09-14T18:43:41.399498] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-09-14T18:43:41.400699] [DEBUG] [LOCAL ] KGS: Trimmed 49537 records to 34220 (keeping 150 days of data) [2025-09-14T18:43:41.624625] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T18:43:41.651542] [DEBUG] [LOCAL ] KGS: Primary data saved (34220 records). [2025-09-14T18:43:41.651757] [INFO ] [MAIN ] KGS: Full history saved. [2025-09-14T18:43:41.651894] [INFO ] [MAIN ] Update Progress: 1193/2370 symbols completed. KGS took 27.1s. Estimated remaining: 2h 4m 48s. Rate: 9.4 symbols/min [2025-09-14T18:43:41.836636] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:43:41.852491] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-14T18:43:41.859965] [DEBUG] [LOCAL ] KKRS: Loaded 2258 existing records from primary storage. [2025-09-14T18:43:41.860215] [INFO ] [MAIN ] KKRS: Loaded 2258 existing records. [2025-09-14T18:43:41.902424] [INFO ] [REMOTE ] KIM: Full fetch complete (57707 records). [2025-09-14T18:43:41.934145] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-09-14T18:43:42.183326] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-09-14T18:43:42.183249] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:43:42.233704] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-09-14T18:43:42.253729] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-09-14T18:43:42.318605] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-09-14T18:43:42.348087] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-09-14T18:43:42.597562] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-09-14T18:43:42.661349] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-09-14T18:43:42.698749] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-09-14T18:43:42.717004] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-09-14T18:43:42.765361] [DEBUG] [LOCAL ] KIM: Trimmed 57707 records to 39911 (keeping 150 days of data) [2025-09-14T18:43:42.800639] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:43:42.983711] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-09-14T18:43:43.066597] [DEBUG] [LOCAL ] KIM: Primary data saved (39911 records). [2025-09-14T18:43:43.066827] [INFO ] [MAIN ] KIM: Full history saved. [2025-09-14T18:43:43.066956] [INFO ] [MAIN ] Update Progress: 1194/2370 symbols completed. KIM took 24.5s. Estimated remaining: 2h 4m 37s. Rate: 9.4 symbols/min [2025-09-14T18:43:43.246861] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:43:43.254583] [DEBUG] [LOCAL ] KKRT: Loaded 5715 existing records from primary storage. [2025-09-14T18:43:43.254765] [INFO ] [MAIN ] KKRT: Loaded 5715 existing records. [2025-09-14T18:43:43.435275] [WARN ] [MAIN ] KKRT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:43:43.435880] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-09-14T18:43:43.435970] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-14T18:43:43.436489] [DEBUG] [LOCAL ] KKRT: Deleted primary data file. [2025-09-14T18:43:43.436686] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-09-14T18:43:43.545537] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-14T18:43:43.750786] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-14T18:43:43.766898] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-09-14T18:43:43.835294] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:43:44.558858] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-09-14T18:43:44.812204] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T18:43:45.243144] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-14T18:43:45.358851] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-09-14T18:43:46.143547] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-14T18:43:46.158819] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-09-14T18:43:46.902559] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-14T18:43:46.958858] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-09-14T18:43:47.610677] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-14T18:43:47.758922] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-09-14T18:43:48.558806] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-09-14T18:43:48.949856] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-14T18:43:49.006467] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-14T18:43:49.358855] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-02. [2025-09-14T18:43:49.601566] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:43:49.601967] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-02 [2025-09-14T18:43:50.158884] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-09-14T18:43:50.789461] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-14T18:43:50.958895] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-03. [2025-09-14T18:43:51.227078] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:43:51.227430] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-03 [2025-09-14T18:43:51.758829] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-09-14T18:43:52.558804] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-09-14T18:43:52.776471] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-14T18:43:52.778885] [INFO ] [REMOTE ] KIO: Full fetch complete (23492 records). [2025-09-14T18:43:52.778976] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-09-14T18:43:53.147519] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-09-14T18:43:53.147688] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-09-14T18:43:53.148283] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-09-14T18:43:53.148346] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-09-14T18:43:53.149345] [DEBUG] [LOCAL ] KIO: Trimmed 23492 records to 15563 (keeping 150 days of data) [2025-09-14T18:43:53.246611] [DEBUG] [LOCAL ] KIO: Primary data saved (15563 records). [2025-09-14T18:43:53.246802] [INFO ] [MAIN ] KIO: Full history saved. [2025-09-14T18:43:53.246932] [INFO ] [MAIN ] Update Progress: 1195/2370 symbols completed. KIO took 24.7s. Estimated remaining: 2h 4m 34s. Rate: 9.4 symbols/min [2025-09-14T18:43:53.364461] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-04. [2025-09-14T18:43:53.419632] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:43:53.423520] [DEBUG] [LOCAL ] KLAR: Loaded 953 existing records from primary storage. [2025-09-14T18:43:53.423628] [INFO ] [MAIN ] KLAR: Loaded 953 existing records. [2025-09-14T18:43:53.607801] [WARN ] [MAIN ] KLAR: Insufficient historical data. Have data from 2025-09-10, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:43:53.608218] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-09-14T18:43:53.608516] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-14T18:43:53.620224] [DEBUG] [LOCAL ] KLAR: Deleted primary data file. [2025-09-14T18:43:53.636425] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-09-14T18:43:53.705340] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:43:53.712699] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-14T18:43:53.735518] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-04 [2025-09-14T18:43:54.014204] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:43:54.158826] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-05. [2025-09-14T18:43:54.598975] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-14T18:43:54.958839] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-02. [2025-09-14T18:43:55.242227] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:43:55.242578] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-02 [2025-09-14T18:43:55.758903] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-09-14T18:43:56.558861] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-09-14T18:43:56.734770] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-14T18:43:57.136822] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T18:43:57.138547] [INFO ] [REMOTE ] KKRS: Full fetch complete (6320 records). [2025-09-14T18:43:57.138728] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-09-14T18:43:57.369242] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-06. [2025-09-14T18:43:57.729628] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-09-14T18:43:57.729813] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-09-14T18:43:57.730201] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-09-14T18:43:57.730298] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-09-14T18:43:57.731067] [DEBUG] [LOCAL ] KKRS: Trimmed 6320 records to 4649 (keeping 150 days of data) [2025-09-14T18:43:57.769166] [DEBUG] [LOCAL ] KKRS: Primary data saved (4649 records). [2025-09-14T18:43:57.769467] [INFO ] [MAIN ] KKRS: Full history saved. [2025-09-14T18:43:57.769672] [INFO ] [MAIN ] Update Progress: 1196/2370 symbols completed. KKRS took 16.1s. Estimated remaining: 2h 4m 26s. Rate: 9.4 symbols/min [2025-09-14T18:43:58.006382] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:43:58.025705] [DEBUG] [LOCAL ] KLC: Loaded 15947 existing records from primary storage. [2025-09-14T18:43:58.025932] [INFO ] [MAIN ] KLC: Loaded 15947 existing records. [2025-09-14T18:43:58.163941] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-09-14T18:43:58.228534] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:43:58.228797] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-09-14T18:43:58.228858] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-09-14T18:43:58.229278] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-09-14T18:43:58.229337] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-09-14T18:43:58.593329] [INFO ] [REMOTE ] KLC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:43:58.609447] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-14T18:43:58.958832] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-09-14T18:43:59.181257] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-14T18:43:59.758850] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-03. [2025-09-14T18:43:59.998055] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:43:59.998415] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-03 [2025-09-14T18:44:00.170932] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-14T18:44:00.558849] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-09-14T18:44:01.358836] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-07. [2025-09-14T18:44:01.673701] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T18:44:02.158794] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-09-14T18:44:02.387167] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-14T18:44:02.958844] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-08. [2025-09-14T18:44:03.649828] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-14T18:44:03.758795] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-09-14T18:44:03.778013] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T18:44:04.558857] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-09. [2025-09-14T18:44:05.269902] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T18:44:05.284613] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T18:44:05.286088] [INFO ] [REMOTE ] KKRT: Full fetch complete (7851 records). [2025-09-14T18:44:05.286176] [DEBUG] [VALIDATOR ] KKRT: Validating primary data. [2025-09-14T18:44:05.363886] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-04. [2025-09-14T18:44:05.469047] [WARN ] [VALIDATOR ] KKRT: Validation failed - insufficient historical data. Have 73 unique days, need 150 days [2025-09-14T18:44:05.469347] [FATAL] [MAIN ] KKRT: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:44:05.469420] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:44:05.469478] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-14T18:44:05.469561] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-14T18:44:05.469623] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-09-14T18:44:05.469703] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-09-14T18:44:05.469801] [INFO ] [MAIN ] Update Progress: 1197/2370 symbols completed. KKRT took 22.4s. Estimated remaining: 2h 4m 21s. Rate: 9.4 symbols/min [2025-09-14T18:44:05.689362] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:44:05.689757] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-04 [2025-09-14T18:44:06.158865] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-09-14T18:44:06.958835] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-09-14T18:44:07.230575] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-14T18:44:07.758835] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-05. [2025-09-14T18:44:08.005836] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:44:08.006194] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-05 [2025-09-14T18:44:08.369700] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-14T18:44:08.558848] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-09-14T18:44:09.250770] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:44:09.256396] [INFO ] [REMOTE ] KKR: Full fetch complete (58204 records). [2025-09-14T18:44:09.256555] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-09-14T18:44:09.359227] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-06. [2025-09-14T18:44:09.641170] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-09-14T18:44:09.641276] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-09-14T18:44:09.642205] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-09-14T18:44:09.642266] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-09-14T18:44:09.643505] [DEBUG] [LOCAL ] KKR: Trimmed 58204 records to 40272 (keeping 150 days of data) [2025-09-14T18:44:09.703162] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:44:09.743845] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-06 [2025-09-14T18:44:09.922118] [DEBUG] [LOCAL ] KKR: Primary data saved (40272 records). [2025-09-14T18:44:09.922280] [INFO ] [MAIN ] KKR: Full history saved. [2025-09-14T18:44:09.922380] [INFO ] [MAIN ] Update Progress: 1198/2370 symbols completed. KKR took 33.9s. Estimated remaining: 2h 4m 13s. Rate: 9.4 symbols/min [2025-09-14T18:44:10.158913] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-09-14T18:44:10.958930] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-07. [2025-09-14T18:44:11.221433] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:44:11.221823] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-07 [2025-09-14T18:44:11.562848] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-14T18:44:11.758892] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-08. [2025-09-14T18:44:12.004934] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:44:12.005300] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-08 [2025-09-14T18:44:12.558825] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-09. [2025-09-14T18:44:13.079809] [INFO ] [REMOTE ] KLAR: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T18:44:13.081633] [INFO ] [REMOTE ] KLAR: Full fetch complete (953 records). [2025-09-14T18:44:13.081732] [DEBUG] [VALIDATOR ] KLAR: Validating primary data. [2025-09-14T18:44:13.255736] [WARN ] [VALIDATOR ] KLAR: Validation failed - insufficient historical data. Have 3 unique days, need 150 days [2025-09-14T18:44:13.255942] [FATAL] [MAIN ] KLAR: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:44:13.255996] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:44:13.256043] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-14T18:44:13.256173] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-14T18:44:13.256235] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-09-14T18:44:13.256303] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-09-14T18:44:13.256449] [INFO ] [MAIN ] Update Progress: 1199/2370 symbols completed. KLAR took 20.0s. Estimated remaining: 2h 4m 4s. Rate: 9.4 symbols/min [2025-09-14T18:44:13.358791] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-09-14T18:44:14.801942] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T18:44:14.809699] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-09-14T18:44:16.277207] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T18:44:16.285766] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-09-14T18:44:17.593707] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-14T18:44:17.597985] [INFO ] [REMOTE ] KLC: Full fetch complete (38290 records). [2025-09-14T18:44:17.598156] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-09-14T18:44:17.986245] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-09-14T18:44:17.986429] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-09-14T18:44:17.987125] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-09-14T18:44:17.987190] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-09-14T18:44:17.988083] [DEBUG] [LOCAL ] KLC: Trimmed 38290 records to 26667 (keeping 150 days of data) [2025-09-14T18:44:18.144003] [DEBUG] [LOCAL ] KLC: Primary data saved (26667 records). [2025-09-14T18:44:18.144168] [INFO ] [MAIN ] KLC: Full history saved. [2025-09-14T18:44:18.144276] [INFO ] [MAIN ] Update Progress: 1200/2370 symbols completed. KLC took 20.4s. Estimated remaining: 2h 3m 56s. Rate: 9.4 symbols/min [2025-09-14T18:44:18.761173] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:44:18.904621] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:44:18.933960] [INFO ] [MAIN ] KLG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:44:18.945577] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:44:18.954186] [DEBUG] [LOCAL ] KMPB: Loaded 1684 existing records from primary storage. [2025-09-14T18:44:18.954599] [INFO ] [MAIN ] KMPB: Loaded 1684 existing records. [2025-09-14T18:44:19.197021] [DEBUG] [LOCAL ] KMI: Loaded 24055 existing records from primary storage. [2025-09-14T18:44:19.202343] [DEBUG] [LOCAL ] KLG: Loaded 18758 existing records from primary storage. [2025-09-14T18:44:19.203631] [DEBUG] [LOCAL ] KMPR: Loaded 19234 existing records from primary storage. [2025-09-14T18:44:19.245003] [INFO ] [MAIN ] KLG: Loaded 18758 existing records. [2025-09-14T18:44:19.224095] [INFO ] [MAIN ] KMI: Loaded 24055 existing records. [2025-09-14T18:44:19.284584] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:44:19.290001] [INFO ] [MAIN ] KMPR: Loaded 19234 existing records. [2025-09-14T18:44:19.446168] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-09-14T18:44:19.490740] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-09-14T18:44:19.592293] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-09-14T18:44:19.662559] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-09-14T18:44:19.819112] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:44:19.885827] [WARN ] [MAIN ] KLG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:44:19.900047] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:44:19.921826] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-09-14T18:44:19.958505] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-09-14T18:44:19.942707] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-09-14T18:44:19.953182] [INFO ] [MAIN ] KLG: Wiping existing primary data before full refresh. [2025-09-14T18:44:19.959080] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-09-14T18:44:19.959290] [INFO ] [LOCAL ] KLG: Starting deletion of primary data. [2025-09-14T18:44:19.970343] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-09-14T18:44:19.973711] [DEBUG] [LOCAL ] KLG: Deleted primary data file. [2025-09-14T18:44:19.984551] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-09-14T18:44:19.964720] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-09-14T18:44:20.000189] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-09-14T18:44:20.011433] [INFO ] [MAIN ] KLG: Starting full primary refresh. [2025-09-14T18:44:20.987406] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:44:21.082047] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-09-14T18:44:21.194564] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:44:21.252833] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-09-14T18:44:21.291600] [INFO ] [REMOTE ] KMI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:44:21.355091] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-09-14T18:44:21.369548] [INFO ] [REMOTE ] KLG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:44:21.372072] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-02. [2025-09-14T18:44:21.838793] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-14T18:44:21.840115] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-09-14T18:44:22.469130] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-14T18:44:22.470967] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-09-14T18:44:22.681118] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T18:44:22.687359] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-09-14T18:44:22.807088] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T18:44:22.815893] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-03. [2025-09-14T18:44:23.073313] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-14T18:44:23.074808] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-09-14T18:44:23.551920] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-14T18:44:23.562337] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-09-14T18:44:23.610312] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-14T18:44:23.758869] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-09-14T18:44:23.830077] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-14T18:44:24.384806] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-14T18:44:24.538257] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T18:44:24.558811] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-04. [2025-09-14T18:44:25.358852] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-09-14T18:44:25.607813] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-14T18:44:25.945811] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-14T18:44:26.160668] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-09-14T18:44:26.167744] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-14T18:44:26.958838] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-09-14T18:44:27.758841] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-09-14T18:44:28.280249] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-14T18:44:28.298140] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-14T18:44:28.547494] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T18:44:28.558764] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-09-14T18:44:29.358846] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-05. [2025-09-14T18:44:29.987385] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-14T18:44:30.158833] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-09-14T18:44:30.958830] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-09-14T18:44:31.003448] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-14T18:44:31.505019] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T18:44:31.505922] [INFO ] [REMOTE ] KMPB: Full fetch complete (3837 records). [2025-09-14T18:44:31.506005] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-09-14T18:44:31.763941] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-09-14T18:44:31.869390] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-09-14T18:44:31.869492] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-09-14T18:44:31.869638] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-09-14T18:44:31.869727] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-09-14T18:44:31.870129] [DEBUG] [LOCAL ] KMPB: Trimmed 3837 records to 2589 (keeping 150 days of data) [2025-09-14T18:44:31.886948] [DEBUG] [LOCAL ] KMPB: Primary data saved (2589 records). [2025-09-14T18:44:31.887039] [INFO ] [MAIN ] KMPB: Full history saved. [2025-09-14T18:44:31.887138] [INFO ] [MAIN ] Update Progress: 1201/2370 symbols completed. KMPB took 13.7s. Estimated remaining: 2h 3m 57s. Rate: 9.4 symbols/min [2025-09-14T18:44:32.062608] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:44:32.084986] [DEBUG] [LOCAL ] KMT: Loaded 19389 existing records from primary storage. [2025-09-14T18:44:32.085250] [INFO ] [MAIN ] KMT: Loaded 19389 existing records. [2025-09-14T18:44:32.278166] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:44:32.278557] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-09-14T18:44:32.278743] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-09-14T18:44:32.279724] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-09-14T18:44:32.279800] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-09-14T18:44:32.490051] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-14T18:44:32.567301] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-06. [2025-09-14T18:44:32.701029] [INFO ] [REMOTE ] KMT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:44:33.333177] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T18:44:33.358771] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-09-14T18:44:34.053946] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-14T18:44:34.158775] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-07. [2025-09-14T18:44:34.950174] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T18:44:34.958790] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-09-14T18:44:35.758848] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-09-14T18:44:35.804883] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-14T18:44:36.558814] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-08. [2025-09-14T18:44:36.851813] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-14T18:44:37.069184] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-14T18:44:37.358923] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-09-14T18:44:38.015600] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:44:38.020298] [INFO ] [REMOTE ] KMPR: Full fetch complete (39728 records). [2025-09-14T18:44:38.020423] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-09-14T18:44:38.160436] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-09-14T18:44:38.423021] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-09-14T18:44:38.423883] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T18:44:38.424017] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-09-14T18:44:38.435211] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-09-14T18:44:38.435470] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-09-14T18:44:38.436819] [DEBUG] [LOCAL ] KMPR: Trimmed 39728 records to 29412 (keeping 150 days of data) [2025-09-14T18:44:38.619607] [DEBUG] [LOCAL ] KMPR: Primary data saved (29412 records). [2025-09-14T18:44:38.619782] [INFO ] [MAIN ] KMPR: Full history saved. [2025-09-14T18:44:38.619896] [INFO ] [MAIN ] Update Progress: 1202/2370 symbols completed. KMPR took 20.5s. Estimated remaining: 2h 3m 51s. Rate: 9.4 symbols/min [2025-09-14T18:44:38.789317] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:44:38.815423] [DEBUG] [LOCAL ] KMX: Loaded 23801 existing records from primary storage. [2025-09-14T18:44:38.815630] [INFO ] [MAIN ] KMX: Loaded 23801 existing records. [2025-09-14T18:44:38.965461] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-09. [2025-09-14T18:44:38.993445] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:44:38.993598] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-09-14T18:44:38.993694] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-09-14T18:44:38.994350] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-09-14T18:44:38.994409] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-09-14T18:44:39.349710] [INFO ] [REMOTE ] KMX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:44:39.708805] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T18:44:39.712936] [INFO ] [REMOTE ] KLG: Full fetch complete (45848 records). [2025-09-14T18:44:39.713033] [DEBUG] [VALIDATOR ] KLG: Validating primary data. [2025-09-14T18:44:39.767132] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-09-14T18:44:40.095033] [DEBUG] [VALIDATOR ] KLG: All expected trading days are present. [2025-09-14T18:44:40.095204] [DEBUG] [VALIDATOR ] KLG: Primary data validation passed. [2025-09-14T18:44:40.096231] [INFO ] [MAIN ] KLG: Fetched primary data is valid. [2025-09-14T18:44:40.096323] [DEBUG] [LOCAL ] KLG: Saving primary data. [2025-09-14T18:44:40.121002] [DEBUG] [LOCAL ] KLG: Trimmed 45848 records to 31211 (keeping 150 days of data) [2025-09-14T18:44:40.120868] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-14T18:44:40.320345] [DEBUG] [LOCAL ] KLG: Primary data saved (31211 records). [2025-09-14T18:44:40.320513] [INFO ] [MAIN ] KLG: Full history saved. [2025-09-14T18:44:40.320623] [INFO ] [MAIN ] Update Progress: 1203/2370 symbols completed. KLG took 22.2s. Estimated remaining: 2h 3m 40s. Rate: 9.4 symbols/min [2025-09-14T18:44:40.489149] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:44:40.507576] [DEBUG] [LOCAL ] KN: Loaded 16594 existing records from primary storage. [2025-09-14T18:44:40.507761] [INFO ] [MAIN ] KN: Loaded 16594 existing records. [2025-09-14T18:44:40.570347] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-09-14T18:44:40.686630] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:44:40.686880] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-09-14T18:44:40.686937] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-09-14T18:44:40.687388] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-09-14T18:44:40.687447] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-09-14T18:44:41.038161] [INFO ] [REMOTE ] KN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:44:41.358827] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-09-14T18:44:41.544389] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-14T18:44:42.158868] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-09-14T18:44:42.385479] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-14T18:44:42.803413] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-14T18:44:42.959161] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-09-14T18:44:43.764810] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-09-14T18:44:43.778575] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-14T18:44:44.177750] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-14T18:44:44.558953] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-09-14T18:44:45.358866] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-09-14T18:44:45.602745] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-14T18:44:46.158913] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-09-14T18:44:46.695369] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-14T18:44:46.821256] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-14T18:44:46.958905] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-09-14T18:44:47.758815] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-09-14T18:44:47.998923] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T18:44:48.037832] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-14T18:44:48.558838] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-09-14T18:44:49.358893] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-09-14T18:44:49.858473] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-14T18:44:50.158921] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-09-14T18:44:50.623007] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-14T18:44:50.767664] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-14T18:44:50.958898] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-09-14T18:44:51.613030] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:44:51.619597] [INFO ] [REMOTE ] KMI: Full fetch complete (58373 records). [2025-09-14T18:44:51.619860] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-09-14T18:44:51.763949] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-09-14T18:44:52.030158] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-09-14T18:44:52.030333] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-09-14T18:44:52.031443] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-09-14T18:44:52.031617] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-09-14T18:44:52.056766] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-14T18:44:52.065954] [DEBUG] [LOCAL ] KMI: Trimmed 58373 records to 40433 (keeping 150 days of data) [2025-09-14T18:44:52.345451] [DEBUG] [LOCAL ] KMI: Primary data saved (40433 records). [2025-09-14T18:44:52.345709] [INFO ] [MAIN ] KMI: Full history saved. [2025-09-14T18:44:52.345890] [INFO ] [MAIN ] Update Progress: 1204/2370 symbols completed. KMI took 34.2s. Estimated remaining: 2h 3m 39s. Rate: 9.4 symbols/min [2025-09-14T18:44:52.520233] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:44:52.537805] [DEBUG] [LOCAL ] KNF: Loaded 16938 existing records from primary storage. [2025-09-14T18:44:52.537997] [INFO ] [MAIN ] KNF: Loaded 16938 existing records. [2025-09-14T18:44:52.569077] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-09-14T18:44:52.737397] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:44:52.737713] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-09-14T18:44:52.737794] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-09-14T18:44:52.738369] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-09-14T18:44:52.738431] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-09-14T18:44:53.101782] [INFO ] [REMOTE ] KNF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:44:53.366606] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-09-14T18:44:53.369031] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T18:44:54.158890] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-09-14T18:44:54.478000] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-14T18:44:54.949832] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T18:44:54.958773] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-09-14T18:44:55.647336] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-14T18:44:55.758827] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-09-14T18:44:56.112929] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-14T18:44:56.558840] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-09-14T18:44:57.349117] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T18:44:57.358912] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-09-14T18:44:57.717872] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-14T18:44:58.158859] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-09-14T18:44:58.969904] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-09-14T18:44:58.975226] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-14T18:44:59.465991] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-14T18:44:59.758879] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-09-14T18:45:00.558837] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-09-14T18:45:00.952675] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-14T18:45:00.981454] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-14T18:45:00.986202] [INFO ] [REMOTE ] KMT: Full fetch complete (46896 records). [2025-09-14T18:45:00.986325] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-09-14T18:45:01.363165] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-09-14T18:45:01.378117] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-09-14T18:45:01.378361] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-09-14T18:45:01.379604] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-09-14T18:45:01.379732] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-09-14T18:45:01.382009] [DEBUG] [LOCAL ] KMT: Trimmed 46896 records to 32243 (keeping 150 days of data) [2025-09-14T18:45:01.510771] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T18:45:01.645668] [DEBUG] [LOCAL ] KMT: Primary data saved (32243 records). [2025-09-14T18:45:01.645961] [INFO ] [MAIN ] KMT: Full history saved. [2025-09-14T18:45:01.646158] [INFO ] [MAIN ] Update Progress: 1205/2370 symbols completed. KMT took 29.8s. Estimated remaining: 2h 3m 35s. Rate: 9.4 symbols/min [2025-09-14T18:45:01.857131] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:45:01.864822] [DEBUG] [LOCAL ] KNOP: Loaded 4043 existing records from primary storage. [2025-09-14T18:45:01.865017] [INFO ] [MAIN ] KNOP: Loaded 4043 existing records. [2025-09-14T18:45:02.069600] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:45:02.070090] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-09-14T18:45:02.070164] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-09-14T18:45:02.070712] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-09-14T18:45:02.070797] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-09-14T18:45:02.164223] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-09-14T18:45:02.478012] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:45:02.958909] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-09-14T18:45:03.758959] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-09-14T18:45:05.352942] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-14T18:45:05.357386] [INFO ] [REMOTE ] KN: Full fetch complete (42904 records). [2025-09-14T18:45:05.357494] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-09-14T18:45:05.770074] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-09-14T18:45:05.770361] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-09-14T18:45:05.771187] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-09-14T18:45:05.771303] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-09-14T18:45:05.772434] [DEBUG] [LOCAL ] KN: Trimmed 42904 records to 28476 (keeping 150 days of data) [2025-09-14T18:45:05.900037] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (3.74 seconds). [2025-09-14T18:45:05.911312] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-09-14T18:45:05.985479] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-14T18:45:05.988495] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-09-14T18:45:06.002399] [DEBUG] [LOCAL ] KN: Primary data saved (28476 records). [2025-09-14T18:45:06.002526] [INFO ] [MAIN ] KN: Full history saved. [2025-09-14T18:45:06.002628] [INFO ] [MAIN ] Update Progress: 1206/2370 symbols completed. KN took 25.7s. Estimated remaining: 2h 3m 27s. Rate: 9.4 symbols/min [2025-09-14T18:45:06.178971] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:45:06.189205] [DEBUG] [LOCAL ] KNSL: Loaded 8519 existing records from primary storage. [2025-09-14T18:45:06.189372] [INFO ] [MAIN ] KNSL: Loaded 8519 existing records. [2025-09-14T18:45:06.364208] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:45:06.364479] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-09-14T18:45:06.364538] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-09-14T18:45:06.364896] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-09-14T18:45:06.364958] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-09-14T18:45:06.727629] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:45:06.728234] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-09-14T18:45:06.762889] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (5.40 seconds). [2025-09-14T18:45:06.857306] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T18:45:06.958829] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-09-14T18:45:07.523963] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-14T18:45:07.722669] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:45:07.728213] [INFO ] [REMOTE ] KMX: Full fetch complete (57319 records). [2025-09-14T18:45:07.728334] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-09-14T18:45:07.763996] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-09-14T18:45:08.133419] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-09-14T18:45:08.144940] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-09-14T18:45:08.146059] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-09-14T18:45:08.146679] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-09-14T18:45:08.147133] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-14T18:45:08.153427] [DEBUG] [LOCAL ] KMX: Trimmed 57319 records to 40060 (keeping 150 days of data) [2025-09-14T18:45:08.394786] [DEBUG] [LOCAL ] KMX: Primary data saved (40060 records). [2025-09-14T18:45:08.394953] [INFO ] [MAIN ] KMX: Full history saved. [2025-09-14T18:45:08.395073] [INFO ] [MAIN ] Update Progress: 1207/2370 symbols completed. KMX took 29.8s. Estimated remaining: 2h 3m 17s. Rate: 9.4 symbols/min [2025-09-14T18:45:08.567012] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-09-14T18:45:08.596045] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:45:08.618855] [DEBUG] [LOCAL ] KNTK: Loaded 21067 existing records from primary storage. [2025-09-14T18:45:08.619035] [INFO ] [MAIN ] KNTK: Loaded 21067 existing records. [2025-09-14T18:45:08.813378] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:45:08.813669] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-09-14T18:45:08.813733] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-09-14T18:45:08.814466] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-09-14T18:45:08.814537] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-09-14T18:45:09.094741] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-14T18:45:09.194168] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:45:09.358838] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-09-14T18:45:09.701888] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-14T18:45:10.158845] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-09-14T18:45:10.711573] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-14T18:45:10.958834] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-09-14T18:45:11.758885] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-09-14T18:45:11.822542] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T18:45:11.865012] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T18:45:12.260802] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T18:45:12.265148] [INFO ] [REMOTE ] KNF: Full fetch complete (38637 records). [2025-09-14T18:45:12.265309] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-09-14T18:45:12.563946] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-09-14T18:45:12.650414] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-09-14T18:45:12.650521] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-09-14T18:45:12.651238] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-09-14T18:45:12.651298] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-09-14T18:45:12.652500] [DEBUG] [LOCAL ] KNF: Trimmed 38637 records to 26885 (keeping 150 days of data) [2025-09-14T18:45:12.833320] [DEBUG] [LOCAL ] KNF: Primary data saved (26885 records). [2025-09-14T18:45:12.833494] [INFO ] [MAIN ] KNF: Full history saved. [2025-09-14T18:45:12.833611] [INFO ] [MAIN ] Update Progress: 1208/2370 symbols completed. KNF took 20.5s. Estimated remaining: 2h 3m 9s. Rate: 9.4 symbols/min [2025-09-14T18:45:13.007565] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:45:13.029840] [DEBUG] [LOCAL ] KNX: Loaded 23430 existing records from primary storage. [2025-09-14T18:45:13.030008] [INFO ] [MAIN ] KNX: Loaded 23430 existing records. [2025-09-14T18:45:13.204077] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:45:13.204335] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-09-14T18:45:13.204394] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-09-14T18:45:13.205083] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-09-14T18:45:13.205155] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-09-14T18:45:13.365578] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-09-14T18:45:13.580366] [INFO ] [REMOTE ] KNX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:45:13.937375] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-14T18:45:14.158842] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-09-14T18:45:14.283355] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-14T18:45:14.958828] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-09-14T18:45:15.758839] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-09-14T18:45:15.978406] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-14T18:45:16.134502] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-14T18:45:16.558841] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-09-14T18:45:17.358834] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-09-14T18:45:17.905220] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-14T18:45:18.158858] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-09-14T18:45:18.275677] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T18:45:18.958850] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-09-14T18:45:19.041075] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-14T18:45:19.365239] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-14T18:45:19.758834] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-09-14T18:45:20.277036] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-14T18:45:20.293917] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T18:45:20.558840] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-09-14T18:45:21.358830] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-09-14T18:45:21.370141] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-14T18:45:21.373222] [INFO ] [REMOTE ] KNOP: Full fetch complete (10635 records). [2025-09-14T18:45:21.373356] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-09-14T18:45:21.743802] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-09-14T18:45:21.743947] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-09-14T18:45:21.744352] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-09-14T18:45:21.744439] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-09-14T18:45:21.745136] [DEBUG] [LOCAL ] KNOP: Trimmed 10635 records to 6675 (keeping 150 days of data) [2025-09-14T18:45:21.790438] [DEBUG] [LOCAL ] KNOP: Primary data saved (6675 records). [2025-09-14T18:45:21.790680] [INFO ] [MAIN ] KNOP: Full history saved. [2025-09-14T18:45:21.790962] [INFO ] [MAIN ] Update Progress: 1209/2370 symbols completed. KNOP took 20.1s. Estimated remaining: 2h 3m 5s. Rate: 9.4 symbols/min [2025-09-14T18:45:21.962976] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:45:21.990460] [DEBUG] [LOCAL ] KO: Loaded 24178 existing records from primary storage. [2025-09-14T18:45:21.990661] [INFO ] [MAIN ] KO: Loaded 24178 existing records. [2025-09-14T18:45:22.161470] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-09-14T18:45:22.164982] [WARN ] [MAIN ] KO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:45:22.166606] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-09-14T18:45:22.166716] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-14T18:45:22.167528] [DEBUG] [LOCAL ] KO: Deleted primary data file. [2025-09-14T18:45:22.167605] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-09-14T18:45:22.524027] [INFO ] [REMOTE ] KO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:45:22.958812] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-09-14T18:45:23.228894] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-14T18:45:23.294934] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-14T18:45:23.758827] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-09-14T18:45:24.558816] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-14T18:45:24.648464] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T18:45:25.358824] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-09-14T18:45:25.607533] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-14T18:45:25.904378] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T18:45:25.912209] [INFO ] [REMOTE ] KNSL: Full fetch complete (20039 records). [2025-09-14T18:45:25.912468] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-09-14T18:45:26.163926] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-09-14T18:45:26.287331] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-09-14T18:45:26.287460] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-09-14T18:45:26.288077] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-09-14T18:45:26.288150] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-09-14T18:45:26.289496] [DEBUG] [LOCAL ] KNSL: Trimmed 20039 records to 13657 (keeping 150 days of data) [2025-09-14T18:45:26.377832] [DEBUG] [LOCAL ] KNSL: Primary data saved (13657 records). [2025-09-14T18:45:26.378011] [INFO ] [MAIN ] KNSL: Full history saved. [2025-09-14T18:45:26.378160] [INFO ] [MAIN ] Update Progress: 1210/2370 symbols completed. KNSL took 20.4s. Estimated remaining: 2h 2m 57s. Rate: 9.4 symbols/min [2025-09-14T18:45:26.547699] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:45:26.568162] [DEBUG] [LOCAL ] KODK: Loaded 19615 existing records from primary storage. [2025-09-14T18:45:26.568343] [INFO ] [MAIN ] KODK: Loaded 19615 existing records. [2025-09-14T18:45:26.756502] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:45:26.756813] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-09-14T18:45:26.756877] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-09-14T18:45:26.757524] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-09-14T18:45:26.757600] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-09-14T18:45:26.969511] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-09-14T18:45:27.125151] [INFO ] [REMOTE ] KODK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:45:27.152280] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-09-14T18:45:27.622044] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T18:45:27.758827] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-14T18:45:28.558829] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-09-14T18:45:28.729054] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-14T18:45:29.358900] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-09-14T18:45:30.158796] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-09-14T18:45:30.485314] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-14T18:45:30.597450] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.84 seconds). [2025-09-14T18:45:30.958892] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-14T18:45:31.758831] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-09-14T18:45:31.864390] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-14T18:45:32.558866] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-09-14T18:45:32.882565] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-09-14T18:45:33.358846] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-09-14T18:45:33.827349] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-14T18:45:33.939449] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.98 seconds). [2025-09-14T18:45:34.011467] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-14T18:45:34.158850] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-09-14T18:45:34.868789] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T18:45:34.874387] [INFO ] [REMOTE ] KNX: Full fetch complete (57153 records). [2025-09-14T18:45:34.874571] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-09-14T18:45:34.966308] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-14T18:45:35.285116] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-09-14T18:45:35.285323] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-09-14T18:45:35.286415] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-09-14T18:45:35.286538] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-09-14T18:45:35.288015] [DEBUG] [LOCAL ] KNX: Trimmed 57153 records to 39453 (keeping 150 days of data) [2025-09-14T18:45:35.427232] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-14T18:45:35.588799] [DEBUG] [LOCAL ] KNX: Primary data saved (39453 records). [2025-09-14T18:45:35.588976] [INFO ] [MAIN ] KNX: Full history saved. [2025-09-14T18:45:35.589093] [INFO ] [MAIN ] Update Progress: 1211/2370 symbols completed. KNX took 22.8s. Estimated remaining: 2h 2m 53s. Rate: 9.4 symbols/min [2025-09-14T18:45:35.769022] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-09-14T18:45:35.772000] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:45:35.785895] [DEBUG] [LOCAL ] KOF: Loaded 11840 existing records from primary storage. [2025-09-14T18:45:35.786543] [INFO ] [MAIN ] KOF: Loaded 11840 existing records. [2025-09-14T18:45:35.964577] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:45:35.964927] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-09-14T18:45:35.964989] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-09-14T18:45:35.965847] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-09-14T18:45:35.965919] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-09-14T18:45:36.318039] [INFO ] [REMOTE ] KOF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:45:36.558896] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-09-14T18:45:37.358821] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-09-14T18:45:37.453308] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-14T18:45:37.745090] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-09-14T18:45:38.158897] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-14T18:45:38.222621] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T18:45:38.958850] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-09-14T18:45:39.037928] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T18:45:39.758897] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-09-14T18:45:40.558872] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-09-14T18:45:40.667549] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-14T18:45:40.752754] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T18:45:40.814219] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-14T18:45:41.358891] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-09-14T18:45:41.830482] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-14T18:45:41.835665] [INFO ] [REMOTE ] KNTK: Full fetch complete (49698 records). [2025-09-14T18:45:41.835791] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-09-14T18:45:42.171930] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-14T18:45:42.223328] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-09-14T18:45:42.223445] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-09-14T18:45:42.224340] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-09-14T18:45:42.224427] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-09-14T18:45:42.225704] [DEBUG] [LOCAL ] KNTK: Trimmed 49698 records to 35256 (keeping 150 days of data) [2025-09-14T18:45:42.458771] [DEBUG] [LOCAL ] KNTK: Primary data saved (35256 records). [2025-09-14T18:45:42.458961] [INFO ] [MAIN ] KNTK: Full history saved. [2025-09-14T18:45:42.459076] [INFO ] [MAIN ] Update Progress: 1212/2370 symbols completed. KNTK took 34.1s. Estimated remaining: 2h 2m 47s. Rate: 9.4 symbols/min [2025-09-14T18:45:42.630433] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:45:42.639707] [DEBUG] [LOCAL ] KOP: Loaded 7486 existing records from primary storage. [2025-09-14T18:45:42.639869] [INFO ] [MAIN ] KOP: Loaded 7486 existing records. [2025-09-14T18:45:42.832262] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:45:42.832750] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-09-14T18:45:42.833032] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-09-14T18:45:42.833588] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-09-14T18:45:42.833843] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-09-14T18:45:42.961954] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-09-14T18:45:42.966869] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T18:45:43.235579] [INFO ] [REMOTE ] KOP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:45:43.758855] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-09-14T18:45:44.180709] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-14T18:45:44.558855] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-09-14T18:45:44.765897] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-14T18:45:45.051192] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-09-14T18:45:45.358829] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-09-14T18:45:46.028292] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T18:45:46.158818] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-09-14T18:45:46.487844] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-14T18:45:46.958886] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-09-14T18:45:47.758879] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-09-14T18:45:48.006538] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-14T18:45:48.072507] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T18:45:48.558835] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-14T18:45:48.946847] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-14T18:45:49.358892] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-09-14T18:45:50.158885] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-09-14T18:45:50.511463] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-14T18:45:50.958845] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-09-14T18:45:51.196509] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-14T18:45:51.460082] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-14T18:45:51.603312] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-14T18:45:51.758887] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-09-14T18:45:52.558845] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-09-14T18:45:52.771931] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-14T18:45:53.358797] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-09-14T18:45:53.622754] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-14T18:45:54.158795] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-09-14T18:45:54.452951] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-14T18:45:54.456408] [INFO ] [REMOTE ] KOF: Full fetch complete (28624 records). [2025-09-14T18:45:54.456510] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-09-14T18:45:54.835007] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-09-14T18:45:54.835122] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-09-14T18:45:54.835828] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-09-14T18:45:54.835888] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-09-14T18:45:54.836756] [DEBUG] [LOCAL ] KOF: Trimmed 28624 records to 19800 (keeping 150 days of data) [2025-09-14T18:45:54.961048] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-09-14T18:45:54.961143] [DEBUG] [LOCAL ] KOF: Primary data saved (19800 records). [2025-09-14T18:45:54.962198] [INFO ] [MAIN ] KOF: Full history saved. [2025-09-14T18:45:54.962310] [INFO ] [MAIN ] Update Progress: 1213/2370 symbols completed. KOF took 19.4s. Estimated remaining: 2h 2m 47s. Rate: 9.4 symbols/min [2025-09-14T18:45:55.132167] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:45:55.134685] [DEBUG] [LOCAL ] KORE: Loaded 884 existing records from primary storage. [2025-09-14T18:45:55.134772] [INFO ] [MAIN ] KORE: Loaded 884 existing records. [2025-09-14T18:45:55.307887] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:45:55.308149] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-09-14T18:45:55.308207] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-09-14T18:45:55.308508] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-09-14T18:45:55.308570] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-09-14T18:45:55.661554] [INFO ] [REMOTE ] KORE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:45:55.758885] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-09-14T18:45:55.844503] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-14T18:45:55.890633] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-14T18:45:56.458899] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-14T18:45:56.558883] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-09-14T18:45:57.040963] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-14T18:45:57.358830] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-14T18:45:58.090882] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T18:45:58.096834] [INFO ] [REMOTE ] KO: Full fetch complete (58498 records). [2025-09-14T18:45:58.097071] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-09-14T18:45:58.164889] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-09-14T18:45:58.496120] [DEBUG] [VALIDATOR ] KO: All expected trading days are present. [2025-09-14T18:45:58.496224] [DEBUG] [VALIDATOR ] KO: Primary data validation passed. [2025-09-14T18:45:58.497113] [INFO ] [MAIN ] KO: Fetched primary data is valid. [2025-09-14T18:45:58.497170] [DEBUG] [LOCAL ] KO: Saving primary data. [2025-09-14T18:45:58.498399] [DEBUG] [LOCAL ] KO: Trimmed 58498 records to 40558 (keeping 150 days of data) [2025-09-14T18:45:58.778850] [DEBUG] [LOCAL ] KO: Primary data saved (40558 records). [2025-09-14T18:45:58.779006] [INFO ] [MAIN ] KO: Full history saved. [2025-09-14T18:45:58.779101] [INFO ] [MAIN ] Update Progress: 1214/2370 symbols completed. KO took 37.0s. Estimated remaining: 2h 2m 38s. Rate: 9.4 symbols/min [2025-09-14T18:45:58.937729] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T18:45:58.958864] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-09-14T18:45:58.956468] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:45:58.959917] [INFO ] [REMOTE ] KOP: Full fetch complete (19460 records). [2025-09-14T18:45:58.960279] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-09-14T18:45:59.078465] [DEBUG] [LOCAL ] KOS: Loaded 15646 existing records from primary storage. [2025-09-14T18:45:59.093880] [INFO ] [MAIN ] KOS: Loaded 15646 existing records. [2025-09-14T18:45:59.509537] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:45:59.517337] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-09-14T18:45:59.517676] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-09-14T18:45:59.517456] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-14T18:45:59.517931] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-09-14T18:45:59.518399] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-09-14T18:45:59.520023] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-09-14T18:45:59.519673] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-09-14T18:45:59.520728] [DEBUG] [LOCAL ] KOP: Trimmed 19460 records to 12894 (keeping 150 days of data) [2025-09-14T18:45:59.520791] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-09-14T18:45:59.520948] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-09-14T18:45:59.766041] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-09-14T18:45:59.908354] [DEBUG] [LOCAL ] KOP: Primary data saved (12894 records). [2025-09-14T18:45:59.938222] [INFO ] [MAIN ] KOP: Full history saved. [2025-09-14T18:45:59.947324] [INFO ] [MAIN ] Update Progress: 1215/2370 symbols completed. KOP took 17.5s. Estimated remaining: 2h 2m 27s. Rate: 9.4 symbols/min [2025-09-14T18:45:59.972418] [INFO ] [REMOTE ] KOS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:46:00.140472] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:46:00.164522] [DEBUG] [LOCAL ] KR: Loaded 24096 existing records from primary storage. [2025-09-14T18:46:00.164753] [INFO ] [MAIN ] KR: Loaded 24096 existing records. [2025-09-14T18:46:00.344221] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:46:00.344517] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-09-14T18:46:00.344594] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-09-14T18:46:00.345339] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-09-14T18:46:00.345417] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-09-14T18:46:00.563984] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-09-14T18:46:00.696457] [INFO ] [REMOTE ] KR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:46:01.358257] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-14T18:46:01.359759] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-09-14T18:46:01.370939] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-14T18:46:01.375273] [INFO ] [REMOTE ] KODK: Full fetch complete (47264 records). [2025-09-14T18:46:01.375387] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-09-14T18:46:01.795710] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-09-14T18:46:01.795843] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-09-14T18:46:01.796765] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-09-14T18:46:01.796827] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-09-14T18:46:01.798142] [DEBUG] [LOCAL ] KODK: Trimmed 47264 records to 32592 (keeping 150 days of data) [2025-09-14T18:46:02.089773] [DEBUG] [LOCAL ] KODK: Primary data saved (32592 records). [2025-09-14T18:46:02.090014] [INFO ] [MAIN ] KODK: Full history saved. [2025-09-14T18:46:02.090137] [INFO ] [MAIN ] Update Progress: 1216/2370 symbols completed. KODK took 35.7s. Estimated remaining: 2h 2m 16s. Rate: 9.4 symbols/min [2025-09-14T18:46:02.168803] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-09-14T18:46:02.222090] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-14T18:46:02.383831] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:46:02.412698] [DEBUG] [LOCAL ] KRC: Loaded 21320 existing records from primary storage. [2025-09-14T18:46:02.412941] [INFO ] [MAIN ] KRC: Loaded 21320 existing records. [2025-09-14T18:46:02.703152] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:46:02.703565] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-09-14T18:46:02.703699] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-09-14T18:46:02.704621] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-09-14T18:46:02.704748] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-09-14T18:46:02.966620] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-09-14T18:46:03.148851] [INFO ] [REMOTE ] KRC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:46:03.671201] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-14T18:46:03.758860] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-09-14T18:46:04.116295] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-14T18:46:04.134470] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-14T18:46:04.558832] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-09-14T18:46:04.987474] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T18:46:04.988295] [INFO ] [REMOTE ] KORE: Full fetch complete (2249 records). [2025-09-14T18:46:04.988379] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-09-14T18:46:05.354297] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-09-14T18:46:05.354402] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-09-14T18:46:05.354511] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-09-14T18:46:05.354561] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-09-14T18:46:05.354985] [DEBUG] [LOCAL ] KORE: Trimmed 2249 records to 1563 (keeping 150 days of data) [2025-09-14T18:46:05.364434] [DEBUG] [LOCAL ] KORE: Primary data saved (1563 records). [2025-09-14T18:46:05.362218] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-09-14T18:46:05.364617] [INFO ] [MAIN ] KORE: Full history saved. [2025-09-14T18:46:05.365446] [INFO ] [MAIN ] Update Progress: 1217/2370 symbols completed. KORE took 10.4s. Estimated remaining: 2h 2m 7s. Rate: 9.4 symbols/min [2025-09-14T18:46:05.542397] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:46:05.559844] [DEBUG] [LOCAL ] KREF: Loaded 15943 existing records from primary storage. [2025-09-14T18:46:05.560002] [INFO ] [MAIN ] KREF: Loaded 15943 existing records. [2025-09-14T18:46:05.737894] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:46:05.738198] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-09-14T18:46:05.738276] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-09-14T18:46:05.738853] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-09-14T18:46:05.738931] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-09-14T18:46:06.090965] [INFO ] [REMOTE ] KREF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:46:06.158790] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-09-14T18:46:06.958778] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-09-14T18:46:07.641267] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-14T18:46:07.690838] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-14T18:46:07.758895] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-09-14T18:46:08.558879] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-09-14T18:46:08.731148] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T18:46:09.217579] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-14T18:46:09.358904] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-09-14T18:46:10.158901] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-09-14T18:46:10.783724] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-14T18:46:10.958832] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-09-14T18:46:11.339854] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-14T18:46:11.758835] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-09-14T18:46:11.820497] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T18:46:12.558865] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-09-14T18:46:13.049765] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-14T18:46:13.358831] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-09-14T18:46:13.520663] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T18:46:14.158801] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-09-14T18:46:14.272170] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T18:46:14.958871] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-09-14T18:46:15.283680] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T18:46:15.758792] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-09-14T18:46:16.271842] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-14T18:46:16.558889] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-09-14T18:46:16.837303] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-14T18:46:17.192326] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-14T18:46:17.358835] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-09-14T18:46:18.158870] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-09-14T18:46:18.555888] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-14T18:46:18.958854] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-09-14T18:46:19.203263] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T18:46:19.758934] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-09-14T18:46:20.142884] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-14T18:46:20.564809] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-09-14T18:46:20.587379] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T18:46:21.358869] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-09-14T18:46:21.649450] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-14T18:46:22.093000] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T18:46:22.158845] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-09-14T18:46:22.402817] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-14T18:46:22.958884] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-09-14T18:46:23.714923] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:46:23.720665] [INFO ] [REMOTE ] KR: Full fetch complete (58358 records). [2025-09-14T18:46:23.720804] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-09-14T18:46:23.763972] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-09-14T18:46:24.114319] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-09-14T18:46:24.114452] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-09-14T18:46:24.115344] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-09-14T18:46:24.115421] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-09-14T18:46:24.117157] [DEBUG] [LOCAL ] KR: Trimmed 58358 records to 40423 (keeping 150 days of data) [2025-09-14T18:46:24.240955] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-14T18:46:24.426521] [DEBUG] [LOCAL ] KR: Primary data saved (40423 records). [2025-09-14T18:46:24.426895] [INFO ] [MAIN ] KR: Full history saved. [2025-09-14T18:46:24.427001] [INFO ] [MAIN ] Update Progress: 1218/2370 symbols completed. KR took 24.5s. Estimated remaining: 2h 2m 13s. Rate: 9.4 symbols/min [2025-09-14T18:46:24.571799] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-09-14T18:46:24.603571] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:46:24.626870] [DEBUG] [LOCAL ] KRG: Loaded 21821 existing records from primary storage. [2025-09-14T18:46:24.627027] [INFO ] [MAIN ] KRG: Loaded 21821 existing records. [2025-09-14T18:46:24.810268] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:46:24.810542] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-09-14T18:46:24.810603] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-09-14T18:46:24.811413] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-09-14T18:46:24.811477] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-09-14T18:46:25.184655] [INFO ] [REMOTE ] KRG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:46:25.358835] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-09-14T18:46:25.503118] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-14T18:46:26.158825] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-09-14T18:46:26.229960] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-14T18:46:26.235669] [INFO ] [REMOTE ] KOS: Full fetch complete (57717 records). [2025-09-14T18:46:26.235837] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-09-14T18:46:26.637615] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-09-14T18:46:26.637767] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-09-14T18:46:26.638839] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-09-14T18:46:26.638917] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-09-14T18:46:26.640418] [DEBUG] [LOCAL ] KOS: Trimmed 57717 records to 39954 (keeping 150 days of data) [2025-09-14T18:46:26.872161] [DEBUG] [LOCAL ] KOS: Primary data saved (39954 records). [2025-09-14T18:46:26.872339] [INFO ] [MAIN ] KOS: Full history saved. [2025-09-14T18:46:26.872450] [INFO ] [MAIN ] Update Progress: 1219/2370 symbols completed. KOS took 28.1s. Estimated remaining: 2h 2m 3s. Rate: 9.4 symbols/min [2025-09-14T18:46:26.963896] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-09-14T18:46:27.056345] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:46:27.080455] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T18:46:27.105257] [DEBUG] [LOCAL ] KRMN: Loaded 21542 existing records from primary storage. [2025-09-14T18:46:27.105418] [INFO ] [MAIN ] KRMN: Loaded 21542 existing records. [2025-09-14T18:46:27.286537] [WARN ] [MAIN ] KRMN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:46:27.286897] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-09-14T18:46:27.286979] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-14T18:46:27.287732] [DEBUG] [LOCAL ] KRMN: Deleted primary data file. [2025-09-14T18:46:27.287806] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-09-14T18:46:27.669885] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:46:27.758836] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-09-14T18:46:27.961542] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-14T18:46:28.558866] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-02. [2025-09-14T18:46:28.644242] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T18:46:29.180543] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-14T18:46:29.358817] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-09-14T18:46:29.766944] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-14T18:46:30.158820] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-09-14T18:46:30.795142] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T18:46:30.799169] [INFO ] [REMOTE ] KREF: Full fetch complete (39270 records). [2025-09-14T18:46:30.799294] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-09-14T18:46:30.980689] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-03. [2025-09-14T18:46:31.200679] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-09-14T18:46:31.200839] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-09-14T18:46:31.201617] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-09-14T18:46:31.201834] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-09-14T18:46:31.202877] [DEBUG] [LOCAL ] KREF: Trimmed 39270 records to 27613 (keeping 150 days of data) [2025-09-14T18:46:31.337315] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-14T18:46:31.410190] [DEBUG] [LOCAL ] KREF: Primary data saved (27613 records). [2025-09-14T18:46:31.410369] [INFO ] [MAIN ] KREF: Full history saved. [2025-09-14T18:46:31.410486] [INFO ] [MAIN ] Update Progress: 1220/2370 symbols completed. KREF took 26.0s. Estimated remaining: 2h 1m 54s. Rate: 9.4 symbols/min [2025-09-14T18:46:31.584181] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:46:31.596788] [DEBUG] [LOCAL ] KRO: Loaded 11990 existing records from primary storage. [2025-09-14T18:46:31.596952] [INFO ] [MAIN ] KRO: Loaded 11990 existing records. [2025-09-14T18:46:31.773696] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-09-14T18:46:31.812628] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:46:31.814068] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-09-14T18:46:31.815811] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-09-14T18:46:31.816311] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-09-14T18:46:31.816393] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-09-14T18:46:32.183458] [INFO ] [REMOTE ] KRO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:46:32.558850] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-09-14T18:46:32.735502] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T18:46:33.231684] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T18:46:33.358788] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-09-14T18:46:33.651273] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T18:46:34.158836] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-09-14T18:46:34.958829] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-09-14T18:46:35.147424] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T18:46:35.758806] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-09-14T18:46:35.818679] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T18:46:36.189880] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-14T18:46:36.558812] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-09-14T18:46:37.224597] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:46:37.229916] [INFO ] [REMOTE ] KRC: Full fetch complete (52760 records). [2025-09-14T18:46:37.230065] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-09-14T18:46:37.360576] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-09-14T18:46:37.623778] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-09-14T18:46:37.623925] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-09-14T18:46:37.624854] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-09-14T18:46:37.624942] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-09-14T18:46:37.626483] [DEBUG] [LOCAL ] KRC: Trimmed 52760 records to 36061 (keeping 150 days of data) [2025-09-14T18:46:37.751397] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-14T18:46:37.905207] [DEBUG] [LOCAL ] KRC: Primary data saved (36061 records). [2025-09-14T18:46:37.905407] [INFO ] [MAIN ] KRC: Full history saved. [2025-09-14T18:46:37.905575] [INFO ] [MAIN ] Update Progress: 1221/2370 symbols completed. KRC took 35.8s. Estimated remaining: 2h 1m 48s. Rate: 9.4 symbols/min [2025-09-14T18:46:38.078211] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:46:38.095309] [DEBUG] [LOCAL ] KRP: Loaded 15906 existing records from primary storage. [2025-09-14T18:46:38.095474] [INFO ] [MAIN ] KRP: Loaded 15906 existing records. [2025-09-14T18:46:38.163908] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-09-14T18:46:38.278434] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:46:38.278715] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-09-14T18:46:38.278779] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-09-14T18:46:38.279245] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-09-14T18:46:38.279312] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-09-14T18:46:38.633984] [INFO ] [REMOTE ] KRP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:46:38.893781] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-14T18:46:38.958851] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-09-14T18:46:39.758820] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-04. [2025-09-14T18:46:39.976859] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-14T18:46:40.018837] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-14T18:46:40.558864] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-09-14T18:46:41.229395] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-14T18:46:41.358814] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-05. [2025-09-14T18:46:42.164038] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-09-14T18:46:42.166493] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T18:46:42.959984] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-09-14T18:46:42.962806] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-14T18:46:43.758917] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-06. [2025-09-14T18:46:43.881535] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T18:46:44.558880] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-09-14T18:46:44.618212] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-14T18:46:44.978529] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T18:46:45.358842] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-09-14T18:46:45.784132] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-14T18:46:46.025349] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:46:46.030577] [INFO ] [REMOTE ] KRG: Full fetch complete (53458 records). [2025-09-14T18:46:46.030719] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-09-14T18:46:46.168547] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-09-14T18:46:46.404096] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-09-14T18:46:46.404205] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-09-14T18:46:46.405046] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-09-14T18:46:46.405104] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-09-14T18:46:46.406315] [DEBUG] [LOCAL ] KRG: Trimmed 53458 records to 36852 (keeping 150 days of data) [2025-09-14T18:46:46.646720] [DEBUG] [LOCAL ] KRG: Primary data saved (36852 records). [2025-09-14T18:46:46.646958] [INFO ] [MAIN ] KRG: Full history saved. [2025-09-14T18:46:46.647112] [INFO ] [MAIN ] Update Progress: 1222/2370 symbols completed. KRG took 22.2s. Estimated remaining: 2h 1m 44s. Rate: 9.4 symbols/min [2025-09-14T18:46:46.815734] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:46:46.839116] [DEBUG] [LOCAL ] KSS: Loaded 23997 existing records from primary storage. [2025-09-14T18:46:46.839286] [INFO ] [MAIN ] KSS: Loaded 23997 existing records. [2025-09-14T18:46:46.963932] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-09-14T18:46:47.015418] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:46:47.015714] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-09-14T18:46:47.015786] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-09-14T18:46:47.016522] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-09-14T18:46:47.016600] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-09-14T18:46:47.382384] [INFO ] [REMOTE ] KSS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:46:47.758868] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-07. [2025-09-14T18:46:47.899770] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T18:46:48.379213] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-14T18:46:48.558846] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-09-14T18:46:49.358805] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-09-14T18:46:49.412568] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-14T18:46:50.157089] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-14T18:46:50.166873] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-08. [2025-09-14T18:46:50.958805] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-09-14T18:46:51.020297] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T18:46:51.758899] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-09-14T18:46:51.947449] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-14T18:46:52.558882] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-09-14T18:46:53.120698] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-14T18:46:53.194683] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T18:46:53.358830] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-09. [2025-09-14T18:46:54.127160] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T18:46:54.158886] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-09-14T18:46:54.958923] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-09-14T18:46:55.048029] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-14T18:46:55.064628] [INFO ] [REMOTE ] KRMN: Full fetch complete (47013 records). [2025-09-14T18:46:55.065030] [DEBUG] [VALIDATOR ] KRMN: Validating primary data. [2025-09-14T18:46:55.340576] [WARN ] [VALIDATOR ] KRMN: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-14T18:46:55.341433] [FATAL] [MAIN ] KRMN: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:46:55.341533] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:46:55.341595] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-14T18:46:55.341698] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-14T18:46:55.341774] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-14T18:46:55.341848] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-09-14T18:46:55.341967] [INFO ] [MAIN ] Update Progress: 1223/2370 symbols completed. KRMN took 28.5s. Estimated remaining: 2h 1m 40s. Rate: 9.4 symbols/min [2025-09-14T18:46:55.538240] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:46:55.561492] [DEBUG] [LOCAL ] KT: Loaded 20006 existing records from primary storage. [2025-09-14T18:46:55.561702] [INFO ] [MAIN ] KT: Loaded 20006 existing records. [2025-09-14T18:46:55.761655] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-09-14T18:46:55.768408] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:46:55.770414] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-09-14T18:46:55.770502] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-09-14T18:46:55.771229] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-09-14T18:46:55.771307] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-09-14T18:46:56.145450] [INFO ] [REMOTE ] KT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:46:56.153486] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-14T18:46:56.156833] [INFO ] [REMOTE ] KRO: Full fetch complete (26933 records). [2025-09-14T18:46:56.156940] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-09-14T18:46:56.557456] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-14T18:46:56.557625] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-09-14T18:46:56.570654] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-09-14T18:46:56.571350] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-09-14T18:46:56.571993] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-09-14T18:46:56.572085] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-09-14T18:46:56.574045] [DEBUG] [LOCAL ] KRO: Trimmed 26933 records to 19761 (keeping 150 days of data) [2025-09-14T18:46:56.696297] [DEBUG] [LOCAL ] KRO: Primary data saved (19761 records). [2025-09-14T18:46:56.696481] [INFO ] [MAIN ] KRO: Full history saved. [2025-09-14T18:46:56.696627] [INFO ] [MAIN ] Update Progress: 1224/2370 symbols completed. KRO took 25.3s. Estimated remaining: 2h 1m 29s. Rate: 9.4 symbols/min [2025-09-14T18:46:56.874995] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:46:56.893088] [DEBUG] [LOCAL ] KTB: Loaded 18631 existing records from primary storage. [2025-09-14T18:46:56.893275] [INFO ] [MAIN ] KTB: Loaded 18631 existing records. [2025-09-14T18:46:57.072922] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:46:57.073434] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-09-14T18:46:57.073505] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-09-14T18:46:57.074418] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-09-14T18:46:57.074483] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-09-14T18:46:57.368348] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-09-14T18:46:57.424261] [INFO ] [REMOTE ] KTB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:46:57.448392] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T18:46:58.158827] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-09-14T18:46:58.331344] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T18:46:58.958873] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-09-14T18:46:59.225119] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T18:46:59.595152] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T18:46:59.758857] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-09-14T18:47:00.558838] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-09-14T18:47:00.688781] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T18:47:01.358870] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-09-14T18:47:01.958154] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-14T18:47:02.002831] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-14T18:47:02.006621] [INFO ] [REMOTE ] KRP: Full fetch complete (41605 records). [2025-09-14T18:47:02.006814] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-09-14T18:47:02.166673] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-09-14T18:47:02.396130] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-09-14T18:47:02.396264] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-09-14T18:47:02.397124] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-09-14T18:47:02.397204] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-09-14T18:47:02.398328] [DEBUG] [LOCAL ] KRP: Trimmed 41605 records to 27131 (keeping 150 days of data) [2025-09-14T18:47:02.569000] [DEBUG] [LOCAL ] KRP: Primary data saved (27131 records). [2025-09-14T18:47:02.569170] [INFO ] [MAIN ] KRP: Full history saved. [2025-09-14T18:47:02.569273] [INFO ] [MAIN ] Update Progress: 1225/2370 symbols completed. KRP took 24.7s. Estimated remaining: 2h 1m 22s. Rate: 9.4 symbols/min [2025-09-14T18:47:02.738905] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:47:02.747459] [DEBUG] [LOCAL ] KTF: Loaded 5354 existing records from primary storage. [2025-09-14T18:47:02.747658] [INFO ] [MAIN ] KTF: Loaded 5354 existing records. [2025-09-14T18:47:02.939950] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:47:02.940574] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-09-14T18:47:02.940716] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-09-14T18:47:02.941091] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-09-14T18:47:02.941187] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-09-14T18:47:02.963987] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-09-14T18:47:03.346040] [INFO ] [REMOTE ] KTF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:47:03.351369] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-14T18:47:03.767457] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-09-14T18:47:03.794043] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T18:47:04.558823] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-09-14T18:47:04.622723] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T18:47:05.060744] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-14T18:47:05.358858] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-09-14T18:47:06.158847] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-09-14T18:47:06.443322] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T18:47:06.958863] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-09-14T18:47:07.115851] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-14T18:47:07.758892] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-09-14T18:47:08.319195] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-14T18:47:08.468588] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-14T18:47:08.558785] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-09-14T18:47:09.358890] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-09-14T18:47:09.444027] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-14T18:47:09.631991] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T18:47:10.158799] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-09-14T18:47:10.484823] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-14T18:47:10.958915] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-09-14T18:47:11.758828] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-09-14T18:47:11.850317] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T18:47:12.138990] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-14T18:47:12.449307] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:47:12.455131] [INFO ] [REMOTE ] KSS: Full fetch complete (58290 records). [2025-09-14T18:47:12.455276] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-09-14T18:47:12.563987] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-09-14T18:47:12.847531] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-09-14T18:47:12.847654] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-09-14T18:47:12.848567] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-09-14T18:47:12.848634] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-09-14T18:47:12.850300] [DEBUG] [LOCAL ] KSS: Trimmed 58290 records to 40357 (keeping 150 days of data) [2025-09-14T18:47:13.114710] [DEBUG] [LOCAL ] KSS: Primary data saved (40357 records). [2025-09-14T18:47:13.114872] [INFO ] [MAIN ] KSS: Full history saved. [2025-09-14T18:47:13.115015] [INFO ] [MAIN ] Update Progress: 1226/2370 symbols completed. KSS took 26.5s. Estimated remaining: 2h 1m 20s. Rate: 9.4 symbols/min [2025-09-14T18:47:13.284237] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:47:13.288020] [DEBUG] [LOCAL ] KUKE: Loaded 1459 existing records from primary storage. [2025-09-14T18:47:13.288112] [INFO ] [MAIN ] KUKE: Loaded 1459 existing records. [2025-09-14T18:47:13.363914] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-09-14T18:47:13.465942] [WARN ] [MAIN ] KUKE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:47:13.466207] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-09-14T18:47:13.466281] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-14T18:47:13.466575] [DEBUG] [LOCAL ] KUKE: Deleted primary data file. [2025-09-14T18:47:13.466666] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-09-14T18:47:13.819586] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:47:14.158829] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-09-14T18:47:14.375283] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-14T18:47:14.958828] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-14T18:47:15.033360] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T18:47:15.094010] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-14T18:47:15.758886] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-09-14T18:47:15.804096] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-14T18:47:16.558838] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-09-14T18:47:17.358810] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-09-14T18:47:17.417485] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T18:47:17.533798] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-14T18:47:18.158834] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-09-14T18:47:18.806621] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:47:18.810951] [INFO ] [REMOTE ] KTB: Full fetch complete (45327 records). [2025-09-14T18:47:18.811081] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-09-14T18:47:18.968828] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-09-14T18:47:19.236362] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-09-14T18:47:19.236605] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-09-14T18:47:19.237463] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-09-14T18:47:19.237691] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-09-14T18:47:19.247706] [DEBUG] [LOCAL ] KTB: Trimmed 45327 records to 30714 (keeping 150 days of data) [2025-09-14T18:47:19.264375] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-14T18:47:19.469688] [DEBUG] [LOCAL ] KTB: Primary data saved (30714 records). [2025-09-14T18:47:19.469856] [INFO ] [MAIN ] KTB: Full history saved. [2025-09-14T18:47:19.469953] [INFO ] [MAIN ] Update Progress: 1227/2370 symbols completed. KTB took 22.8s. Estimated remaining: 2h 1m 13s. Rate: 9.4 symbols/min [2025-09-14T18:47:19.638267] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:47:19.661618] [DEBUG] [LOCAL ] KVUE: Loaded 24030 existing records from primary storage. [2025-09-14T18:47:19.661808] [INFO ] [MAIN ] KVUE: Loaded 24030 existing records. [2025-09-14T18:47:19.763464] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-09-14T18:47:19.840593] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:47:19.840903] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-09-14T18:47:19.840964] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-09-14T18:47:19.841708] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-09-14T18:47:19.841777] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-09-14T18:47:20.129134] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T18:47:20.217040] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:47:20.558854] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-09-14T18:47:21.256896] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-14T18:47:21.262233] [INFO ] [REMOTE ] KT: Full fetch complete (49997 records). [2025-09-14T18:47:21.262370] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-09-14T18:47:21.360631] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-14T18:47:21.641600] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-09-14T18:47:21.641792] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-09-14T18:47:21.642674] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-09-14T18:47:21.642795] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-09-14T18:47:21.644367] [DEBUG] [LOCAL ] KT: Trimmed 49997 records to 33903 (keeping 150 days of data) [2025-09-14T18:47:21.871506] [DEBUG] [LOCAL ] KT: Primary data saved (33903 records). [2025-09-14T18:47:21.871695] [INFO ] [MAIN ] KT: Full history saved. [2025-09-14T18:47:21.871811] [INFO ] [MAIN ] Update Progress: 1228/2370 symbols completed. KT took 26.5s. Estimated remaining: 2h 1m 3s. Rate: 9.4 symbols/min [2025-09-14T18:47:22.042074] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:47:22.064334] [DEBUG] [LOCAL ] KVYO: Loaded 22357 existing records from primary storage. [2025-09-14T18:47:22.064493] [INFO ] [MAIN ] KVYO: Loaded 22357 existing records. [2025-09-14T18:47:22.164741] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-09-14T18:47:22.244098] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:47:22.244339] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-09-14T18:47:22.244401] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-09-14T18:47:22.245103] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-09-14T18:47:22.245172] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-09-14T18:47:22.620230] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:47:22.630954] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T18:47:22.666359] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-14T18:47:22.958847] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-09-14T18:47:23.123582] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-14T18:47:23.758837] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-14T18:47:24.211246] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-14T18:47:24.558829] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-14T18:47:25.016074] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-14T18:47:25.135200] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-14T18:47:25.358825] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-09-14T18:47:26.158836] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-14T18:47:26.655023] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-14T18:47:26.958818] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-14T18:47:27.244579] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T18:47:27.492683] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-14T18:47:27.758836] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-09-14T18:47:28.512571] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T18:47:28.514213] [INFO ] [REMOTE ] KTF: Full fetch complete (14206 records). [2025-09-14T18:47:28.514311] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-09-14T18:47:28.566296] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-14T18:47:28.870049] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-09-14T18:47:28.870151] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-09-14T18:47:28.870504] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-09-14T18:47:28.870580] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-09-14T18:47:28.871157] [DEBUG] [LOCAL ] KTF: Trimmed 14206 records to 8981 (keeping 150 days of data) [2025-09-14T18:47:28.926464] [DEBUG] [LOCAL ] KTF: Primary data saved (8981 records). [2025-09-14T18:47:28.926621] [INFO ] [MAIN ] KTF: Full history saved. [2025-09-14T18:47:28.926787] [INFO ] [MAIN ] Update Progress: 1229/2370 symbols completed. KTF took 26.4s. Estimated remaining: 2h 0m 58s. Rate: 9.4 symbols/min [2025-09-14T18:47:29.094274] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:47:29.113980] [DEBUG] [LOCAL ] KW: Loaded 17575 existing records from primary storage. [2025-09-14T18:47:29.114136] [INFO ] [MAIN ] KW: Loaded 17575 existing records. [2025-09-14T18:47:29.295720] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-14T18:47:29.299239] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:47:29.301317] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-09-14T18:47:29.301380] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-09-14T18:47:29.302005] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-09-14T18:47:29.302070] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-09-14T18:47:29.363873] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-09-14T18:47:29.658879] [INFO ] [REMOTE ] KW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:47:30.158812] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-14T18:47:30.757621] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T18:47:30.758897] [INFO ] [REMOTE ] KUKE: Full fetch complete (4920 records). [2025-09-14T18:47:30.758991] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-09-14T18:47:30.937690] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-14T18:47:30.937964] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:47:30.938019] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:47:30.938064] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-14T18:47:30.938141] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-14T18:47:30.938233] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-09-14T18:47:30.938333] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-09-14T18:47:30.938431] [INFO ] [MAIN ] Update Progress: 1230/2370 symbols completed. KUKE took 17.8s. Estimated remaining: 2h 0m 47s. Rate: 9.4 symbols/min [2025-09-14T18:47:30.970129] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-09-14T18:47:31.112763] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:47:31.125877] [DEBUG] [LOCAL ] KWR: Loaded 7309 existing records from primary storage. [2025-09-14T18:47:31.126050] [INFO ] [MAIN ] KWR: Loaded 7309 existing records. [2025-09-14T18:47:31.305839] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:47:31.306221] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-09-14T18:47:31.306326] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-09-14T18:47:31.306833] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-09-14T18:47:31.306916] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-09-14T18:47:31.644621] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-14T18:47:31.720095] [INFO ] [REMOTE ] KWR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:47:31.758782] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-09-14T18:47:32.489006] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T18:47:32.558791] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-09-14T18:47:33.358808] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-09-14T18:47:33.682890] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T18:47:34.072915] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T18:47:34.158798] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-09-14T18:47:34.958807] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-09-14T18:47:35.037614] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T18:47:35.758811] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-09-14T18:47:35.823092] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-14T18:47:36.094682] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T18:47:36.558847] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-09-14T18:47:37.344124] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T18:47:37.358767] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-09-14T18:47:37.693736] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-14T18:47:38.158828] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-09-14T18:47:38.958914] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-09-14T18:47:39.135769] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-14T18:47:39.190524] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-14T18:47:39.758824] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-09-14T18:47:40.558799] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-09-14T18:47:40.676325] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-14T18:47:40.927931] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-14T18:47:41.358894] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-09-14T18:47:42.158841] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-09-14T18:47:42.427115] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T18:47:42.567075] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-14T18:47:42.958832] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-09-14T18:47:43.758834] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-09-14T18:47:43.940756] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T18:47:44.470160] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T18:47:44.558796] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-09-14T18:47:45.358844] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-09-14T18:47:45.567482] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T18:47:46.134173] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T18:47:46.158785] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-09-14T18:47:46.745567] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T18:47:46.958802] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-09-14T18:47:47.659781] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-14T18:47:47.758902] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-09-14T18:47:48.458677] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T18:47:48.467822] [INFO ] [REMOTE ] KVUE: Full fetch complete (58347 records). [2025-09-14T18:47:48.468113] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-09-14T18:47:48.566735] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-09-14T18:47:48.998656] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-09-14T18:47:48.999400] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-09-14T18:47:49.000802] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-09-14T18:47:49.025621] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-09-14T18:47:49.031923] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-14T18:47:49.043434] [DEBUG] [LOCAL ] KVUE: Trimmed 58347 records to 40407 (keeping 150 days of data) [2025-09-14T18:47:49.186434] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T18:47:49.195307] [INFO ] [REMOTE ] KW: Full fetch complete (43647 records). [2025-09-14T18:47:49.195631] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-09-14T18:47:49.367672] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-09-14T18:47:49.676664] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-09-14T18:47:49.677756] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-09-14T18:47:49.678741] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-09-14T18:47:49.679082] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-09-14T18:47:49.681229] [DEBUG] [LOCAL ] KW: Trimmed 43647 records to 30508 (keeping 150 days of data) [2025-09-14T18:47:49.875101] [DEBUG] [LOCAL ] KW: Primary data saved (30508 records). [2025-09-14T18:47:49.876090] [INFO ] [MAIN ] KW: Full history saved. [2025-09-14T18:47:49.876199] [INFO ] [MAIN ] Update Progress: 1231/2370 symbols completed. KW took 20.9s. Estimated remaining: 2h 0m 52s. Rate: 9.4 symbols/min [2025-09-14T18:47:49.975984] [DEBUG] [LOCAL ] KVUE: Primary data saved (40407 records). [2025-09-14T18:47:49.986204] [INFO ] [MAIN ] KVUE: Full history saved. [2025-09-14T18:47:49.986416] [INFO ] [MAIN ] Update Progress: 1232/2370 symbols completed. KVUE took 30.5s. Estimated remaining: 2h 0m 40s. Rate: 9.4 symbols/min [2025-09-14T18:47:50.161663] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:47:50.160308] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-09-14T18:47:50.248783] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:47:50.260935] [DEBUG] [LOCAL ] KYN: Loaded 13447 existing records from primary storage. [2025-09-14T18:47:50.261202] [INFO ] [MAIN ] KYN: Loaded 13447 existing records. [2025-09-14T18:47:50.450716] [DEBUG] [LOCAL ] L: Loaded 18981 existing records from primary storage. [2025-09-14T18:47:50.450215] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:47:50.450955] [INFO ] [MAIN ] L: Loaded 18981 existing records. [2025-09-14T18:47:50.451082] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-09-14T18:47:50.513003] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-09-14T18:47:50.540027] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-09-14T18:47:50.550084] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-09-14T18:47:50.778787] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:47:50.875605] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-09-14T18:47:50.905423] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-09-14T18:47:50.913560] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-09-14T18:47:50.934514] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-09-14T18:47:51.061820] [INFO ] [REMOTE ] KYN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:47:51.085558] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-09-14T18:47:51.354330] [INFO ] [REMOTE ] L: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:47:51.369573] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T18:47:51.406281] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-14T18:47:51.758949] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-09-14T18:47:52.558856] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-09-14T18:47:52.607576] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T18:47:52.755798] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-14T18:47:53.358836] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-09-14T18:47:53.932526] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-14T18:47:53.937859] [INFO ] [REMOTE ] KVYO: Full fetch complete (54023 records). [2025-09-14T18:47:53.937973] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-09-14T18:47:54.163929] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-09-14T18:47:54.322177] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-09-14T18:47:54.322290] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-09-14T18:47:54.323121] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-09-14T18:47:54.323180] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-09-14T18:47:54.324370] [DEBUG] [LOCAL ] KVYO: Trimmed 54023 records to 37922 (keeping 150 days of data) [2025-09-14T18:47:54.546426] [DEBUG] [LOCAL ] KVYO: Primary data saved (37922 records). [2025-09-14T18:47:54.546620] [INFO ] [MAIN ] KVYO: Full history saved. [2025-09-14T18:47:54.546761] [INFO ] [MAIN ] Update Progress: 1233/2370 symbols completed. KVYO took 32.7s. Estimated remaining: 2h 0m 32s. Rate: 9.4 symbols/min [2025-09-14T18:47:54.727025] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:47:54.746819] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-14T18:47:54.776015] [DEBUG] [LOCAL ] LAC: Loaded 23609 existing records from primary storage. [2025-09-14T18:47:54.776260] [INFO ] [MAIN ] LAC: Loaded 23609 existing records. [2025-09-14T18:47:54.964280] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-09-14T18:47:54.970436] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:47:54.971907] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-09-14T18:47:54.971988] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-09-14T18:47:54.972907] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-09-14T18:47:54.972986] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-09-14T18:47:55.365236] [INFO ] [REMOTE ] LAC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:47:55.524442] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T18:47:55.527926] [INFO ] [REMOTE ] KWR: Full fetch complete (18489 records). [2025-09-14T18:47:55.528157] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-09-14T18:47:55.764145] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-09-14T18:47:55.928954] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-09-14T18:47:55.929145] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-09-14T18:47:55.929804] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-09-14T18:47:55.930552] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-09-14T18:47:55.931535] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-14T18:47:55.941026] [DEBUG] [LOCAL ] KWR: Trimmed 18489 records to 12557 (keeping 150 days of data) [2025-09-14T18:47:56.031948] [DEBUG] [LOCAL ] KWR: Primary data saved (12557 records). [2025-09-14T18:47:56.032161] [INFO ] [MAIN ] KWR: Full history saved. [2025-09-14T18:47:56.032284] [INFO ] [MAIN ] Update Progress: 1234/2370 symbols completed. KWR took 25.1s. Estimated remaining: 2h 0m 21s. Rate: 9.4 symbols/min [2025-09-14T18:47:56.205163] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:47:56.217933] [DEBUG] [LOCAL ] LAD: Loaded 10217 existing records from primary storage. [2025-09-14T18:47:56.218084] [INFO ] [MAIN ] LAD: Loaded 10217 existing records. [2025-09-14T18:47:56.394379] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:47:56.394680] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-09-14T18:47:56.394742] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-09-14T18:47:56.395179] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-09-14T18:47:56.395238] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-09-14T18:47:56.565751] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-09-14T18:47:56.751066] [INFO ] [REMOTE ] LAD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:47:57.358827] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-09-14T18:47:57.791247] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-14T18:47:58.158848] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-09-14T18:47:58.271837] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-14T18:47:58.474165] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-14T18:47:58.958887] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-09-14T18:47:59.397615] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T18:47:59.758874] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-09-14T18:48:00.282309] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-14T18:48:00.558841] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-09-14T18:48:01.358852] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-09-14T18:48:01.559586] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-14T18:48:02.129730] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-14T18:48:02.158836] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-09-14T18:48:02.958862] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-09-14T18:48:03.758833] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-09-14T18:48:04.412723] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (3.05 seconds). [2025-09-14T18:48:04.558798] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-09-14T18:48:04.989941] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-09-14T18:48:05.358839] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-09-14T18:48:06.085433] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-14T18:48:06.165921] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-09-14T18:48:06.182697] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (3.22 seconds). [2025-09-14T18:48:06.211875] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-14T18:48:06.683933] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-14T18:48:06.958871] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-09-14T18:48:07.758795] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-09-14T18:48:08.050498] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-14T18:48:08.053758] [INFO ] [REMOTE ] KYN: Full fetch complete (33127 records). [2025-09-14T18:48:08.053861] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-09-14T18:48:08.443117] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-09-14T18:48:08.443299] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-09-14T18:48:08.444487] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-09-14T18:48:08.444563] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-09-14T18:48:08.482584] [DEBUG] [LOCAL ] KYN: Trimmed 33127 records to 22403 (keeping 150 days of data) [2025-09-14T18:48:08.487127] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-14T18:48:08.566570] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-09-14T18:48:08.652671] [DEBUG] [LOCAL ] KYN: Primary data saved (22403 records). [2025-09-14T18:48:08.652896] [INFO ] [MAIN ] KYN: Full history saved. [2025-09-14T18:48:08.653028] [INFO ] [MAIN ] Update Progress: 1235/2370 symbols completed. KYN took 18.8s. Estimated remaining: 2h 0m 21s. Rate: 9.4 symbols/min [2025-09-14T18:48:08.841032] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:48:08.862763] [DEBUG] [LOCAL ] LADR: Loaded 17427 existing records from primary storage. [2025-09-14T18:48:08.863043] [INFO ] [MAIN ] LADR: Loaded 17427 existing records. [2025-09-14T18:48:09.066263] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:48:09.079830] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-09-14T18:48:09.080587] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-09-14T18:48:09.081073] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-14T18:48:09.085973] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-09-14T18:48:09.086450] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-09-14T18:48:09.364117] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-09-14T18:48:09.470497] [INFO ] [REMOTE ] LADR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:48:10.158808] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-09-14T18:48:10.255975] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T18:48:10.594699] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-14T18:48:10.958906] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-09-14T18:48:11.758848] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-09-14T18:48:12.157246] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-14T18:48:12.417321] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T18:48:12.558866] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-09-14T18:48:13.245747] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T18:48:13.358849] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-09-14T18:48:13.742565] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T18:48:14.158890] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-09-14T18:48:14.958860] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-09-14T18:48:15.084512] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-14T18:48:15.758936] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-09-14T18:48:16.217813] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-14T18:48:16.220433] [INFO ] [REMOTE ] LAD: Full fetch complete (26568 records). [2025-09-14T18:48:16.220529] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-09-14T18:48:16.577334] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-09-14T18:48:16.587528] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-09-14T18:48:16.588707] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-09-14T18:48:16.589398] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-09-14T18:48:16.589469] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-09-14T18:48:16.590725] [DEBUG] [LOCAL ] LAD: Trimmed 26568 records to 17159 (keeping 150 days of data) [2025-09-14T18:48:16.743001] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-09-14T18:48:16.757831] [DEBUG] [LOCAL ] LAD: Primary data saved (17159 records). [2025-09-14T18:48:16.758064] [INFO ] [MAIN ] LAD: Full history saved. [2025-09-14T18:48:16.758698] [INFO ] [MAIN ] Update Progress: 1236/2370 symbols completed. LAD took 20.7s. Estimated remaining: 2h 0m 16s. Rate: 9.4 symbols/min [2025-09-14T18:48:16.936541] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:48:16.940242] [DEBUG] [LOCAL ] LANV: Loaded 1458 existing records from primary storage. [2025-09-14T18:48:16.940337] [INFO ] [MAIN ] LANV: Loaded 1458 existing records. [2025-09-14T18:48:17.147343] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:48:17.147686] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-09-14T18:48:17.147752] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-09-14T18:48:17.148033] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-09-14T18:48:17.148096] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-09-14T18:48:17.369027] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-09-14T18:48:17.508452] [INFO ] [REMOTE ] LANV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:48:17.959611] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-14T18:48:18.103586] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T18:48:18.158838] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-09-14T18:48:18.958854] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-09-14T18:48:19.153953] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-14T18:48:19.693940] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-14T18:48:19.758868] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-09-14T18:48:20.362850] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-14T18:48:20.430775] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T18:48:20.558838] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-09-14T18:48:21.065485] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-14T18:48:21.358835] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-09-14T18:48:22.158849] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-09-14T18:48:22.730102] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-14T18:48:22.941816] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-14T18:48:22.958781] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-09-14T18:48:23.758828] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-09-14T18:48:24.267658] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-14T18:48:24.554236] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-14T18:48:24.563025] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-09-14T18:48:25.358837] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-09-14T18:48:26.158834] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-09-14T18:48:26.683918] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-14T18:48:26.763438] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-14T18:48:26.843571] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-14T18:48:26.958819] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-09-14T18:48:27.758877] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-09-14T18:48:27.992859] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-14T18:48:28.558866] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-09-14T18:48:29.266572] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-14T18:48:29.271081] [INFO ] [REMOTE ] L: Full fetch complete (44530 records). [2025-09-14T18:48:29.271196] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-09-14T18:48:29.363974] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-09-14T18:48:29.653568] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-09-14T18:48:29.653686] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-09-14T18:48:29.654432] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-09-14T18:48:29.654491] [DEBUG] [LOCAL ] L: Saving primary data. [2025-09-14T18:48:29.655555] [DEBUG] [LOCAL ] L: Trimmed 44530 records to 30602 (keeping 150 days of data) [2025-09-14T18:48:29.862508] [DEBUG] [LOCAL ] L: Primary data saved (30602 records). [2025-09-14T18:48:29.862714] [INFO ] [MAIN ] L: Full history saved. [2025-09-14T18:48:29.862824] [INFO ] [MAIN ] Update Progress: 1237/2370 symbols completed. L took 39.9s. Estimated remaining: 2h 0m 16s. Rate: 9.4 symbols/min [2025-09-14T18:48:30.158836] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-09-14T18:48:30.638401] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-14T18:48:30.639481] [INFO ] [REMOTE ] LANV: Full fetch complete (2799 records). [2025-09-14T18:48:30.639567] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-09-14T18:48:31.003252] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-09-14T18:48:31.003632] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-09-14T18:48:31.009073] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-09-14T18:48:31.016588] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-09-14T18:48:31.017852] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-14T18:48:31.018133] [DEBUG] [LOCAL ] LANV: Trimmed 2799 records to 1944 (keeping 150 days of data) [2025-09-14T18:48:31.023542] [INFO ] [REMOTE ] LAC: Full fetch complete (56804 records). [2025-09-14T18:48:31.023852] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-09-14T18:48:31.097706] [DEBUG] [LOCAL ] LANV: Primary data saved (1944 records). [2025-09-14T18:48:31.135339] [INFO ] [MAIN ] LANV: Full history saved. [2025-09-14T18:48:31.135525] [INFO ] [MAIN ] Update Progress: 1238/2370 symbols completed. LANV took 14.4s. Estimated remaining: 2h 0m 5s. Rate: 9.4 symbols/min [2025-09-14T18:48:31.419486] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-14T18:48:31.443675] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-09-14T18:48:31.443969] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-09-14T18:48:31.444903] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-09-14T18:48:31.445256] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-09-14T18:48:31.445321] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-09-14T18:48:31.447454] [DEBUG] [LOCAL ] LAC: Trimmed 56804 records to 39364 (keeping 150 days of data) [2025-09-14T18:48:31.684603] [DEBUG] [LOCAL ] LAC: Primary data saved (39364 records). [2025-09-14T18:48:31.684785] [INFO ] [MAIN ] LAC: Full history saved. [2025-09-14T18:48:31.684892] [INFO ] [MAIN ] Update Progress: 1239/2370 symbols completed. LAC took 37.1s. Estimated remaining: 1h 59m 53s. Rate: 9.4 symbols/min [2025-09-14T18:48:32.820455] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-14T18:48:32.824607] [INFO ] [REMOTE ] LADR: Full fetch complete (41409 records). [2025-09-14T18:48:32.824748] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-09-14T18:48:33.198260] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-09-14T18:48:33.198406] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-09-14T18:48:33.199195] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-09-14T18:48:33.199273] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-09-14T18:48:33.200420] [DEBUG] [LOCAL ] LADR: Trimmed 41409 records to 28952 (keeping 150 days of data) [2025-09-14T18:48:33.392855] [DEBUG] [LOCAL ] LADR: Primary data saved (28952 records). [2025-09-14T18:48:33.393047] [INFO ] [MAIN ] LADR: Full history saved. [2025-09-14T18:48:33.393226] [INFO ] [MAIN ] Update Progress: 1240/2370 symbols completed. LADR took 24.7s. Estimated remaining: 1h 59m 43s. Rate: 9.4 symbols/min [2025-09-14T18:48:34.051873] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:48:34.097903] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:48:34.118152] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:48:34.101990] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:48:34.131084] [DEBUG] [LOCAL ] LAW: Loaded 6778 existing records from primary storage. [2025-09-14T18:48:34.131522] [INFO ] [MAIN ] LAW: Loaded 6778 existing records. [2025-09-14T18:48:34.283877] [DEBUG] [LOCAL ] LAZ: Loaded 19970 existing records from primary storage. [2025-09-14T18:48:34.284125] [DEBUG] [LOCAL ] LAR: Loaded 20841 existing records from primary storage. [2025-09-14T18:48:34.277449] [DEBUG] [LOCAL ] LB: Loaded 17429 existing records from primary storage. [2025-09-14T18:48:34.284396] [INFO ] [MAIN ] LAR: Loaded 20841 existing records. [2025-09-14T18:48:34.303294] [INFO ] [MAIN ] LAZ: Loaded 19970 existing records. [2025-09-14T18:48:34.313918] [INFO ] [MAIN ] LB: Loaded 17429 existing records. [2025-09-14T18:48:34.484869] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:48:34.666207] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-09-14T18:48:34.838046] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-09-14T18:48:34.827723] [WARN ] [MAIN ] LAR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:48:34.920486] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:48:34.925889] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-09-14T18:48:34.920315] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-09-14T18:48:34.926001] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-09-14T18:48:34.904218] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-09-14T18:48:34.926252] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:48:34.926473] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-14T18:48:34.926533] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-09-14T18:48:34.926870] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-09-14T18:48:34.939369] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-09-14T18:48:34.939440] [DEBUG] [LOCAL ] LAR: Deleted primary data file. [2025-09-14T18:48:34.966610] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-09-14T18:48:34.966758] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-09-14T18:48:34.987739] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-09-14T18:48:35.017424] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-09-14T18:48:35.079610] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-09-14T18:48:35.938714] [INFO ] [REMOTE ] LAW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:48:36.066950] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-09-14T18:48:36.331850] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:48:36.355166] [INFO ] [REMOTE ] LAR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:48:36.396238] [INFO ] [REMOTE ] LB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:48:36.389553] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-09-14T18:48:36.397775] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-09-14T18:48:36.396593] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-09-14T18:48:37.236276] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-14T18:48:37.240249] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-09-14T18:48:37.629741] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T18:48:37.638611] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-09-14T18:48:37.966872] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T18:48:37.975157] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-09-14T18:48:38.075444] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-14T18:48:38.105407] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-09-14T18:48:38.106910] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T18:48:38.158792] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-09-14T18:48:39.107603] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-14T18:48:39.111313] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-09-14T18:48:39.185127] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T18:48:39.437281] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-14T18:48:39.478118] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T18:48:39.758849] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-09-14T18:48:40.101352] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-14T18:48:40.558850] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-09-14T18:48:41.358879] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-09-14T18:48:41.483890] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T18:48:42.158921] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-09-14T18:48:42.330182] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T18:48:42.418789] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-14T18:48:42.958911] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-09-14T18:48:43.747393] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T18:48:43.758769] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-09-14T18:48:44.261329] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-14T18:48:44.558840] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-09-14T18:48:45.327131] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T18:48:45.358771] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-09-14T18:48:46.158843] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-09-14T18:48:46.261874] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T18:48:46.643126] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-14T18:48:46.742999] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-14T18:48:46.958837] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-09-14T18:48:47.758794] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-09-14T18:48:48.048720] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-14T18:48:48.558880] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-09-14T18:48:49.276899] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T18:48:49.358891] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-09-14T18:48:50.108799] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T18:48:50.110781] [INFO ] [REMOTE ] LAW: Full fetch complete (15395 records). [2025-09-14T18:48:50.110868] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-09-14T18:48:50.163999] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-09-14T18:48:50.423897] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-14T18:48:50.519734] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-09-14T18:48:50.519854] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-09-14T18:48:50.520279] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-09-14T18:48:50.520355] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-09-14T18:48:50.520999] [DEBUG] [LOCAL ] LAW: Trimmed 15395 records to 10652 (keeping 150 days of data) [2025-09-14T18:48:50.581574] [DEBUG] [LOCAL ] LAW: Primary data saved (10652 records). [2025-09-14T18:48:50.581743] [INFO ] [MAIN ] LAW: Full history saved. [2025-09-14T18:48:50.581905] [INFO ] [MAIN ] Update Progress: 1241/2370 symbols completed. LAW took 17.2s. Estimated remaining: 1h 59m 46s. Rate: 9.4 symbols/min [2025-09-14T18:48:50.752524] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:48:50.780222] [DEBUG] [LOCAL ] LBRT: Loaded 23697 existing records from primary storage. [2025-09-14T18:48:50.780433] [INFO ] [MAIN ] LBRT: Loaded 23697 existing records. [2025-09-14T18:48:50.955420] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:48:50.955725] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-09-14T18:48:50.955797] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-09-14T18:48:50.956472] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-09-14T18:48:50.956534] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-09-14T18:48:50.967509] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-09-14T18:48:51.311374] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:48:51.758834] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-09-14T18:48:52.050683] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-14T18:48:52.558819] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-09-14T18:48:52.789162] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-14T18:48:53.358892] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-09-14T18:48:53.663182] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-14T18:48:53.936482] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-14T18:48:54.158885] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-09-14T18:48:54.958849] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-09-14T18:48:55.012173] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-14T18:48:55.459231] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-14T18:48:55.758881] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-09-14T18:48:55.910139] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-14T18:48:55.915069] [INFO ] [REMOTE ] LAR: Full fetch complete (48819 records). [2025-09-14T18:48:55.915197] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-09-14T18:48:56.295105] [DEBUG] [VALIDATOR ] LAR: All expected trading days are present. [2025-09-14T18:48:56.295240] [DEBUG] [VALIDATOR ] LAR: Primary data validation passed. [2025-09-14T18:48:56.296213] [INFO ] [MAIN ] LAR: Fetched primary data is valid. [2025-09-14T18:48:56.296283] [DEBUG] [LOCAL ] LAR: Saving primary data. [2025-09-14T18:48:56.297546] [DEBUG] [LOCAL ] LAR: Trimmed 48819 records to 33941 (keeping 150 days of data) [2025-09-14T18:48:56.500470] [DEBUG] [LOCAL ] LAR: Primary data saved (33941 records). [2025-09-14T18:48:56.500699] [INFO ] [MAIN ] LAR: Full history saved. [2025-09-14T18:48:56.500833] [INFO ] [MAIN ] Update Progress: 1242/2370 symbols completed. LAR took 23.1s. Estimated remaining: 1h 59m 39s. Rate: 9.4 symbols/min [2025-09-14T18:48:56.564907] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-09-14T18:48:56.674235] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:48:56.695502] [DEBUG] [LOCAL ] LC: Loaded 21503 existing records from primary storage. [2025-09-14T18:48:56.695729] [INFO ] [MAIN ] LC: Loaded 21503 existing records. [2025-09-14T18:48:56.871467] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:48:56.871745] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-09-14T18:48:56.871807] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-09-14T18:48:56.872477] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-09-14T18:48:56.872539] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-09-14T18:48:57.223631] [INFO ] [REMOTE ] LC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:48:57.358874] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-09-14T18:48:57.427255] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T18:48:58.158872] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-09-14T18:48:58.340815] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-14T18:48:58.958937] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-09-14T18:48:59.100528] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-14T18:48:59.758923] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-09-14T18:49:00.126664] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-14T18:49:00.310787] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-14T18:49:00.315741] [INFO ] [REMOTE ] LAZ: Full fetch complete (49453 records). [2025-09-14T18:49:00.315905] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-09-14T18:49:00.569696] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-09-14T18:49:00.697172] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-09-14T18:49:00.697303] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-09-14T18:49:00.698128] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-09-14T18:49:00.698190] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-09-14T18:49:00.699414] [DEBUG] [LOCAL ] LAZ: Trimmed 49453 records to 33715 (keeping 150 days of data) [2025-09-14T18:49:00.835260] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-14T18:49:00.845867] [INFO ] [REMOTE ] LB: Full fetch complete (41545 records). [2025-09-14T18:49:00.846553] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-09-14T18:49:01.316311] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-09-14T18:49:01.317251] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-09-14T18:49:01.318015] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-09-14T18:49:01.318395] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-09-14T18:49:01.320347] [DEBUG] [LOCAL ] LB: Trimmed 41545 records to 27942 (keeping 150 days of data) [2025-09-14T18:49:01.378953] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-09-14T18:49:01.433155] [DEBUG] [LOCAL ] LAZ: Primary data saved (33715 records). [2025-09-14T18:49:01.434694] [INFO ] [MAIN ] LAZ: Full history saved. [2025-09-14T18:49:01.436253] [INFO ] [MAIN ] Update Progress: 1243/2370 symbols completed. LAZ took 28.0s. Estimated remaining: 1h 59m 32s. Rate: 9.4 symbols/min [2025-09-14T18:49:01.622934] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:49:01.642915] [DEBUG] [LOCAL ] LCII: Loaded 11886 existing records from primary storage. [2025-09-14T18:49:01.645331] [INFO ] [MAIN ] LCII: Loaded 11886 existing records. [2025-09-14T18:49:01.952271] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:49:01.953612] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-09-14T18:49:01.954608] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-09-14T18:49:01.955061] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-09-14T18:49:01.955128] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-09-14T18:49:02.153370] [DEBUG] [LOCAL ] LB: Primary data saved (27942 records). [2025-09-14T18:49:02.227069] [INFO ] [MAIN ] LB: Full history saved. [2025-09-14T18:49:02.257464] [INFO ] [MAIN ] Update Progress: 1244/2370 symbols completed. LB took 28.9s. Estimated remaining: 1h 59m 20s. Rate: 9.4 symbols/min [2025-09-14T18:49:02.470305] [INFO ] [REMOTE ] LCII: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:49:02.506559] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-09-14T18:49:02.537446] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:49:02.558378] [DEBUG] [LOCAL ] LDI: Loaded 20298 existing records from primary storage. [2025-09-14T18:49:02.558539] [INFO ] [MAIN ] LDI: Loaded 20298 existing records. [2025-09-14T18:49:02.733120] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:49:02.733370] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-09-14T18:49:02.733428] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-09-14T18:49:02.733932] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-09-14T18:49:02.733993] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-09-14T18:49:03.115035] [INFO ] [REMOTE ] LDI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:49:03.115487] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-09-14T18:49:03.147205] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-14T18:49:03.190342] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T18:49:03.758847] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-09-14T18:49:03.813820] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-14T18:49:04.340175] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-14T18:49:04.558855] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-09-14T18:49:05.358830] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-09-14T18:49:05.608685] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T18:49:06.074001] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T18:49:06.158819] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-09-14T18:49:06.958862] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-09-14T18:49:07.146791] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T18:49:07.331442] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T18:49:07.758836] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-09-14T18:49:08.558827] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-09-14T18:49:08.714133] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T18:49:09.358835] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-09-14T18:49:09.448138] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-14T18:49:10.127721] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-14T18:49:10.158789] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-09-14T18:49:10.958886] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-09-14T18:49:11.257247] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T18:49:11.758882] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-09-14T18:49:11.844497] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-14T18:49:12.558840] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-09-14T18:49:12.653222] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T18:49:13.358879] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-09-14T18:49:13.467476] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T18:49:13.782571] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T18:49:14.158891] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-09-14T18:49:14.958885] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-09-14T18:49:15.281037] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-14T18:49:15.439395] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T18:49:15.758885] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-09-14T18:49:16.396222] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T18:49:16.558892] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-09-14T18:49:17.063167] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-14T18:49:17.245048] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:49:17.250541] [INFO ] [REMOTE ] LBRT: Full fetch complete (57544 records). [2025-09-14T18:49:17.250685] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-09-14T18:49:17.364031] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-09-14T18:49:17.638165] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-09-14T18:49:17.638269] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-09-14T18:49:17.639136] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-09-14T18:49:17.639203] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-09-14T18:49:17.640494] [DEBUG] [LOCAL ] LBRT: Trimmed 57544 records to 39791 (keeping 150 days of data) [2025-09-14T18:49:17.904968] [DEBUG] [LOCAL ] LBRT: Primary data saved (39791 records). [2025-09-14T18:49:17.905134] [INFO ] [MAIN ] LBRT: Full history saved. [2025-09-14T18:49:17.905249] [INFO ] [MAIN ] Update Progress: 1245/2370 symbols completed. LBRT took 27.3s. Estimated remaining: 1h 59m 22s. Rate: 9.4 symbols/min [2025-09-14T18:49:18.073092] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:49:18.093475] [DEBUG] [LOCAL ] LDOS: Loaded 19358 existing records from primary storage. [2025-09-14T18:49:18.093624] [INFO ] [MAIN ] LDOS: Loaded 19358 existing records. [2025-09-14T18:49:18.170172] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-09-14T18:49:18.277008] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:49:18.277249] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-09-14T18:49:18.277313] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-09-14T18:49:18.277903] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-09-14T18:49:18.277989] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-09-14T18:49:18.624419] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:49:18.958853] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-09-14T18:49:18.996564] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T18:49:19.658678] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T18:49:19.758835] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-09-14T18:49:19.903700] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-14T18:49:20.558889] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-09-14T18:49:21.291987] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-14T18:49:21.297452] [INFO ] [REMOTE ] LC: Full fetch complete (52446 records). [2025-09-14T18:49:21.297688] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-09-14T18:49:21.365964] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-09-14T18:49:21.719629] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-09-14T18:49:21.719757] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-09-14T18:49:21.720758] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-09-14T18:49:21.720836] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-09-14T18:49:21.722187] [DEBUG] [LOCAL ] LC: Trimmed 52446 records to 35913 (keeping 150 days of data) [2025-09-14T18:49:21.974415] [DEBUG] [LOCAL ] LC: Primary data saved (35913 records). [2025-09-14T18:49:21.974743] [INFO ] [MAIN ] LC: Full history saved. [2025-09-14T18:49:21.974942] [INFO ] [MAIN ] Update Progress: 1246/2370 symbols completed. LC took 25.5s. Estimated remaining: 1h 59m 14s. Rate: 9.4 symbols/min [2025-09-14T18:49:22.147516] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:49:22.155711] [DEBUG] [LOCAL ] LDP: Loaded 5747 existing records from primary storage. [2025-09-14T18:49:22.155850] [INFO ] [MAIN ] LDP: Loaded 5747 existing records. [2025-09-14T18:49:22.186760] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-09-14T18:49:22.348901] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:49:22.349374] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-09-14T18:49:22.349485] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-09-14T18:49:22.349930] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-09-14T18:49:22.350045] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-09-14T18:49:22.735998] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-14T18:49:22.756623] [INFO ] [REMOTE ] LDP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:49:22.841794] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-14T18:49:22.958815] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-09-14T18:49:23.696099] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-14T18:49:23.701476] [INFO ] [REMOTE ] LDI: Full fetch complete (46146 records). [2025-09-14T18:49:23.701634] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-09-14T18:49:23.764609] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-09-14T18:49:23.945977] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-14T18:49:24.094653] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-09-14T18:49:24.094766] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-09-14T18:49:24.095927] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-09-14T18:49:24.095995] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-09-14T18:49:24.097225] [DEBUG] [LOCAL ] LDI: Trimmed 46146 records to 32413 (keeping 150 days of data) [2025-09-14T18:49:24.287057] [DEBUG] [LOCAL ] LDI: Primary data saved (32413 records). [2025-09-14T18:49:24.287226] [INFO ] [MAIN ] LDI: Full history saved. [2025-09-14T18:49:24.287356] [INFO ] [MAIN ] Update Progress: 1247/2370 symbols completed. LDI took 22.0s. Estimated remaining: 1h 59m 4s. Rate: 9.4 symbols/min [2025-09-14T18:49:24.453941] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:49:24.474912] [DEBUG] [LOCAL ] LEA: Loaded 18627 existing records from primary storage. [2025-09-14T18:49:24.475084] [INFO ] [MAIN ] LEA: Loaded 18627 existing records. [2025-09-14T18:49:24.564198] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-09-14T18:49:24.651459] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:49:24.651680] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-09-14T18:49:24.651746] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-09-14T18:49:24.652260] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-09-14T18:49:24.652322] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-09-14T18:49:25.016765] [INFO ] [REMOTE ] LEA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:49:25.163104] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T18:49:25.166005] [INFO ] [REMOTE ] LCII: Full fetch complete (31095 records). [2025-09-14T18:49:25.166122] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-09-14T18:49:25.367817] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-09-14T18:49:25.552171] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-09-14T18:49:25.552299] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-09-14T18:49:25.553410] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-09-14T18:49:25.553482] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-09-14T18:49:25.554709] [DEBUG] [LOCAL ] LCII: Trimmed 31095 records to 20847 (keeping 150 days of data) [2025-09-14T18:49:25.693752] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T18:49:25.743902] [DEBUG] [LOCAL ] LCII: Primary data saved (20847 records). [2025-09-14T18:49:25.744071] [INFO ] [MAIN ] LCII: Full history saved. [2025-09-14T18:49:25.744183] [INFO ] [MAIN ] Update Progress: 1248/2370 symbols completed. LCII took 24.3s. Estimated remaining: 1h 58m 53s. Rate: 9.4 symbols/min [2025-09-14T18:49:25.922125] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:49:25.944326] [DEBUG] [LOCAL ] LEG: Loaded 22489 existing records from primary storage. [2025-09-14T18:49:25.944510] [INFO ] [MAIN ] LEG: Loaded 22489 existing records. [2025-09-14T18:49:26.129219] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:49:26.129595] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-09-14T18:49:26.129676] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-09-14T18:49:26.130381] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-09-14T18:49:26.130446] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-09-14T18:49:26.163306] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-09-14T18:49:26.498275] [INFO ] [REMOTE ] LEG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:49:26.542497] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T18:49:26.958827] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-09-14T18:49:27.758812] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-09-14T18:49:27.968721] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-14T18:49:28.163155] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-14T18:49:28.558831] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-09-14T18:49:29.166864] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T18:49:29.358824] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-09-14T18:49:30.158851] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-09-14T18:49:30.428901] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-14T18:49:30.958778] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-09-14T18:49:31.052340] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-14T18:49:31.620240] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T18:49:31.758778] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-09-14T18:49:32.558859] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-09-14T18:49:32.628323] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-14T18:49:33.356832] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-14T18:49:33.367259] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-09-14T18:49:33.564394] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-14T18:49:34.158832] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-09-14T18:49:34.958878] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-09-14T18:49:35.133051] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T18:49:35.758970] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-09-14T18:49:35.836058] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T18:49:36.283676] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-14T18:49:36.558902] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-09-14T18:49:37.358841] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-09-14T18:49:37.533145] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T18:49:37.548733] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-14T18:49:38.158836] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-09-14T18:49:38.786079] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-14T18:49:38.919754] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:49:38.924238] [INFO ] [REMOTE ] LDOS: Full fetch complete (50608 records). [2025-09-14T18:49:38.924354] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-09-14T18:49:38.964005] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-09-14T18:49:39.306438] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-09-14T18:49:39.306561] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-09-14T18:49:39.307388] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-09-14T18:49:39.307449] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-09-14T18:49:39.308899] [DEBUG] [LOCAL ] LDOS: Trimmed 50608 records to 33900 (keeping 150 days of data) [2025-09-14T18:49:39.545697] [DEBUG] [LOCAL ] LDOS: Primary data saved (33900 records). [2025-09-14T18:49:39.545894] [INFO ] [MAIN ] LDOS: Full history saved. [2025-09-14T18:49:39.546015] [INFO ] [MAIN ] Update Progress: 1249/2370 symbols completed. LDOS took 21.6s. Estimated remaining: 1h 58m 53s. Rate: 9.4 symbols/min [2025-09-14T18:49:39.714822] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:49:39.739731] [DEBUG] [LOCAL ] LEN: Loaded 23913 existing records from primary storage. [2025-09-14T18:49:39.739889] [INFO ] [MAIN ] LEN: Loaded 23913 existing records. [2025-09-14T18:49:39.769935] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-09-14T18:49:39.931045] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:49:39.931346] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-09-14T18:49:39.931406] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-09-14T18:49:39.932112] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-09-14T18:49:39.932175] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-09-14T18:49:40.243596] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-14T18:49:40.299227] [INFO ] [REMOTE ] LEN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:49:40.558855] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-09-14T18:49:41.358798] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-09-14T18:49:41.450793] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-14T18:49:42.158837] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-09-14T18:49:42.334304] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-14T18:49:42.371587] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T18:49:42.958860] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-09-14T18:49:43.758838] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-09-14T18:49:43.889266] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-14T18:49:43.927023] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T18:49:44.558880] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-09-14T18:49:45.358869] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-09-14T18:49:45.515472] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-14T18:49:45.584503] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-14T18:49:46.158890] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-09-14T18:49:46.194256] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-14T18:49:46.958866] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-09-14T18:49:47.758923] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-09-14T18:49:47.818069] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T18:49:48.058450] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-14T18:49:48.558846] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-09-14T18:49:49.331433] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T18:49:49.344584] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-14T18:49:49.346370] [INFO ] [REMOTE ] LDP: Full fetch complete (14196 records). [2025-09-14T18:49:49.346458] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-09-14T18:49:49.367015] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-09-14T18:49:49.705277] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-09-14T18:49:49.705380] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-09-14T18:49:49.705723] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-09-14T18:49:49.705780] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-09-14T18:49:49.706293] [DEBUG] [LOCAL ] LDP: Trimmed 14196 records to 9487 (keeping 150 days of data) [2025-09-14T18:49:49.764863] [DEBUG] [LOCAL ] LDP: Primary data saved (9487 records). [2025-09-14T18:49:49.765012] [INFO ] [MAIN ] LDP: Full history saved. [2025-09-14T18:49:49.765104] [INFO ] [MAIN ] Update Progress: 1250/2370 symbols completed. LDP took 27.8s. Estimated remaining: 1h 58m 50s. Rate: 9.4 symbols/min [2025-09-14T18:49:49.970530] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:49:49.978800] [DEBUG] [LOCAL ] LEO: Loaded 6985 existing records from primary storage. [2025-09-14T18:49:49.978931] [INFO ] [MAIN ] LEO: Loaded 6985 existing records. [2025-09-14T18:49:50.161708] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:49:50.159029] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-09-14T18:49:50.162894] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-09-14T18:49:50.162978] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-09-14T18:49:50.163430] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-09-14T18:49:50.163631] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-09-14T18:49:50.525261] [INFO ] [REMOTE ] LEO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:49:50.564854] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T18:49:50.565301] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T18:49:50.580452] [INFO ] [REMOTE ] LEA: Full fetch complete (45363 records). [2025-09-14T18:49:50.580774] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-09-14T18:49:50.967405] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-09-14T18:49:50.980572] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-09-14T18:49:50.980758] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-09-14T18:49:50.981869] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-09-14T18:49:50.982036] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-09-14T18:49:50.983364] [DEBUG] [LOCAL ] LEA: Trimmed 45363 records to 30762 (keeping 150 days of data) [2025-09-14T18:49:51.188331] [DEBUG] [LOCAL ] LEA: Primary data saved (30762 records). [2025-09-14T18:49:51.188506] [INFO ] [MAIN ] LEA: Full history saved. [2025-09-14T18:49:51.188609] [INFO ] [MAIN ] Update Progress: 1251/2370 symbols completed. LEA took 26.9s. Estimated remaining: 1h 58m 40s. Rate: 9.4 symbols/min [2025-09-14T18:49:51.364009] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:49:51.387351] [DEBUG] [LOCAL ] LEVI: Loaded 23139 existing records from primary storage. [2025-09-14T18:49:51.387519] [INFO ] [MAIN ] LEVI: Loaded 23139 existing records. [2025-09-14T18:49:51.577036] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:49:51.577435] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-09-14T18:49:51.577503] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-09-14T18:49:51.578920] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-09-14T18:49:51.579210] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-09-14T18:49:51.766017] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-09-14T18:49:51.969671] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:49:52.170098] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-14T18:49:52.558837] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-09-14T18:49:52.742450] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-14T18:49:53.358796] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-09-14T18:49:53.752377] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-14T18:49:54.158858] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-09-14T18:49:54.958865] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-09-14T18:49:55.042972] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-14T18:49:55.116236] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T18:49:55.758894] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-09-14T18:49:56.063041] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-14T18:49:56.558850] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-09-14T18:49:57.358806] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-09-14T18:49:57.416540] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-14T18:49:57.658948] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-14T18:49:58.158842] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-09-14T18:49:58.958869] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-09-14T18:49:59.168317] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-14T18:49:59.627674] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:49:59.633332] [INFO ] [REMOTE ] LEN: Full fetch complete (57810 records). [2025-09-14T18:49:59.633490] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-09-14T18:49:59.763917] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-09-14T18:50:00.022341] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-09-14T18:50:00.022448] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-09-14T18:50:00.023467] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-09-14T18:50:00.023544] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-09-14T18:50:00.024817] [DEBUG] [LOCAL ] LEN: Trimmed 57810 records to 39992 (keeping 150 days of data) [2025-09-14T18:50:00.292388] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-14T18:50:00.339595] [DEBUG] [LOCAL ] LEN: Primary data saved (39992 records). [2025-09-14T18:50:00.339812] [INFO ] [MAIN ] LEN: Full history saved. [2025-09-14T18:50:00.339974] [INFO ] [MAIN ] Update Progress: 1252/2370 symbols completed. LEN took 20.8s. Estimated remaining: 1h 58m 36s. Rate: 9.4 symbols/min [2025-09-14T18:50:00.527271] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:50:00.547834] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-14T18:50:00.554107] [INFO ] [REMOTE ] LEG: Full fetch complete (54840 records). [2025-09-14T18:50:00.559090] [DEBUG] [LOCAL ] LFT: Loaded 8405 existing records from primary storage. [2025-09-14T18:50:00.559235] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-09-14T18:50:00.559427] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-09-14T18:50:00.561092] [INFO ] [MAIN ] LFT: Loaded 8405 existing records. [2025-09-14T18:50:00.934715] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:50:00.974239] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-09-14T18:50:01.047156] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-09-14T18:50:01.075978] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-09-14T18:50:01.086602] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-09-14T18:50:01.288219] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-09-14T18:50:01.309848] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-09-14T18:50:01.340745] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-09-14T18:50:01.350394] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-09-14T18:50:01.366238] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-09-14T18:50:01.447274] [DEBUG] [LOCAL ] LEG: Trimmed 54840 records to 37656 (keeping 150 days of data) [2025-09-14T18:50:01.651335] [INFO ] [REMOTE ] LFT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:50:01.791783] [DEBUG] [LOCAL ] LEG: Primary data saved (37656 records). [2025-09-14T18:50:01.792019] [INFO ] [MAIN ] LEG: Full history saved. [2025-09-14T18:50:01.792164] [INFO ] [MAIN ] Update Progress: 1253/2370 symbols completed. LEG took 36.0s. Estimated remaining: 1h 58m 25s. Rate: 9.4 symbols/min [2025-09-14T18:50:02.003041] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:50:02.011084] [DEBUG] [LOCAL ] LGI: Loaded 4397 existing records from primary storage. [2025-09-14T18:50:02.011811] [INFO ] [MAIN ] LGI: Loaded 4397 existing records. [2025-09-14T18:50:02.167726] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-09-14T18:50:02.211050] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:50:02.211369] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-09-14T18:50:02.211440] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-09-14T18:50:02.211734] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-09-14T18:50:02.211804] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-09-14T18:50:02.581058] [INFO ] [REMOTE ] LGI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:50:02.615170] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-14T18:50:02.769228] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-14T18:50:02.958833] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-09-14T18:50:03.389418] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-14T18:50:03.758793] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-09-14T18:50:04.062411] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-14T18:50:04.558818] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-09-14T18:50:04.863873] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T18:50:05.358840] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-09-14T18:50:06.158859] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-09-14T18:50:06.447412] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-14T18:50:06.468801] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-14T18:50:06.801476] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-14T18:50:06.958839] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-09-14T18:50:07.697110] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-14T18:50:07.758891] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-09-14T18:50:08.558847] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-09-14T18:50:09.358864] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-09-14T18:50:09.493008] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-14T18:50:09.750163] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-14T18:50:10.158809] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-09-14T18:50:10.507179] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-14T18:50:10.958866] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-09-14T18:50:11.022223] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T18:50:11.758884] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-09-14T18:50:12.558836] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-09-14T18:50:12.809366] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-14T18:50:12.859968] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-14T18:50:13.358847] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-09-14T18:50:13.446415] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-14T18:50:14.158875] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-09-14T18:50:14.223356] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-14T18:50:14.225732] [INFO ] [REMOTE ] LEO: Full fetch complete (19801 records). [2025-09-14T18:50:14.225834] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-09-14T18:50:14.591158] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-09-14T18:50:14.591260] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-09-14T18:50:14.591666] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-09-14T18:50:14.591721] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-09-14T18:50:14.592295] [DEBUG] [LOCAL ] LEO: Trimmed 19801 records to 12504 (keeping 150 days of data) [2025-09-14T18:50:14.669635] [DEBUG] [LOCAL ] LEO: Primary data saved (12504 records). [2025-09-14T18:50:14.669814] [INFO ] [MAIN ] LEO: Full history saved. [2025-09-14T18:50:14.669915] [INFO ] [MAIN ] Update Progress: 1254/2370 symbols completed. LEO took 24.9s. Estimated remaining: 1h 58m 24s. Rate: 9.4 symbols/min [2025-09-14T18:50:14.839064] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:50:14.856311] [DEBUG] [LOCAL ] LH: Loaded 16243 existing records from primary storage. [2025-09-14T18:50:14.856478] [INFO ] [MAIN ] LH: Loaded 16243 existing records. [2025-09-14T18:50:14.963998] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-09-14T18:50:15.034857] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:50:15.035152] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-09-14T18:50:15.035314] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-09-14T18:50:15.040741] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-14T18:50:15.040779] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-09-14T18:50:15.042912] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-09-14T18:50:15.400381] [INFO ] [REMOTE ] LH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:50:15.758826] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-09-14T18:50:16.167355] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T18:50:16.558878] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-09-14T18:50:16.755191] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-14T18:50:17.358892] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-09-14T18:50:18.050254] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T18:50:18.158957] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-09-14T18:50:18.958865] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-09-14T18:50:19.041945] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-14T18:50:19.047276] [INFO ] [REMOTE ] LEVI: Full fetch complete (55912 records). [2025-09-14T18:50:19.047386] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-09-14T18:50:19.433845] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-09-14T18:50:19.434823] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-09-14T18:50:19.438312] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-09-14T18:50:19.438469] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-09-14T18:50:19.437239] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-14T18:50:19.446209] [DEBUG] [LOCAL ] LEVI: Trimmed 55912 records to 38710 (keeping 150 days of data) [2025-09-14T18:50:19.664437] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T18:50:19.667002] [INFO ] [REMOTE ] LGI: Full fetch complete (11062 records). [2025-09-14T18:50:19.669524] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-09-14T18:50:19.763891] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-09-14T18:50:20.068213] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-09-14T18:50:20.068834] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-09-14T18:50:20.069229] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-09-14T18:50:20.069578] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-09-14T18:50:20.070856] [DEBUG] [LOCAL ] LGI: Trimmed 11062 records to 7499 (keeping 150 days of data) [2025-09-14T18:50:20.122801] [DEBUG] [LOCAL ] LEVI: Primary data saved (38710 records). [2025-09-14T18:50:20.122996] [INFO ] [MAIN ] LEVI: Full history saved. [2025-09-14T18:50:20.123353] [INFO ] [MAIN ] Update Progress: 1255/2370 symbols completed. LEVI took 28.9s. Estimated remaining: 1h 58m 17s. Rate: 9.4 symbols/min [2025-09-14T18:50:20.230944] [DEBUG] [LOCAL ] LGI: Primary data saved (7499 records). [2025-09-14T18:50:20.231179] [INFO ] [MAIN ] LGI: Full history saved. [2025-09-14T18:50:20.236967] [INFO ] [MAIN ] Update Progress: 1256/2370 symbols completed. LGI took 18.4s. Estimated remaining: 1h 58m 5s. Rate: 9.4 symbols/min [2025-09-14T18:50:20.403810] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:50:20.474470] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:50:20.493401] [DEBUG] [LOCAL ] LHX: Loaded 21479 existing records from primary storage. [2025-09-14T18:50:20.493587] [INFO ] [MAIN ] LHX: Loaded 21479 existing records. [2025-09-14T18:50:20.561944] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-09-14T18:50:20.587190] [DEBUG] [LOCAL ] LII: Loaded 11691 existing records from primary storage. [2025-09-14T18:50:20.619573] [INFO ] [MAIN ] LII: Loaded 11691 existing records. [2025-09-14T18:50:20.705666] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:50:20.774053] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-09-14T18:50:20.774186] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-09-14T18:50:20.779952] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-09-14T18:50:20.800398] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-09-14T18:50:20.896602] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:50:20.950875] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-09-14T18:50:20.990029] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-09-14T18:50:21.077461] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-09-14T18:50:21.107324] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-14T18:50:21.148887] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-09-14T18:50:21.372223] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-09-14T18:50:21.393258] [INFO ] [REMOTE ] LHX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:50:21.672313] [INFO ] [REMOTE ] LII: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:50:22.130259] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-14T18:50:22.158838] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-09-14T18:50:22.276494] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-14T18:50:22.278351] [INFO ] [REMOTE ] LFT: Full fetch complete (18640 records). [2025-09-14T18:50:22.278450] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-09-14T18:50:22.639995] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-09-14T18:50:22.640103] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-09-14T18:50:22.640565] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-09-14T18:50:22.640629] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-09-14T18:50:22.641420] [DEBUG] [LOCAL ] LFT: Trimmed 18640 records to 14281 (keeping 150 days of data) [2025-09-14T18:50:22.737308] [DEBUG] [LOCAL ] LFT: Primary data saved (14281 records). [2025-09-14T18:50:22.737477] [INFO ] [MAIN ] LFT: Full history saved. [2025-09-14T18:50:22.737588] [INFO ] [MAIN ] Update Progress: 1257/2370 symbols completed. LFT took 22.4s. Estimated remaining: 1h 57m 56s. Rate: 9.4 symbols/min [2025-09-14T18:50:22.910224] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:50:22.931450] [DEBUG] [LOCAL ] LION: Loaded 22207 existing records from primary storage. [2025-09-14T18:50:22.931613] [INFO ] [MAIN ] LION: Loaded 22207 existing records. [2025-09-14T18:50:22.963895] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-09-14T18:50:23.112821] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:50:23.113099] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-09-14T18:50:23.113161] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-09-14T18:50:23.113839] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-09-14T18:50:23.113905] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-09-14T18:50:23.472086] [INFO ] [REMOTE ] LION: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:50:23.758811] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-09-14T18:50:23.920048] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T18:50:24.420144] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T18:50:24.558786] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-09-14T18:50:24.584929] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T18:50:25.358922] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-09-14T18:50:26.034318] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-14T18:50:26.158856] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-09-14T18:50:26.958829] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-09-14T18:50:26.992962] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-14T18:50:27.260767] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-14T18:50:27.758853] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-09-14T18:50:28.371296] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-14T18:50:28.558822] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-09-14T18:50:29.096243] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-14T18:50:29.358841] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-09-14T18:50:29.978503] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-14T18:50:30.158836] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-09-14T18:50:30.779946] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-14T18:50:30.958828] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-09-14T18:50:31.758855] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-09-14T18:50:31.913710] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T18:50:32.195890] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-14T18:50:32.558856] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-09-14T18:50:33.340423] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T18:50:33.358772] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-09-14T18:50:34.158847] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-09-14T18:50:34.571481] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-14T18:50:34.900270] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-14T18:50:34.958787] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-09-14T18:50:35.254136] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-14T18:50:35.758859] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-09-14T18:50:36.564256] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-09-14T18:50:36.580536] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-14T18:50:37.094359] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-14T18:50:37.358880] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-09-14T18:50:37.983562] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-14T18:50:38.158926] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-09-14T18:50:38.958807] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-09-14T18:50:39.444762] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-14T18:50:39.492199] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-14T18:50:39.758844] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-09-14T18:50:40.558890] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-09-14T18:50:40.780794] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-14T18:50:40.812191] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-14T18:50:41.358878] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-09-14T18:50:42.158796] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-09-14T18:50:42.649072] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-14T18:50:42.701110] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T18:50:42.704552] [INFO ] [REMOTE ] LII: Full fetch complete (31469 records). [2025-09-14T18:50:42.704724] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-09-14T18:50:42.965591] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-09-14T18:50:43.090667] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-09-14T18:50:43.090847] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-09-14T18:50:43.091709] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-09-14T18:50:43.091809] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-09-14T18:50:43.092890] [DEBUG] [LOCAL ] LII: Trimmed 31469 records to 20548 (keeping 150 days of data) [2025-09-14T18:50:43.216109] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T18:50:43.264188] [DEBUG] [LOCAL ] LII: Primary data saved (20548 records). [2025-09-14T18:50:43.264359] [INFO ] [MAIN ] LII: Full history saved. [2025-09-14T18:50:43.264465] [INFO ] [MAIN ] Update Progress: 1258/2370 symbols completed. LII took 23.0s. Estimated remaining: 1h 58m 2s. Rate: 9.4 symbols/min [2025-09-14T18:50:43.431425] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:50:43.434503] [DEBUG] [LOCAL ] LITB: Loaded 1316 existing records from primary storage. [2025-09-14T18:50:43.434599] [INFO ] [MAIN ] LITB: Loaded 1316 existing records. [2025-09-14T18:50:43.609056] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:50:43.609329] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-09-14T18:50:43.609407] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-09-14T18:50:43.609678] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-09-14T18:50:43.609743] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-09-14T18:50:43.764942] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-09-14T18:50:43.962013] [INFO ] [REMOTE ] LITB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:50:44.558839] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-09-14T18:50:44.798016] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T18:50:45.221224] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:50:45.224762] [INFO ] [REMOTE ] LH: Full fetch complete (42352 records). [2025-09-14T18:50:45.224884] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-09-14T18:50:45.373438] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-09-14T18:50:45.556888] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-14T18:50:45.634906] [INFO ] [REMOTE ] LION: Full fetch complete (43849 records). [2025-09-14T18:50:45.645916] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-09-14T18:50:45.646078] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-09-14T18:50:45.646272] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-09-14T18:50:45.647450] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-09-14T18:50:45.647663] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-09-14T18:50:45.752417] [DEBUG] [LOCAL ] LH: Trimmed 42352 records to 28629 (keeping 150 days of data) [2025-09-14T18:50:46.167677] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-09-14T18:50:46.185437] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-09-14T18:50:46.196872] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-09-14T18:50:46.248943] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T18:50:46.252419] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-09-14T18:50:46.263050] [INFO ] [REMOTE ] LHX: Full fetch complete (53604 records). [2025-09-14T18:50:46.263255] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-09-14T18:50:46.263782] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-09-14T18:50:46.332184] [DEBUG] [LOCAL ] LION: Trimmed 43849 records to 35561 (keeping 150 days of data) [2025-09-14T18:50:46.537089] [DEBUG] [LOCAL ] LH: Primary data saved (28629 records). [2025-09-14T18:50:46.553564] [INFO ] [MAIN ] LH: Full history saved. [2025-09-14T18:50:46.561030] [INFO ] [MAIN ] Update Progress: 1259/2370 symbols completed. LH took 31.9s. Estimated remaining: 1h 57m 53s. Rate: 9.4 symbols/min [2025-09-14T18:50:46.799164] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-14T18:50:46.959621] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-09-14T18:50:46.956544] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:50:46.959881] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-09-14T18:50:46.966411] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-09-14T18:50:46.968185] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-09-14T18:50:47.011739] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-09-14T18:50:47.058712] [DEBUG] [LOCAL ] LHX: Trimmed 53604 records to 36949 (keeping 150 days of data) [2025-09-14T18:50:47.076779] [DEBUG] [LOCAL ] LLY: Loaded 23916 existing records from primary storage. [2025-09-14T18:50:47.158442] [INFO ] [MAIN ] LLY: Loaded 23916 existing records. [2025-09-14T18:50:47.252431] [DEBUG] [LOCAL ] LION: Primary data saved (35561 records). [2025-09-14T18:50:47.292250] [INFO ] [MAIN ] LION: Full history saved. [2025-09-14T18:50:47.292818] [INFO ] [MAIN ] Update Progress: 1260/2370 symbols completed. LION took 24.6s. Estimated remaining: 1h 57m 41s. Rate: 9.4 symbols/min [2025-09-14T18:50:47.731082] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:50:47.757606] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-09-14T18:50:47.804904] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-09-14T18:50:47.815117] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-14T18:50:47.819972] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-09-14T18:50:47.835575] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-09-14T18:50:47.937097] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-09-14T18:50:47.961511] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:50:48.241379] [DEBUG] [LOCAL ] LMND: Loaded 23614 existing records from primary storage. [2025-09-14T18:50:48.308762] [INFO ] [MAIN ] LMND: Loaded 23614 existing records. [2025-09-14T18:50:48.624513] [INFO ] [REMOTE ] LLY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:50:48.641961] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-09-14T18:50:48.701269] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:50:48.702026] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-09-14T18:50:48.702103] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-09-14T18:50:48.703105] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-09-14T18:50:48.703317] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-09-14T18:50:49.019677] [DEBUG] [LOCAL ] LHX: Primary data saved (36949 records). [2025-09-14T18:50:49.047593] [INFO ] [MAIN ] LHX: Full history saved. [2025-09-14T18:50:49.075968] [INFO ] [MAIN ] Update Progress: 1261/2370 symbols completed. LHX took 29.0s. Estimated remaining: 1h 57m 31s. Rate: 9.4 symbols/min [2025-09-14T18:50:49.075810] [INFO ] [REMOTE ] LMND: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:50:49.082765] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-14T18:50:49.259814] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:50:49.284094] [DEBUG] [LOCAL ] LMT: Loaded 22737 existing records from primary storage. [2025-09-14T18:50:49.284257] [INFO ] [MAIN ] LMT: Loaded 22737 existing records. [2025-09-14T18:50:49.363976] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-09-14T18:50:49.469449] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:50:49.469698] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-09-14T18:50:49.469771] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-09-14T18:50:49.470463] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-09-14T18:50:49.470544] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-09-14T18:50:49.830943] [INFO ] [REMOTE ] LMT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:50:50.158868] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-09-14T18:50:50.958902] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-09-14T18:50:51.173634] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-09-14T18:50:51.475803] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-14T18:50:51.477440] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-14T18:50:51.758881] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-09-14T18:50:51.957860] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-14T18:50:52.558849] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-09-14T18:50:53.358853] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-09-14T18:50:53.622061] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T18:50:53.759906] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-14T18:50:54.158854] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-09-14T18:50:54.698561] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-14T18:50:54.908392] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-14T18:50:54.958812] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-09-14T18:50:55.758839] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-09-14T18:50:56.558797] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-09-14T18:50:57.044948] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-14T18:50:57.358821] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-09-14T18:50:57.735357] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-14T18:50:58.071021] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T18:50:58.158789] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-09-14T18:50:58.311001] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-09-14T18:50:58.958833] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-09-14T18:50:59.611485] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T18:50:59.612865] [INFO ] [REMOTE ] LITB: Full fetch complete (4430 records). [2025-09-14T18:50:59.612960] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-09-14T18:50:59.764086] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-09-14T18:50:59.974534] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-09-14T18:50:59.974657] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-09-14T18:50:59.974817] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-09-14T18:50:59.974876] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-09-14T18:50:59.975282] [DEBUG] [LOCAL ] LITB: Trimmed 4430 records to 2497 (keeping 150 days of data) [2025-09-14T18:50:59.990134] [DEBUG] [LOCAL ] LITB: Primary data saved (2497 records). [2025-09-14T18:50:59.990226] [INFO ] [MAIN ] LITB: Full history saved. [2025-09-14T18:50:59.990317] [INFO ] [MAIN ] Update Progress: 1262/2370 symbols completed. LITB took 16.7s. Estimated remaining: 1h 57m 29s. Rate: 9.4 symbols/min [2025-09-14T18:51:00.168855] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:51:00.201123] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-14T18:51:00.225452] [DEBUG] [LOCAL ] LNC: Loaded 23111 existing records from primary storage. [2025-09-14T18:51:00.225624] [INFO ] [MAIN ] LNC: Loaded 23111 existing records. [2025-09-14T18:51:00.398720] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:51:00.399014] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-09-14T18:51:00.399903] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-09-14T18:51:00.400453] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-09-14T18:51:00.400513] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-09-14T18:51:00.570610] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-09-14T18:51:00.754584] [INFO ] [REMOTE ] LNC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:51:01.358895] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-09-14T18:51:02.158842] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-09-14T18:51:02.511681] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-09-14T18:51:02.958845] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-09-14T18:51:03.463127] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.89 seconds). [2025-09-14T18:51:03.758851] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-09-14T18:51:05.248187] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (3.89 seconds). [2025-09-14T18:51:05.258942] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-09-14T18:51:05.715049] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (3.56 seconds). [2025-09-14T18:51:05.727985] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-09-14T18:51:06.356258] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-14T18:51:06.366862] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-09-14T18:51:06.624947] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-14T18:51:06.958888] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-09-14T18:51:07.214446] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (4.26 seconds). [2025-09-14T18:51:07.758819] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-09-14T18:51:08.010891] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-14T18:51:08.558908] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-09-14T18:51:08.661428] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-14T18:51:08.884972] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-14T18:51:09.358869] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-09-14T18:51:10.158869] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-09-14T18:51:10.342572] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-09-14T18:51:10.433573] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-14T18:51:10.958905] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-09-14T18:51:11.713722] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-14T18:51:11.758792] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-09-14T18:51:11.800352] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-14T18:51:12.558912] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-09-14T18:51:13.283453] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T18:51:13.289030] [INFO ] [REMOTE ] LMT: Full fetch complete (54565 records). [2025-09-14T18:51:13.289197] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-09-14T18:51:13.368413] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-09-14T18:51:13.683624] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-09-14T18:51:13.683963] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-09-14T18:51:13.685612] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-09-14T18:51:13.686038] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-09-14T18:51:13.703581] [DEBUG] [LOCAL ] LMT: Trimmed 54565 records to 37406 (keeping 150 days of data) [2025-09-14T18:51:13.703348] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-14T18:51:13.711277] [INFO ] [REMOTE ] LMND: Full fetch complete (56458 records). [2025-09-14T18:51:13.711706] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-09-14T18:51:13.934920] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.98 seconds). [2025-09-14T18:51:14.162014] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-09-14T18:51:14.263214] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-09-14T18:51:14.263988] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-09-14T18:51:14.265324] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-09-14T18:51:14.265904] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-09-14T18:51:14.269705] [DEBUG] [LOCAL ] LMND: Trimmed 56458 records to 39073 (keeping 150 days of data) [2025-09-14T18:51:14.613426] [DEBUG] [LOCAL ] LMND: Primary data saved (39073 records). [2025-09-14T18:51:14.614790] [INFO ] [MAIN ] LMND: Full history saved. [2025-09-14T18:51:14.614922] [INFO ] [MAIN ] Update Progress: 1263/2370 symbols completed. LMND took 27.3s. Estimated remaining: 1h 57m 29s. Rate: 9.4 symbols/min [2025-09-14T18:51:14.795129] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:51:14.802897] [DEBUG] [LOCAL ] LND: Loaded 2311 existing records from primary storage. [2025-09-14T18:51:14.804664] [INFO ] [MAIN ] LND: Loaded 2311 existing records. [2025-09-14T18:51:14.989096] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:51:14.990933] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-09-14T18:51:14.991282] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-09-14T18:51:14.994669] [DEBUG] [LOCAL ] LMT: Primary data saved (37406 records). [2025-09-14T18:51:14.994900] [INFO ] [MAIN ] LMT: Full history saved. [2025-09-14T18:51:14.995015] [INFO ] [MAIN ] Update Progress: 1264/2370 symbols completed. LMT took 25.9s. Estimated remaining: 1h 57m 18s. Rate: 9.4 symbols/min [2025-09-14T18:51:14.995049] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-09-14T18:51:14.995197] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-09-14T18:51:15.377599] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:51:15.573980] [INFO ] [REMOTE ] LND: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:51:15.574576] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-09-14T18:51:15.617536] [DEBUG] [LOCAL ] LNG: Loaded 22929 existing records from primary storage. [2025-09-14T18:51:15.619718] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-14T18:51:15.619822] [INFO ] [MAIN ] LNG: Loaded 22929 existing records. [2025-09-14T18:51:15.763865] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-09-14T18:51:15.819509] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:51:15.819735] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-09-14T18:51:15.819808] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-09-14T18:51:15.820440] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-09-14T18:51:15.820500] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-09-14T18:51:16.174713] [INFO ] [REMOTE ] LNG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:51:16.360018] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-14T18:51:16.558843] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-09-14T18:51:17.287677] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-14T18:51:17.358878] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-09-14T18:51:17.678288] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-14T18:51:18.068688] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (3.91 seconds). [2025-09-14T18:51:18.069552] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-14T18:51:18.158774] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-09-14T18:51:18.837237] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:51:18.843144] [INFO ] [REMOTE ] LLY: Full fetch complete (57941 records). [2025-09-14T18:51:18.843304] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-09-14T18:51:18.964029] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-09-14T18:51:19.289328] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-09-14T18:51:19.289437] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-09-14T18:51:19.290308] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-09-14T18:51:19.290368] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-09-14T18:51:19.291620] [DEBUG] [LOCAL ] LLY: Trimmed 57941 records to 40112 (keeping 150 days of data) [2025-09-14T18:51:19.570832] [DEBUG] [LOCAL ] LLY: Primary data saved (40112 records). [2025-09-14T18:51:19.570996] [INFO ] [MAIN ] LLY: Full history saved. [2025-09-14T18:51:19.571113] [INFO ] [MAIN ] Update Progress: 1265/2370 symbols completed. LLY took 33.0s. Estimated remaining: 1h 57m 10s. Rate: 9.4 symbols/min [2025-09-14T18:51:19.748616] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:51:19.756834] [DEBUG] [LOCAL ] LNN: Loaded 5446 existing records from primary storage. [2025-09-14T18:51:19.757170] [INFO ] [MAIN ] LNN: Loaded 5446 existing records. [2025-09-14T18:51:19.771975] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-09-14T18:51:19.782712] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T18:51:19.945958] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:51:19.946238] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-09-14T18:51:19.946299] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-09-14T18:51:19.946585] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-09-14T18:51:19.946671] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-09-14T18:51:20.298064] [INFO ] [REMOTE ] LNN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:51:20.558854] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-09-14T18:51:21.358825] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-09-14T18:51:21.728365] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-14T18:51:22.162822] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-09-14T18:51:22.165916] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-14T18:51:22.270133] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T18:51:22.770482] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-14T18:51:22.958838] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-09-14T18:51:23.758842] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-09-14T18:51:23.831966] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T18:51:24.475485] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T18:51:24.481287] [INFO ] [REMOTE ] LNC: Full fetch complete (56126 records). [2025-09-14T18:51:24.481463] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-09-14T18:51:24.563988] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-09-14T18:51:24.898421] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-09-14T18:51:24.898526] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-09-14T18:51:24.899824] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-09-14T18:51:24.899915] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-09-14T18:51:24.902795] [DEBUG] [LOCAL ] LNC: Trimmed 56126 records to 38705 (keeping 150 days of data) [2025-09-14T18:51:25.155275] [DEBUG] [LOCAL ] LNC: Primary data saved (38705 records). [2025-09-14T18:51:25.155473] [INFO ] [MAIN ] LNC: Full history saved. [2025-09-14T18:51:25.155711] [INFO ] [MAIN ] Update Progress: 1266/2370 symbols completed. LNC took 25.2s. Estimated remaining: 1h 57m 3s. Rate: 9.4 symbols/min [2025-09-14T18:51:25.332743] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:51:25.338221] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-14T18:51:25.359020] [DEBUG] [LOCAL ] LOAR: Loaded 18986 existing records from primary storage. [2025-09-14T18:51:25.359088] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-09-14T18:51:25.359435] [INFO ] [MAIN ] LOAR: Loaded 18986 existing records. [2025-09-14T18:51:25.549928] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:51:25.550192] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-09-14T18:51:25.550254] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-09-14T18:51:25.550965] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-09-14T18:51:25.551039] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-09-14T18:51:25.911001] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:51:26.158822] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-09-14T18:51:26.442900] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T18:51:26.958849] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-09-14T18:51:27.758848] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-09-14T18:51:27.819882] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T18:51:28.265123] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-14T18:51:28.458418] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-14T18:51:28.558836] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-09-14T18:51:29.358835] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-09-14T18:51:29.488897] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-14T18:51:29.939081] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T18:51:29.940469] [INFO ] [REMOTE ] LND: Full fetch complete (5993 records). [2025-09-14T18:51:29.940581] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-09-14T18:51:30.164423] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-09-14T18:51:30.321672] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-09-14T18:51:30.321778] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-09-14T18:51:30.321966] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-09-14T18:51:30.322028] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-09-14T18:51:30.322434] [DEBUG] [LOCAL ] LND: Trimmed 5993 records to 3677 (keeping 150 days of data) [2025-09-14T18:51:30.343802] [DEBUG] [LOCAL ] LND: Primary data saved (3677 records). [2025-09-14T18:51:30.343894] [INFO ] [MAIN ] LND: Full history saved. [2025-09-14T18:51:30.344024] [INFO ] [MAIN ] Update Progress: 1267/2370 symbols completed. LND took 15.7s. Estimated remaining: 1h 56m 56s. Rate: 9.4 symbols/min [2025-09-14T18:51:30.520086] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:51:30.535386] [DEBUG] [LOCAL ] LOB: Loaded 11421 existing records from primary storage. [2025-09-14T18:51:30.535563] [INFO ] [MAIN ] LOB: Loaded 11421 existing records. [2025-09-14T18:51:30.724523] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:51:30.724839] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-09-14T18:51:30.724908] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-09-14T18:51:30.725245] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-09-14T18:51:30.725317] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-09-14T18:51:30.965139] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-09-14T18:51:31.097477] [INFO ] [REMOTE ] LOB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:51:31.758877] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-09-14T18:51:32.343062] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-14T18:51:32.395692] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T18:51:32.558864] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-09-14T18:51:33.032950] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-14T18:51:33.358867] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-09-14T18:51:33.634998] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-14T18:51:34.158902] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-09-14T18:51:34.566053] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-14T18:51:34.958928] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-09-14T18:51:34.974190] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-14T18:51:35.758940] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-09-14T18:51:36.487716] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-14T18:51:36.558775] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-09-14T18:51:37.358859] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-09-14T18:51:37.419525] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-14T18:51:37.779963] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-14T18:51:37.803797] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-14T18:51:37.805455] [INFO ] [REMOTE ] LNN: Full fetch complete (11911 records). [2025-09-14T18:51:37.805586] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-09-14T18:51:38.162396] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-09-14T18:51:38.169100] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-09-14T18:51:38.170206] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-09-14T18:51:38.170521] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-09-14T18:51:38.170571] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-09-14T18:51:38.171156] [DEBUG] [LOCAL ] LNN: Trimmed 11911 records to 8309 (keeping 150 days of data) [2025-09-14T18:51:38.229604] [DEBUG] [LOCAL ] LNN: Primary data saved (8309 records). [2025-09-14T18:51:38.229777] [INFO ] [MAIN ] LNN: Full history saved. [2025-09-14T18:51:38.229889] [INFO ] [MAIN ] Update Progress: 1268/2370 symbols completed. LNN took 18.7s. Estimated remaining: 1h 56m 51s. Rate: 9.4 symbols/min [2025-09-14T18:51:38.406593] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:51:38.410378] [DEBUG] [LOCAL ] LOCL: Loaded 1238 existing records from primary storage. [2025-09-14T18:51:38.410501] [INFO ] [MAIN ] LOCL: Loaded 1238 existing records. [2025-09-14T18:51:38.596373] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:51:38.596744] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-09-14T18:51:38.596826] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-09-14T18:51:38.597099] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-09-14T18:51:38.597178] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-09-14T18:51:38.962716] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:51:38.962817] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-09-14T18:51:39.397430] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-14T18:51:39.758962] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-09-14T18:51:40.517494] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-14T18:51:40.558929] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-09-14T18:51:41.073334] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T18:51:41.358847] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-09-14T18:51:42.158928] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-09-14T18:51:42.497945] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-14T18:51:42.606989] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T18:51:42.958878] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-09-14T18:51:43.535135] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T18:51:43.758865] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-09-14T18:51:43.983855] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-14T18:51:43.987081] [INFO ] [REMOTE ] LOB: Full fetch complete (29313 records). [2025-09-14T18:51:43.987183] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-09-14T18:51:44.376261] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-09-14T18:51:44.376466] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-09-14T18:51:44.377163] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-09-14T18:51:44.377229] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-09-14T18:51:44.378051] [DEBUG] [LOCAL ] LOB: Trimmed 29313 records to 19624 (keeping 150 days of data) [2025-09-14T18:51:44.514546] [DEBUG] [LOCAL ] LOB: Primary data saved (19624 records). [2025-09-14T18:51:44.514746] [INFO ] [MAIN ] LOB: Full history saved. [2025-09-14T18:51:44.514850] [INFO ] [MAIN ] Update Progress: 1269/2370 symbols completed. LOB took 14.2s. Estimated remaining: 1h 56m 44s. Rate: 9.4 symbols/min [2025-09-14T18:51:44.570086] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-09-14T18:51:44.690330] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:51:44.704744] [DEBUG] [LOCAL ] LOMA: Loaded 14111 existing records from primary storage. [2025-09-14T18:51:44.704895] [INFO ] [MAIN ] LOMA: Loaded 14111 existing records. [2025-09-14T18:51:44.877061] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:51:44.877289] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-09-14T18:51:44.877350] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-09-14T18:51:44.877881] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-09-14T18:51:44.877946] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-09-14T18:51:45.191394] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-14T18:51:45.227565] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:51:45.358793] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-09-14T18:51:45.905270] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-14T18:51:46.158840] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-09-14T18:51:46.654479] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-14T18:51:46.958831] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-09-14T18:51:47.433363] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-14T18:51:47.758834] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-09-14T18:51:47.990966] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T18:51:48.558842] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-09-14T18:51:49.358852] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-09-14T18:51:49.577923] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T18:51:49.923238] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-14T18:51:50.144562] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-14T18:51:50.150626] [INFO ] [REMOTE ] LNG: Full fetch complete (56305 records). [2025-09-14T18:51:50.150781] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-09-14T18:51:50.164016] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-09-14T18:51:50.540593] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-09-14T18:51:50.540719] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-09-14T18:51:50.541589] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-09-14T18:51:50.541659] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-09-14T18:51:50.542911] [DEBUG] [LOCAL ] LNG: Trimmed 56305 records to 38725 (keeping 150 days of data) [2025-09-14T18:51:50.805757] [DEBUG] [LOCAL ] LNG: Primary data saved (38725 records). [2025-09-14T18:51:50.805959] [INFO ] [MAIN ] LNG: Full history saved. [2025-09-14T18:51:50.806082] [INFO ] [MAIN ] Update Progress: 1270/2370 symbols completed. LNG took 35.8s. Estimated remaining: 1h 56m 38s. Rate: 9.4 symbols/min [2025-09-14T18:51:50.958876] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-09-14T18:51:50.977184] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:51:51.002095] [DEBUG] [LOCAL ] LOW: Loaded 23760 existing records from primary storage. [2025-09-14T18:51:51.002278] [INFO ] [MAIN ] LOW: Loaded 23760 existing records. [2025-09-14T18:51:51.189308] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:51:51.189552] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-09-14T18:51:51.189609] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-09-14T18:51:51.190334] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-09-14T18:51:51.190395] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-09-14T18:51:51.582752] [INFO ] [REMOTE ] LOW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:51:51.583494] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-14T18:51:51.606152] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-14T18:51:51.758879] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-09-14T18:51:52.558849] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-09-14T18:51:53.103307] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-14T18:51:53.358844] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-09-14T18:51:53.422613] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T18:51:53.878176] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-14T18:51:54.158841] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-09-14T18:51:54.958831] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-09-14T18:51:55.758812] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-09-14T18:51:55.815253] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T18:51:55.984129] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-14T18:51:56.174241] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-14T18:51:56.558830] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-09-14T18:51:57.358840] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-09-14T18:51:57.529819] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-14T18:51:58.158875] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-09-14T18:51:58.692078] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-14T18:51:58.812369] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-14T18:51:58.958784] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-09-14T18:51:59.495310] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-14T18:51:59.758801] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-09-14T18:52:00.558869] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-09-14T18:52:00.693002] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T18:52:01.172102] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-14T18:52:01.358835] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-09-14T18:52:01.899749] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T18:52:01.901695] [INFO ] [REMOTE ] LOCL: Full fetch complete (3304 records). [2025-09-14T18:52:01.902108] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-09-14T18:52:02.164041] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-09-14T18:52:02.288879] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-09-14T18:52:02.288985] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-09-14T18:52:02.289118] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-09-14T18:52:02.289168] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-09-14T18:52:02.289526] [DEBUG] [LOCAL ] LOCL: Trimmed 3304 records to 2141 (keeping 150 days of data) [2025-09-14T18:52:02.302461] [DEBUG] [LOCAL ] LOCL: Primary data saved (2141 records). [2025-09-14T18:52:02.302538] [INFO ] [MAIN ] LOCL: Full history saved. [2025-09-14T18:52:02.302622] [INFO ] [MAIN ] Update Progress: 1271/2370 symbols completed. LOCL took 24.1s. Estimated remaining: 1h 56m 36s. Rate: 9.4 symbols/min [2025-09-14T18:52:02.469439] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:52:02.489851] [DEBUG] [LOCAL ] LPG: Loaded 17710 existing records from primary storage. [2025-09-14T18:52:02.490031] [INFO ] [MAIN ] LPG: Loaded 17710 existing records. [2025-09-14T18:52:02.668668] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:52:02.668949] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-09-14T18:52:02.669006] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-09-14T18:52:02.669542] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-09-14T18:52:02.669602] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-09-14T18:52:02.962054] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-09-14T18:52:03.034686] [INFO ] [REMOTE ] LPG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:52:03.360515] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T18:52:03.758839] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-09-14T18:52:04.268522] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T18:52:04.558874] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-09-14T18:52:04.979632] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-14T18:52:05.358812] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-09-14T18:52:05.491229] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-14T18:52:06.158849] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-09-14T18:52:06.966425] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-09-14T18:52:06.969444] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T18:52:07.423970] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-14T18:52:07.683454] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T18:52:07.688984] [INFO ] [REMOTE ] LOW: Full fetch complete (57596 records). [2025-09-14T18:52:07.689121] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-09-14T18:52:07.763919] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-09-14T18:52:08.086323] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-09-14T18:52:08.086467] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-09-14T18:52:08.087865] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-09-14T18:52:08.087935] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-09-14T18:52:08.089623] [DEBUG] [LOCAL ] LOW: Trimmed 57596 records to 39883 (keeping 150 days of data) [2025-09-14T18:52:08.379209] [DEBUG] [LOCAL ] LOW: Primary data saved (39883 records). [2025-09-14T18:52:08.379793] [INFO ] [MAIN ] LOW: Full history saved. [2025-09-14T18:52:08.380062] [INFO ] [MAIN ] Update Progress: 1272/2370 symbols completed. LOW took 17.6s. Estimated remaining: 1h 56m 29s. Rate: 9.4 symbols/min [2025-09-14T18:52:08.564524] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-09-14T18:52:08.567468] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:52:08.585881] [DEBUG] [LOCAL ] LPL: Loaded 13628 existing records from primary storage. [2025-09-14T18:52:08.586245] [INFO ] [MAIN ] LPL: Loaded 13628 existing records. [2025-09-14T18:52:08.782939] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:52:08.783287] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-09-14T18:52:08.783357] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-09-14T18:52:08.783979] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-09-14T18:52:08.784048] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-09-14T18:52:09.209148] [INFO ] [REMOTE ] LPL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:52:09.273714] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-14T18:52:09.278474] [INFO ] [REMOTE ] LOAR: Full fetch complete (44224 records). [2025-09-14T18:52:09.278598] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-09-14T18:52:09.364032] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-09-14T18:52:09.654943] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-09-14T18:52:09.655046] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-09-14T18:52:09.656023] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-09-14T18:52:09.656083] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-09-14T18:52:09.657135] [DEBUG] [LOCAL ] LOAR: Trimmed 44224 records to 32743 (keeping 150 days of data) [2025-09-14T18:52:09.855453] [DEBUG] [LOCAL ] LOAR: Primary data saved (32743 records). [2025-09-14T18:52:09.855659] [INFO ] [MAIN ] LOAR: Full history saved. [2025-09-14T18:52:09.855763] [INFO ] [MAIN ] Update Progress: 1273/2370 symbols completed. LOAR took 44.7s. Estimated remaining: 1h 56m 19s. Rate: 9.4 symbols/min [2025-09-14T18:52:10.029946] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:52:10.042754] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-14T18:52:10.047691] [INFO ] [REMOTE ] LOMA: Full fetch complete (34165 records). [2025-09-14T18:52:10.047858] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-09-14T18:52:10.163595] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-09-14T18:52:10.245850] [DEBUG] [LOCAL ] LPX: Loaded 18158 existing records from primary storage. [2025-09-14T18:52:10.266257] [INFO ] [MAIN ] LPX: Loaded 18158 existing records. [2025-09-14T18:52:10.632464] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:52:10.634466] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-09-14T18:52:10.634824] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-09-14T18:52:10.634671] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-09-14T18:52:10.634916] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-09-14T18:52:10.635661] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-09-14T18:52:10.635843] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-09-14T18:52:10.636446] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-09-14T18:52:10.636615] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-09-14T18:52:10.667972] [DEBUG] [LOCAL ] LOMA: Trimmed 34165 records to 23254 (keeping 150 days of data) [2025-09-14T18:52:11.010310] [DEBUG] [LOCAL ] LOMA: Primary data saved (23254 records). [2025-09-14T18:52:11.041896] [INFO ] [MAIN ] LOMA: Full history saved. [2025-09-14T18:52:11.059666] [INFO ] [MAIN ] Update Progress: 1274/2370 symbols completed. LOMA took 26.5s. Estimated remaining: 1h 56m 8s. Rate: 9.4 symbols/min [2025-09-14T18:52:11.189640] [INFO ] [REMOTE ] LPX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:52:11.212442] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-09-14T18:52:11.344317] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:52:11.349496] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-14T18:52:11.374502] [DEBUG] [LOCAL ] LRN: Loaded 16426 existing records from primary storage. [2025-09-14T18:52:11.374679] [INFO ] [MAIN ] LRN: Loaded 16426 existing records. [2025-09-14T18:52:11.549482] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:52:11.549775] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-09-14T18:52:11.549836] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-09-14T18:52:11.550428] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-09-14T18:52:11.550491] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-09-14T18:52:11.710887] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-14T18:52:11.763978] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-09-14T18:52:11.938458] [INFO ] [REMOTE ] LRN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:52:12.558832] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-09-14T18:52:12.859318] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-14T18:52:12.998009] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-14T18:52:13.358834] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-09-14T18:52:13.712388] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-14T18:52:14.158845] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-09-14T18:52:14.952177] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-14T18:52:14.960350] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-09-14T18:52:15.758865] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-09-14T18:52:15.868850] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-14T18:52:16.186780] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-14T18:52:16.558840] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-09-14T18:52:17.283997] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-14T18:52:17.358837] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-09-14T18:52:17.582996] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T18:52:18.158834] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-09-14T18:52:18.850089] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-14T18:52:18.886063] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-14T18:52:18.958828] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-09-14T18:52:19.758847] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-09-14T18:52:20.505908] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T18:52:20.558819] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-09-14T18:52:21.358839] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-09-14T18:52:21.510412] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-14T18:52:22.076720] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-14T18:52:22.158816] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-09-14T18:52:22.690835] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-14T18:52:22.958836] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-09-14T18:52:23.758879] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-09-14T18:52:23.798595] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T18:52:24.558851] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-09-14T18:52:24.779706] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-14T18:52:25.358853] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-09-14T18:52:25.394952] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T18:52:26.094380] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T18:52:26.158795] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-09-14T18:52:26.425427] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T18:52:26.958902] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-09-14T18:52:27.759894] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-09-14T18:52:27.765764] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T18:52:27.826961] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-14T18:52:28.558893] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-09-14T18:52:28.897324] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-14T18:52:29.283711] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T18:52:29.287742] [INFO ] [REMOTE ] LRN: Full fetch complete (43297 records). [2025-09-14T18:52:29.287887] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-09-14T18:52:29.364082] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-09-14T18:52:29.664210] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-09-14T18:52:29.664330] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-09-14T18:52:29.665236] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-09-14T18:52:29.665304] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-09-14T18:52:29.666442] [DEBUG] [LOCAL ] LRN: Trimmed 43297 records to 29698 (keeping 150 days of data) [2025-09-14T18:52:29.857272] [DEBUG] [LOCAL ] LRN: Primary data saved (29698 records). [2025-09-14T18:52:29.857455] [INFO ] [MAIN ] LRN: Full history saved. [2025-09-14T18:52:29.857560] [INFO ] [MAIN ] Update Progress: 1275/2370 symbols completed. LRN took 18.8s. Estimated remaining: 1h 56m 12s. Rate: 9.4 symbols/min [2025-09-14T18:52:30.025143] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:52:30.044411] [DEBUG] [LOCAL ] LSPD: Loaded 18153 existing records from primary storage. [2025-09-14T18:52:30.044583] [INFO ] [MAIN ] LSPD: Loaded 18153 existing records. [2025-09-14T18:52:30.190692] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-09-14T18:52:30.272011] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:52:30.272317] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-09-14T18:52:30.272384] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-09-14T18:52:30.273064] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-09-14T18:52:30.273139] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-09-14T18:52:30.655119] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:52:30.954303] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T18:52:30.962883] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-09-14T18:52:31.735515] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-14T18:52:31.758774] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-09-14T18:52:32.559126] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-09-14T18:52:32.753468] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-14T18:52:33.149250] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-14T18:52:33.153752] [INFO ] [REMOTE ] LPL: Full fetch complete (26179 records). [2025-09-14T18:52:33.153934] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-09-14T18:52:33.367423] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-09-14T18:52:33.535822] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-09-14T18:52:33.535931] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-09-14T18:52:33.536537] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-09-14T18:52:33.536595] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-09-14T18:52:33.537472] [DEBUG] [LOCAL ] LPL: Trimmed 26179 records to 19157 (keeping 150 days of data) [2025-09-14T18:52:33.644190] [DEBUG] [LOCAL ] LPL: Primary data saved (19157 records). [2025-09-14T18:52:33.644363] [INFO ] [MAIN ] LPL: Full history saved. [2025-09-14T18:52:33.644468] [INFO ] [MAIN ] Update Progress: 1276/2370 symbols completed. LPL took 25.3s. Estimated remaining: 1h 56m 3s. Rate: 9.4 symbols/min [2025-09-14T18:52:33.823487] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:52:33.837946] [DEBUG] [LOCAL ] LTC: Loaded 13773 existing records from primary storage. [2025-09-14T18:52:33.838087] [INFO ] [MAIN ] LTC: Loaded 13773 existing records. [2025-09-14T18:52:34.012599] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:52:34.012857] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-09-14T18:52:34.012915] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-09-14T18:52:34.013560] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-09-14T18:52:34.013621] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-09-14T18:52:34.165428] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-09-14T18:52:34.376073] [INFO ] [REMOTE ] LTC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:52:34.402392] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T18:52:34.958867] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-09-14T18:52:35.157945] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-14T18:52:35.758882] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-09-14T18:52:35.983724] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-14T18:52:36.028295] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T18:52:36.098370] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-14T18:52:36.102996] [INFO ] [REMOTE ] LPG: Full fetch complete (44592 records). [2025-09-14T18:52:36.103175] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-09-14T18:52:36.480572] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-09-14T18:52:36.480696] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-09-14T18:52:36.481514] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-09-14T18:52:36.481594] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-09-14T18:52:36.482726] [DEBUG] [LOCAL ] LPG: Trimmed 44592 records to 30148 (keeping 150 days of data) [2025-09-14T18:52:36.580568] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-09-14T18:52:36.689797] [DEBUG] [LOCAL ] LPG: Primary data saved (30148 records). [2025-09-14T18:52:36.689970] [INFO ] [MAIN ] LPG: Full history saved. [2025-09-14T18:52:36.690079] [INFO ] [MAIN ] Update Progress: 1277/2370 symbols completed. LPG took 34.4s. Estimated remaining: 1h 55m 54s. Rate: 9.4 symbols/min [2025-09-14T18:52:37.358875] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-09-14T18:52:37.935280] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-14T18:52:38.158843] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-09-14T18:52:38.914898] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-14T18:52:38.958776] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-09-14T18:52:39.484754] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-14T18:52:39.758835] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-09-14T18:52:40.420041] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T18:52:40.424176] [INFO ] [REMOTE ] LPX: Full fetch complete (43601 records). [2025-09-14T18:52:40.424302] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-09-14T18:52:40.567286] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-09-14T18:52:40.823875] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-09-14T18:52:40.824045] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-09-14T18:52:40.824841] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-09-14T18:52:40.824997] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-09-14T18:52:40.850548] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-14T18:52:40.850685] [DEBUG] [LOCAL ] LPX: Trimmed 43601 records to 29818 (keeping 150 days of data) [2025-09-14T18:52:41.044206] [DEBUG] [LOCAL ] LPX: Primary data saved (29818 records). [2025-09-14T18:52:41.044384] [INFO ] [MAIN ] LPX: Full history saved. [2025-09-14T18:52:41.044498] [INFO ] [MAIN ] Update Progress: 1278/2370 symbols completed. LPX took 31.2s. Estimated remaining: 1h 55m 46s. Rate: 9.4 symbols/min [2025-09-14T18:52:41.358899] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-09-14T18:52:42.062135] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-14T18:52:42.158853] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-09-14T18:52:42.542035] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-14T18:52:42.958839] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-09-14T18:52:43.199476] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-14T18:52:43.758886] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-09-14T18:52:44.127184] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-14T18:52:44.558914] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-09-14T18:52:44.973686] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T18:52:45.358842] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-09-14T18:52:46.045282] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T18:52:46.158833] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-09-14T18:52:46.726610] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-14T18:52:46.958906] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-09-14T18:52:47.381757] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-14T18:52:47.386307] [INFO ] [REMOTE ] LTC: Full fetch complete (32505 records). [2025-09-14T18:52:47.386493] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-09-14T18:52:47.768119] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-14T18:52:47.801869] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-09-14T18:52:47.802018] [INFO ] [REMOTE ] LSPD: Full fetch complete (48071 records). [2025-09-14T18:52:47.802290] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-09-14T18:52:47.802399] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-09-14T18:52:47.803438] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-09-14T18:52:47.803789] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-09-14T18:52:47.912910] [DEBUG] [LOCAL ] LTC: Trimmed 32505 records to 22507 (keeping 150 days of data) [2025-09-14T18:52:48.320892] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-09-14T18:52:48.322356] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-09-14T18:52:48.324516] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-09-14T18:52:48.327841] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-09-14T18:52:48.348714] [DEBUG] [LOCAL ] LSPD: Trimmed 48071 records to 31705 (keeping 150 days of data) [2025-09-14T18:52:48.352976] [DEBUG] [LOCAL ] LTC: Primary data saved (22507 records). [2025-09-14T18:52:48.353078] [INFO ] [MAIN ] LTC: Full history saved. [2025-09-14T18:52:48.353199] [INFO ] [MAIN ] Update Progress: 1279/2370 symbols completed. LTC took 14.7s. Estimated remaining: 1h 55m 41s. Rate: 9.4 symbols/min [2025-09-14T18:52:48.558746] [DEBUG] [LOCAL ] LSPD: Primary data saved (31705 records). [2025-09-14T18:52:48.558930] [INFO ] [MAIN ] LSPD: Full history saved. [2025-09-14T18:52:48.559046] [INFO ] [MAIN ] Update Progress: 1280/2370 symbols completed. LSPD took 18.7s. Estimated remaining: 1h 55m 29s. Rate: 9.4 symbols/min [2025-09-14T18:52:49.234025] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:52:49.254774] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:52:49.273994] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:52:49.255711] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:52:49.292709] [DEBUG] [LOCAL ] LUCK: Loaded 9996 existing records from primary storage. [2025-09-14T18:52:49.301524] [INFO ] [MAIN ] LUCK: Loaded 9996 existing records. [2025-09-14T18:52:49.427108] [DEBUG] [LOCAL ] LTM: Loaded 18473 existing records from primary storage. [2025-09-14T18:52:49.427617] [DEBUG] [LOCAL ] LU: Loaded 21823 existing records from primary storage. [2025-09-14T18:52:49.431300] [INFO ] [MAIN ] LU: Loaded 21823 existing records. [2025-09-14T18:52:49.485253] [DEBUG] [LOCAL ] LTH: Loaded 23237 existing records from primary storage. [2025-09-14T18:52:49.465720] [INFO ] [MAIN ] LTM: Loaded 18473 existing records. [2025-09-14T18:52:49.506155] [INFO ] [MAIN ] LTH: Loaded 23237 existing records. [2025-09-14T18:52:49.635295] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:52:49.761176] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-09-14T18:52:49.816381] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-14T18:52:49.918559] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-09-14T18:52:49.918705] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:52:49.986322] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-09-14T18:52:50.024971] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-09-14T18:52:50.037887] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:52:50.062617] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-09-14T18:52:50.067467] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:52:50.062567] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-09-14T18:52:50.088178] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-09-14T18:52:50.097069] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-09-14T18:52:50.102238] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-09-14T18:52:50.124327] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-09-14T18:52:50.124548] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-09-14T18:52:50.150469] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-09-14T18:52:50.214552] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-09-14T18:52:50.242457] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-09-14T18:52:50.237301] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-09-14T18:52:51.289290] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:52:51.355764] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-14T18:52:51.397268] [INFO ] [REMOTE ] LU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:52:51.488396] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-09-14T18:52:51.533063] [INFO ] [REMOTE ] LTM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:52:51.545367] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-09-14T18:52:51.548536] [INFO ] [REMOTE ] LTH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:52:51.549726] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-09-14T18:52:52.779326] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-14T18:52:52.785235] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-09-14T18:52:52.925236] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T18:52:52.932604] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-14T18:52:53.010348] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T18:52:53.019905] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-09-14T18:52:53.189601] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-14T18:52:53.358918] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-09-14T18:52:53.986879] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T18:52:54.107034] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-14T18:52:54.158913] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-14T18:52:54.712948] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-14T18:52:54.958885] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-09-14T18:52:55.208988] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-14T18:52:55.240847] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T18:52:55.758882] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-09-14T18:52:56.513312] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T18:52:56.558854] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-09-14T18:52:57.358859] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-09-14T18:52:57.550766] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T18:52:57.839900] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T18:52:58.158889] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-14T18:52:58.942686] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-14T18:52:58.958763] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-09-14T18:52:59.545697] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-14T18:52:59.758829] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-14T18:53:00.513058] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T18:53:00.558797] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-09-14T18:53:01.286144] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-14T18:53:01.358854] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-09-14T18:53:02.023092] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-14T18:53:02.158870] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-14T18:53:02.958842] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-09-14T18:53:03.384795] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-14T18:53:03.446336] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-14T18:53:03.758874] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-09-14T18:53:04.558841] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-14T18:53:04.795348] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T18:53:05.358851] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-09-14T18:53:05.476411] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-14T18:53:05.658466] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-14T18:53:06.158856] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-09-14T18:53:06.958890] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-09-14T18:53:07.180965] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-14T18:53:07.668626] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-14T18:53:07.673913] [INFO ] [REMOTE ] LU: Full fetch complete (53116 records). [2025-09-14T18:53:07.674048] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-09-14T18:53:07.765070] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-09-14T18:53:08.055175] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-09-14T18:53:08.055298] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-09-14T18:53:08.056371] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-09-14T18:53:08.056514] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-09-14T18:53:08.057957] [DEBUG] [LOCAL ] LU: Trimmed 53116 records to 36936 (keeping 150 days of data) [2025-09-14T18:53:08.277785] [DEBUG] [LOCAL ] LU: Primary data saved (36936 records). [2025-09-14T18:53:08.277964] [INFO ] [MAIN ] LU: Full history saved. [2025-09-14T18:53:08.278126] [INFO ] [MAIN ] Update Progress: 1281/2370 symbols completed. LU took 19.7s. Estimated remaining: 1h 55m 34s. Rate: 9.4 symbols/min [2025-09-14T18:53:08.460987] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:53:08.483765] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T18:53:08.513076] [DEBUG] [LOCAL ] LUMN: Loaded 24037 existing records from primary storage. [2025-09-14T18:53:08.513258] [INFO ] [MAIN ] LUMN: Loaded 24037 existing records. [2025-09-14T18:53:08.569901] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-14T18:53:08.699596] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:53:08.699927] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-09-14T18:53:08.699996] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-09-14T18:53:08.700692] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-09-14T18:53:08.700755] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-09-14T18:53:09.067260] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:53:09.358828] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-09-14T18:53:09.591237] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-14T18:53:09.594205] [INFO ] [REMOTE ] LUCK: Full fetch complete (29022 records). [2025-09-14T18:53:09.594309] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-09-14T18:53:09.793774] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-14T18:53:10.018426] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-09-14T18:53:10.018533] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-09-14T18:53:10.019166] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-09-14T18:53:10.019223] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-09-14T18:53:10.020000] [DEBUG] [LOCAL ] LUCK: Trimmed 29022 records to 17981 (keeping 150 days of data) [2025-09-14T18:53:10.134386] [DEBUG] [LOCAL ] LUCK: Primary data saved (17981 records). [2025-09-14T18:53:10.134565] [INFO ] [MAIN ] LUCK: Full history saved. [2025-09-14T18:53:10.134699] [INFO ] [MAIN ] Update Progress: 1282/2370 symbols completed. LUCK took 21.6s. Estimated remaining: 1h 55m 24s. Rate: 9.4 symbols/min [2025-09-14T18:53:10.165660] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-09-14T18:53:10.303305] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:53:10.326403] [DEBUG] [LOCAL ] LUV: Loaded 24102 existing records from primary storage. [2025-09-14T18:53:10.326566] [INFO ] [MAIN ] LUV: Loaded 24102 existing records. [2025-09-14T18:53:10.513094] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:53:10.513356] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-09-14T18:53:10.513417] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-09-14T18:53:10.514153] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-09-14T18:53:10.514223] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-09-14T18:53:10.889048] [INFO ] [REMOTE ] LUV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:53:10.913727] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T18:53:10.958788] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-09-14T18:53:11.758854] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-09-14T18:53:11.938530] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T18:53:12.558929] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-09-14T18:53:12.664578] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-14T18:53:13.358857] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-09-14T18:53:13.468445] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T18:53:14.158835] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-09-14T18:53:14.215760] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-14T18:53:14.221061] [INFO ] [REMOTE ] LTH: Full fetch complete (56353 records). [2025-09-14T18:53:14.221193] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-09-14T18:53:14.619052] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-09-14T18:53:14.619188] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-09-14T18:53:14.620410] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-09-14T18:53:14.620477] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-09-14T18:53:14.621823] [DEBUG] [LOCAL ] LTH: Trimmed 56353 records to 38977 (keeping 150 days of data) [2025-09-14T18:53:14.859601] [DEBUG] [LOCAL ] LTH: Primary data saved (38977 records). [2025-09-14T18:53:14.859814] [INFO ] [MAIN ] LTH: Full history saved. [2025-09-14T18:53:14.859934] [INFO ] [MAIN ] Update Progress: 1283/2370 symbols completed. LTH took 26.3s. Estimated remaining: 1h 55m 16s. Rate: 9.4 symbols/min [2025-09-14T18:53:14.960465] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-09-14T18:53:15.037604] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:53:15.048704] [DEBUG] [LOCAL ] LUXE: Loaded 7772 existing records from primary storage. [2025-09-14T18:53:15.048943] [INFO ] [MAIN ] LUXE: Loaded 7772 existing records. [2025-09-14T18:53:15.247541] [WARN ] [MAIN ] LUXE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:53:15.247957] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-09-14T18:53:15.248056] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-14T18:53:15.248433] [DEBUG] [LOCAL ] LUXE: Deleted primary data file. [2025-09-14T18:53:15.248508] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-09-14T18:53:15.638005] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:53:15.654159] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-14T18:53:15.676770] [INFO ] [REMOTE ] LTM: Full fetch complete (37461 records). [2025-09-14T18:53:15.690185] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-09-14T18:53:15.692669] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-14T18:53:15.772227] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-02. [2025-09-14T18:53:16.079548] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-09-14T18:53:16.079703] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-09-14T18:53:16.080566] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-09-14T18:53:16.080625] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-09-14T18:53:16.082188] [DEBUG] [LOCAL ] LTM: Trimmed 37461 records to 28107 (keeping 150 days of data) [2025-09-14T18:53:16.134701] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:53:16.170876] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-02 [2025-09-14T18:53:16.256861] [DEBUG] [LOCAL ] LTM: Primary data saved (28107 records). [2025-09-14T18:53:16.257085] [INFO ] [MAIN ] LTM: Full history saved. [2025-09-14T18:53:16.257216] [INFO ] [MAIN ] Update Progress: 1284/2370 symbols completed. LTM took 27.7s. Estimated remaining: 1h 55m 6s. Rate: 9.4 symbols/min [2025-09-14T18:53:16.427925] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:53:16.451549] [DEBUG] [LOCAL ] LVS: Loaded 23956 existing records from primary storage. [2025-09-14T18:53:16.451740] [INFO ] [MAIN ] LVS: Loaded 23956 existing records. [2025-09-14T18:53:16.564058] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-09-14T18:53:16.634203] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:53:16.634470] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-09-14T18:53:16.634533] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-09-14T18:53:16.635264] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-09-14T18:53:16.635329] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-09-14T18:53:16.988869] [INFO ] [REMOTE ] LVS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:53:17.032114] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-14T18:53:17.358834] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-09-14T18:53:18.158833] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-09-14T18:53:18.791324] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-14T18:53:18.958855] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-09-14T18:53:19.150154] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-14T18:53:19.311381] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-14T18:53:19.758915] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-09-14T18:53:20.558851] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-03. [2025-09-14T18:53:20.809190] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:53:20.809541] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-03 [2025-09-14T18:53:20.869995] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T18:53:21.358812] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-09-14T18:53:21.819569] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-14T18:53:22.158832] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-09-14T18:53:22.228970] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-14T18:53:22.958834] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-09-14T18:53:23.758843] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-04. [2025-09-14T18:53:24.025242] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T18:53:24.025669] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-04 [2025-09-14T18:53:24.186006] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-14T18:53:24.558793] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-09-14T18:53:24.636716] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-14T18:53:25.074740] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-14T18:53:25.358829] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-09-14T18:53:26.158833] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-09-14T18:53:26.333550] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-14T18:53:26.958825] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-09-14T18:53:27.758844] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-09-14T18:53:27.876842] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-14T18:53:28.558829] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-09-14T18:53:28.627731] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T18:53:29.273743] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-14T18:53:29.358873] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-09-14T18:53:30.158810] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-05. [2025-09-14T18:53:30.332477] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-14T18:53:30.420355] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-14T18:53:30.958828] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-09-14T18:53:31.254397] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-14T18:53:31.758820] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-09-14T18:53:31.871623] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-14T18:53:32.558849] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-09-14T18:53:33.358840] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-09-14T18:53:33.796906] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-14T18:53:34.052350] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:53:34.058420] [INFO ] [REMOTE ] LVS: Full fetch complete (58244 records). [2025-09-14T18:53:34.058616] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-09-14T18:53:34.161770] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-09-14T18:53:34.443495] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-09-14T18:53:34.443628] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-09-14T18:53:34.444632] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-09-14T18:53:34.444731] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-09-14T18:53:34.446479] [DEBUG] [LOCAL ] LVS: Trimmed 58244 records to 40317 (keeping 150 days of data) [2025-09-14T18:53:34.713221] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-14T18:53:34.771258] [DEBUG] [LOCAL ] LVS: Primary data saved (40317 records). [2025-09-14T18:53:34.771449] [INFO ] [MAIN ] LVS: Full history saved. [2025-09-14T18:53:34.771609] [INFO ] [MAIN ] Update Progress: 1285/2370 symbols completed. LVS took 18.5s. Estimated remaining: 1h 55m 9s. Rate: 9.4 symbols/min [2025-09-14T18:53:34.948282] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:53:34.963219] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-09-14T18:53:34.964599] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T18:53:34.979264] [DEBUG] [LOCAL ] LVWR: Loaded 9105 existing records from primary storage. [2025-09-14T18:53:34.979008] [INFO ] [REMOTE ] LUMN: Full fetch complete (58305 records). [2025-09-14T18:53:34.979557] [INFO ] [MAIN ] LVWR: Loaded 9105 existing records. [2025-09-14T18:53:35.025039] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-09-14T18:53:35.337357] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:53:35.418728] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-09-14T18:53:35.459562] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-09-14T18:53:35.499249] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-09-14T18:53:35.541518] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-09-14T18:53:35.674352] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-09-14T18:53:35.692191] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-09-14T18:53:35.701629] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-09-14T18:53:35.718964] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-09-14T18:53:35.790841] [DEBUG] [LOCAL ] LUMN: Trimmed 58305 records to 40397 (keeping 150 days of data) [2025-09-14T18:53:35.768608] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-06. [2025-09-14T18:53:36.115731] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:53:36.136245] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-14T18:53:36.146033] [INFO ] [REMOTE ] LUV: Full fetch complete (58368 records). [2025-09-14T18:53:36.147202] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-09-14T18:53:36.561375] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-09-14T18:53:36.657363] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-09-14T18:53:36.658149] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-09-14T18:53:36.659151] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-09-14T18:53:36.659528] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-09-14T18:53:36.672910] [DEBUG] [LOCAL ] LUV: Trimmed 58368 records to 40429 (keeping 150 days of data) [2025-09-14T18:53:36.747308] [DEBUG] [LOCAL ] LUMN: Primary data saved (40397 records). [2025-09-14T18:53:36.756448] [INFO ] [MAIN ] LUMN: Full history saved. [2025-09-14T18:53:36.756688] [INFO ] [MAIN ] Update Progress: 1286/2370 symbols completed. LUMN took 28.5s. Estimated remaining: 1h 54m 59s. Rate: 9.4 symbols/min [2025-09-14T18:53:36.964149] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:53:36.987124] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T18:53:37.022846] [DEBUG] [LOCAL ] LW: Loaded 22970 existing records from primary storage. [2025-09-14T18:53:37.027728] [INFO ] [MAIN ] LW: Loaded 22970 existing records. [2025-09-14T18:53:37.316514] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:53:37.317708] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-09-14T18:53:37.318055] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-09-14T18:53:37.319573] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-09-14T18:53:37.320203] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-09-14T18:53:37.364291] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-07. [2025-09-14T18:53:37.435146] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-14T18:53:37.707913] [INFO ] [REMOTE ] LW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:53:37.728211] [DEBUG] [LOCAL ] LUV: Primary data saved (40429 records). [2025-09-14T18:53:37.728439] [INFO ] [MAIN ] LUV: Full history saved. [2025-09-14T18:53:37.728588] [INFO ] [MAIN ] Update Progress: 1287/2370 symbols completed. LUV took 27.6s. Estimated remaining: 1h 54m 48s. Rate: 9.4 symbols/min [2025-09-14T18:53:37.909427] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:53:37.919203] [DEBUG] [LOCAL ] LXFR: Loaded 7356 existing records from primary storage. [2025-09-14T18:53:37.919366] [INFO ] [MAIN ] LXFR: Loaded 7356 existing records. [2025-09-14T18:53:38.099177] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:53:38.099464] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-09-14T18:53:38.099538] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-09-14T18:53:38.099865] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-09-14T18:53:38.099932] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-09-14T18:53:38.164131] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-09-14T18:53:38.460283] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:53:38.481623] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-14T18:53:38.890126] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-14T18:53:38.958854] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-09-14T18:53:39.758783] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-08. [2025-09-14T18:53:40.133260] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-14T18:53:40.353784] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-14T18:53:40.558872] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-09. [2025-09-14T18:53:41.358836] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-09-14T18:53:41.504304] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-14T18:53:41.506956] [INFO ] [REMOTE ] LUXE: Full fetch complete (11544 records). [2025-09-14T18:53:41.507043] [DEBUG] [VALIDATOR ] LUXE: Validating primary data. [2025-09-14T18:53:41.695836] [WARN ] [VALIDATOR ] LUXE: Validation failed - insufficient historical data. Have 93 unique days, need 150 days [2025-09-14T18:53:41.696143] [FATAL] [MAIN ] LUXE: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:53:41.696200] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:53:41.696245] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-14T18:53:41.696320] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-14T18:53:41.696375] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-09-14T18:53:41.696433] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-09-14T18:53:41.696526] [INFO ] [MAIN ] Update Progress: 1288/2370 symbols completed. LUXE took 26.8s. Estimated remaining: 1h 54m 40s. Rate: 9.4 symbols/min [2025-09-14T18:53:41.877856] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:53:41.906324] [DEBUG] [LOCAL ] LXP: Loaded 22852 existing records from primary storage. [2025-09-14T18:53:41.906509] [INFO ] [MAIN ] LXP: Loaded 22852 existing records. [2025-09-14T18:53:42.080093] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:53:42.080338] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-09-14T18:53:42.080404] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-09-14T18:53:42.081108] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-09-14T18:53:42.081191] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-09-14T18:53:42.164104] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-09-14T18:53:42.444272] [INFO ] [REMOTE ] LXP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:53:42.958841] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-09-14T18:53:43.090395] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T18:53:43.287315] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T18:53:43.611658] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-14T18:53:43.758803] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-09-14T18:53:44.558848] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-09-14T18:53:44.992352] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-14T18:53:45.358906] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-09-14T18:53:46.158980] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-09-14T18:53:46.292932] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-14T18:53:46.621683] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-14T18:53:46.958877] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-09-14T18:53:47.758871] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-09-14T18:53:47.989020] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-14T18:53:48.012260] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-14T18:53:48.558841] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-09-14T18:53:49.358886] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-09-14T18:53:49.531740] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-14T18:53:49.586890] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-14T18:53:50.158836] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-09-14T18:53:50.958953] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-09-14T18:53:51.000839] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-14T18:53:51.237238] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-14T18:53:51.758836] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-09-14T18:53:52.558878] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-09-14T18:53:52.684987] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-14T18:53:52.733243] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-14T18:53:53.358883] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-09-14T18:53:54.146403] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-14T18:53:54.158782] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-09-14T18:53:54.175467] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T18:53:54.178059] [INFO ] [REMOTE ] LXFR: Full fetch complete (18900 records). [2025-09-14T18:53:54.178147] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-09-14T18:53:54.541837] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-09-14T18:53:54.541947] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-09-14T18:53:54.542404] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-09-14T18:53:54.542487] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-09-14T18:53:54.543141] [DEBUG] [LOCAL ] LXFR: Trimmed 18900 records to 12577 (keeping 150 days of data) [2025-09-14T18:53:54.619677] [DEBUG] [LOCAL ] LXFR: Primary data saved (12577 records). [2025-09-14T18:53:54.619837] [INFO ] [MAIN ] LXFR: Full history saved. [2025-09-14T18:53:54.619933] [INFO ] [MAIN ] Update Progress: 1289/2370 symbols completed. LXFR took 16.9s. Estimated remaining: 1h 54m 39s. Rate: 9.4 symbols/min [2025-09-14T18:53:54.787089] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:53:54.801476] [DEBUG] [LOCAL ] LXU: Loaded 13674 existing records from primary storage. [2025-09-14T18:53:54.801660] [INFO ] [MAIN ] LXU: Loaded 13674 existing records. [2025-09-14T18:53:54.970715] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-09-14T18:53:54.975166] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:53:54.976396] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-09-14T18:53:54.976475] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-09-14T18:53:54.976977] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-09-14T18:53:54.977058] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-09-14T18:53:55.323780] [INFO ] [REMOTE ] LXU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:53:55.758821] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-09-14T18:53:55.938485] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T18:53:56.558800] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-09-14T18:53:56.671413] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T18:53:56.890441] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-14T18:53:57.358897] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-09-14T18:53:58.046684] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-14T18:53:58.158871] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-09-14T18:53:58.633040] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T18:53:58.958861] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-09-14T18:53:59.498592] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-14T18:53:59.758924] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-09-14T18:54:00.456335] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-14T18:54:00.558798] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-09-14T18:54:01.358842] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-09-14T18:54:01.396828] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T18:54:02.158853] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-09-14T18:54:02.463981] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-14T18:54:02.958843] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-09-14T18:54:03.758902] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-09-14T18:54:05.387270] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (3.23 seconds). [2025-09-14T18:54:05.398992] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-09-14T18:54:05.421672] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (4.06 seconds). [2025-09-14T18:54:05.427120] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-09-14T18:54:05.584465] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-09-14T18:54:05.732295] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T18:54:05.738431] [INFO ] [REMOTE ] LXP: Full fetch complete (54728 records). [2025-09-14T18:54:05.738589] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-09-14T18:54:06.120075] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-09-14T18:54:06.120314] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-09-14T18:54:06.121469] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-09-14T18:54:06.121689] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-09-14T18:54:06.123553] [DEBUG] [LOCAL ] LXP: Trimmed 54728 records to 38192 (keeping 150 days of data) [2025-09-14T18:54:06.190971] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-09-14T18:54:06.250329] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-14T18:54:06.391866] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-14T18:54:06.429898] [DEBUG] [LOCAL ] LXP: Primary data saved (38192 records). [2025-09-14T18:54:06.430094] [INFO ] [MAIN ] LXP: Full history saved. [2025-09-14T18:54:06.430224] [INFO ] [MAIN ] Update Progress: 1290/2370 symbols completed. LXP took 24.7s. Estimated remaining: 1h 54m 37s. Rate: 9.4 symbols/min [2025-09-14T18:54:06.602957] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:54:06.625314] [DEBUG] [LOCAL ] LYB: Loaded 24054 existing records from primary storage. [2025-09-14T18:54:06.625493] [INFO ] [MAIN ] LYB: Loaded 24054 existing records. [2025-09-14T18:54:06.801905] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:54:06.802133] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-09-14T18:54:06.802192] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-09-14T18:54:06.802933] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-09-14T18:54:06.802997] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-09-14T18:54:06.960211] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-09-14T18:54:07.159756] [INFO ] [REMOTE ] LYB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:54:07.733386] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T18:54:07.758777] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-09-14T18:54:08.558901] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-09-14T18:54:08.895810] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-14T18:54:09.052348] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-14T18:54:09.358889] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-09-14T18:54:10.015668] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-14T18:54:10.158838] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-09-14T18:54:10.464929] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-14T18:54:10.467959] [INFO ] [REMOTE ] LXU: Full fetch complete (34672 records). [2025-09-14T18:54:10.468057] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-09-14T18:54:10.837703] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-09-14T18:54:10.837807] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-09-14T18:54:10.838428] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-09-14T18:54:10.838482] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-09-14T18:54:10.839323] [DEBUG] [LOCAL ] LXU: Trimmed 34672 records to 24142 (keeping 150 days of data) [2025-09-14T18:54:10.964457] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-09-14T18:54:10.978630] [DEBUG] [LOCAL ] LXU: Primary data saved (24142 records). [2025-09-14T18:54:10.978779] [INFO ] [MAIN ] LXU: Full history saved. [2025-09-14T18:54:10.978877] [INFO ] [MAIN ] Update Progress: 1291/2370 symbols completed. LXU took 16.4s. Estimated remaining: 1h 54m 30s. Rate: 9.4 symbols/min [2025-09-14T18:54:11.187741] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-14T18:54:11.189820] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:54:11.192661] [INFO ] [REMOTE ] LVWR: Full fetch complete (17076 records). [2025-09-14T18:54:11.192760] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-09-14T18:54:11.489604] [DEBUG] [LOCAL ] LYG: Loaded 23561 existing records from primary storage. [2025-09-14T18:54:11.490059] [INFO ] [MAIN ] LYG: Loaded 23561 existing records. [2025-09-14T18:54:11.673630] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-09-14T18:54:11.689342] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-09-14T18:54:11.723974] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-09-14T18:54:11.732544] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-09-14T18:54:11.752351] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:54:11.752766] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-09-14T18:54:11.752860] [DEBUG] [LOCAL ] LVWR: Trimmed 17076 records to 15617 (keeping 150 days of data) [2025-09-14T18:54:11.752917] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-09-14T18:54:11.753858] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-09-14T18:54:11.753930] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-09-14T18:54:11.765348] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-09-14T18:54:12.211480] [INFO ] [REMOTE ] LYG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:54:12.226199] [DEBUG] [LOCAL ] LVWR: Primary data saved (15617 records). [2025-09-14T18:54:12.226393] [INFO ] [MAIN ] LVWR: Full history saved. [2025-09-14T18:54:12.226529] [INFO ] [MAIN ] Update Progress: 1292/2370 symbols completed. LVWR took 37.5s. Estimated remaining: 1h 54m 19s. Rate: 9.4 symbols/min [2025-09-14T18:54:12.394866] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:54:12.423216] [DEBUG] [LOCAL ] LYV: Loaded 22677 existing records from primary storage. [2025-09-14T18:54:12.423439] [INFO ] [MAIN ] LYV: Loaded 22677 existing records. [2025-09-14T18:54:12.563895] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-09-14T18:54:12.603551] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:54:12.604126] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-09-14T18:54:12.604218] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-09-14T18:54:12.610366] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-09-14T18:54:12.617986] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-09-14T18:54:12.619163] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-14T18:54:12.694283] [INFO ] [REMOTE ] LW: Full fetch complete (55902 records). [2025-09-14T18:54:12.716776] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-09-14T18:54:13.246066] [INFO ] [REMOTE ] LYV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:54:13.366728] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-09-14T18:54:13.386463] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-09-14T18:54:13.418585] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-09-14T18:54:13.420034] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-09-14T18:54:13.420290] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-09-14T18:54:13.421983] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-14T18:54:13.434361] [DEBUG] [LOCAL ] LW: Trimmed 55902 records to 38350 (keeping 150 days of data) [2025-09-14T18:54:13.675181] [DEBUG] [LOCAL ] LW: Primary data saved (38350 records). [2025-09-14T18:54:13.675374] [INFO ] [MAIN ] LW: Full history saved. [2025-09-14T18:54:13.675486] [INFO ] [MAIN ] Update Progress: 1293/2370 symbols completed. LW took 36.9s. Estimated remaining: 1h 54m 8s. Rate: 9.4 symbols/min [2025-09-14T18:54:13.851808] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:54:13.868617] [DEBUG] [LOCAL ] LZB: Loaded 16243 existing records from primary storage. [2025-09-14T18:54:13.868797] [INFO ] [MAIN ] LZB: Loaded 16243 existing records. [2025-09-14T18:54:14.045759] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:54:14.046025] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-09-14T18:54:14.046085] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-09-14T18:54:14.046607] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-09-14T18:54:14.046693] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-09-14T18:54:14.163945] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-09-14T18:54:14.416337] [INFO ] [REMOTE ] LZB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:54:14.629999] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-14T18:54:14.958851] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-09-14T18:54:15.758909] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-09-14T18:54:15.852756] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-09-14T18:54:16.558893] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-09-14T18:54:17.017024] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-14T18:54:17.090618] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-14T18:54:17.358876] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-09-14T18:54:17.628463] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (3.46 seconds). [2025-09-14T18:54:18.158859] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-09-14T18:54:18.676395] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-14T18:54:18.835110] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-14T18:54:18.958847] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-09-14T18:54:19.758864] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-09-14T18:54:20.078231] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T18:54:20.558830] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-09-14T18:54:20.904352] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T18:54:21.307120] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T18:54:21.358887] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-09-14T18:54:22.158894] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-09-14T18:54:22.443948] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-14T18:54:22.887548] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-14T18:54:22.958869] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-09-14T18:54:23.758851] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-09-14T18:54:24.244537] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-14T18:54:24.392384] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-14T18:54:24.558911] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-09-14T18:54:25.358871] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-09-14T18:54:25.609357] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T18:54:26.158847] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-09-14T18:54:26.314347] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-14T18:54:26.958833] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-09-14T18:54:27.456847] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-14T18:54:27.758865] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-09-14T18:54:28.558951] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-09-14T18:54:28.666687] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-14T18:54:28.988906] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-14T18:54:29.358912] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-09-14T18:54:29.819816] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-14T18:54:30.071596] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-14T18:54:30.158849] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-09-14T18:54:30.958873] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-09-14T18:54:31.547286] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-14T18:54:31.758922] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-09-14T18:54:31.868980] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-14T18:54:32.558873] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-09-14T18:54:32.751546] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-14T18:54:32.889279] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T18:54:32.894473] [INFO ] [REMOTE ] LZB: Full fetch complete (38859 records). [2025-09-14T18:54:32.894771] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-09-14T18:54:33.334542] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-09-14T18:54:33.336930] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-14T18:54:33.337068] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-09-14T18:54:33.339206] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-09-14T18:54:33.345372] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-09-14T18:54:33.346139] [INFO ] [REMOTE ] LYG: Full fetch complete (57496 records). [2025-09-14T18:54:33.347037] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-09-14T18:54:33.353504] [DEBUG] [LOCAL ] LZB: Trimmed 38859 records to 26397 (keeping 150 days of data) [2025-09-14T18:54:33.363957] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-09-14T18:54:33.839346] [DEBUG] [LOCAL ] LZB: Primary data saved (26397 records). [2025-09-14T18:54:33.842811] [INFO ] [MAIN ] LZB: Full history saved. [2025-09-14T18:54:33.848935] [INFO ] [MAIN ] Update Progress: 1294/2370 symbols completed. LZB took 20.2s. Estimated remaining: 1h 54m 14s. Rate: 9.4 symbols/min [2025-09-14T18:54:34.061595] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-09-14T18:54:34.092051] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-09-14T18:54:34.107822] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-09-14T18:54:34.124099] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-09-14T18:54:34.125584] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:54:34.128312] [DEBUG] [LOCAL ] LYG: Trimmed 57496 records to 39753 (keeping 150 days of data) [2025-09-14T18:54:34.134291] [DEBUG] [LOCAL ] LZM: Loaded 5194 existing records from primary storage. [2025-09-14T18:54:34.186027] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-09-14T18:54:34.186394] [INFO ] [MAIN ] LZM: Loaded 5194 existing records. [2025-09-14T18:54:34.448324] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:54:34.449794] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-09-14T18:54:34.454808] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-09-14T18:54:34.455235] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-09-14T18:54:34.455299] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-09-14T18:54:34.955171] [INFO ] [REMOTE ] LZM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:54:34.963305] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-09-14T18:54:34.963397] [DEBUG] [LOCAL ] LYG: Primary data saved (39753 records). [2025-09-14T18:54:34.964508] [INFO ] [MAIN ] LYG: Full history saved. [2025-09-14T18:54:34.964678] [INFO ] [MAIN ] Update Progress: 1295/2370 symbols completed. LYG took 24.0s. Estimated remaining: 1h 54m 3s. Rate: 9.4 symbols/min [2025-09-14T18:54:35.161080] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:54:35.191892] [DEBUG] [LOCAL ] M: Loaded 23965 existing records from primary storage. [2025-09-14T18:54:35.192139] [INFO ] [MAIN ] M: Loaded 23965 existing records. [2025-09-14T18:54:35.375208] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:54:35.375574] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-09-14T18:54:35.375639] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-09-14T18:54:35.376563] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-09-14T18:54:35.376639] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-09-14T18:54:35.787327] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-14T18:54:35.786288] [INFO ] [REMOTE ] M: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:54:35.790594] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-09-14T18:54:35.845450] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T18:54:35.882097] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-14T18:54:36.558839] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-09-14T18:54:36.893101] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-14T18:54:37.248334] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T18:54:37.253981] [INFO ] [REMOTE ] LYB: Full fetch complete (58189 records). [2025-09-14T18:54:37.254121] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-09-14T18:54:37.364062] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-09-14T18:54:37.639331] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-09-14T18:54:37.639438] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-09-14T18:54:37.640346] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-09-14T18:54:37.640427] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-09-14T18:54:37.641715] [DEBUG] [LOCAL ] LYB: Trimmed 58189 records to 40365 (keeping 150 days of data) [2025-09-14T18:54:37.969586] [DEBUG] [LOCAL ] LYB: Primary data saved (40365 records). [2025-09-14T18:54:37.969829] [INFO ] [MAIN ] LYB: Full history saved. [2025-09-14T18:54:37.970000] [INFO ] [MAIN ] Update Progress: 1296/2370 symbols completed. LYB took 31.5s. Estimated remaining: 1h 53m 54s. Rate: 9.4 symbols/min [2025-09-14T18:54:38.164109] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-09-14T18:54:38.242138] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:54:38.281961] [DEBUG] [LOCAL ] MA: Loaded 23507 existing records from primary storage. [2025-09-14T18:54:38.282298] [INFO ] [MAIN ] MA: Loaded 23507 existing records. [2025-09-14T18:54:38.603828] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:54:38.604330] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-09-14T18:54:38.604427] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-09-14T18:54:38.605342] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-09-14T18:54:38.605442] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-09-14T18:54:38.967892] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-09-14T18:54:39.116601] [INFO ] [REMOTE ] MA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:54:39.339181] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-14T18:54:39.423203] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-14T18:54:39.739926] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T18:54:39.745526] [INFO ] [REMOTE ] LYV: Full fetch complete (55920 records). [2025-09-14T18:54:39.745754] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-09-14T18:54:39.766686] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-09-14T18:54:40.158294] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-09-14T18:54:40.158437] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-09-14T18:54:40.159609] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-09-14T18:54:40.159702] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-09-14T18:54:40.161502] [DEBUG] [LOCAL ] LYV: Trimmed 55920 records to 38333 (keeping 150 days of data) [2025-09-14T18:54:40.418295] [DEBUG] [LOCAL ] LYV: Primary data saved (38333 records). [2025-09-14T18:54:40.418561] [INFO ] [MAIN ] LYV: Full history saved. [2025-09-14T18:54:40.418738] [INFO ] [MAIN ] Update Progress: 1297/2370 symbols completed. LYV took 28.2s. Estimated remaining: 1h 53m 44s. Rate: 9.4 symbols/min [2025-09-14T18:54:40.572220] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-09-14T18:54:40.608699] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:54:40.633452] [DEBUG] [LOCAL ] MAA: Loaded 19600 existing records from primary storage. [2025-09-14T18:54:40.633715] [INFO ] [MAIN ] MAA: Loaded 19600 existing records. [2025-09-14T18:54:40.839059] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:54:40.840931] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-14T18:54:40.841361] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-09-14T18:54:40.844197] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-09-14T18:54:40.845472] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-09-14T18:54:40.845583] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-09-14T18:54:41.217706] [INFO ] [REMOTE ] MAA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:54:41.358918] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-09-14T18:54:41.515346] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-14T18:54:42.018541] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-14T18:54:42.158853] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-09-14T18:54:42.958849] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-09-14T18:54:43.197608] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-14T18:54:43.758837] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-09-14T18:54:44.558951] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-09-14T18:54:44.641942] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-14T18:54:45.181066] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-14T18:54:45.358876] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-09-14T18:54:46.139664] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T18:54:46.158783] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-09-14T18:54:46.286605] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-14T18:54:46.958869] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-09-14T18:54:47.056936] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-14T18:54:47.758839] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-09-14T18:54:48.558836] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-09-14T18:54:48.701040] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-14T18:54:49.054874] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-14T18:54:49.358856] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-09-14T18:54:49.438343] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T18:54:49.440552] [INFO ] [REMOTE ] LZM: Full fetch complete (13975 records). [2025-09-14T18:54:49.440673] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-09-14T18:54:49.802688] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-09-14T18:54:49.802804] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-09-14T18:54:49.803174] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-09-14T18:54:49.803241] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-09-14T18:54:49.803851] [DEBUG] [LOCAL ] LZM: Trimmed 13975 records to 9361 (keeping 150 days of data) [2025-09-14T18:54:49.859909] [DEBUG] [LOCAL ] LZM: Primary data saved (9361 records). [2025-09-14T18:54:49.860083] [INFO ] [MAIN ] LZM: Full history saved. [2025-09-14T18:54:49.860184] [INFO ] [MAIN ] Update Progress: 1298/2370 symbols completed. LZM took 16.0s. Estimated remaining: 1h 53m 40s. Rate: 9.4 symbols/min [2025-09-14T18:54:50.047712] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:54:50.070420] [DEBUG] [LOCAL ] MAC: Loaded 22074 existing records from primary storage. [2025-09-14T18:54:50.070602] [INFO ] [MAIN ] MAC: Loaded 22074 existing records. [2025-09-14T18:54:50.167704] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-09-14T18:54:50.261661] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:54:50.261964] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-09-14T18:54:50.262044] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-09-14T18:54:50.262849] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-09-14T18:54:50.262931] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-09-14T18:54:50.626053] [INFO ] [REMOTE ] MAC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:54:50.958879] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-09-14T18:54:51.294305] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-14T18:54:51.558981] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-14T18:54:51.758907] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-09-14T18:54:52.370928] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T18:54:52.558806] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-09-14T18:54:52.680615] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-14T18:54:53.358849] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-09-14T18:54:54.163898] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-09-14T18:54:54.181635] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-14T18:54:54.958850] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-09-14T18:54:55.205978] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T18:54:55.634931] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:54:55.640291] [INFO ] [REMOTE ] MA: Full fetch complete (57208 records). [2025-09-14T18:54:55.640424] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-09-14T18:54:55.767947] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-09-14T18:54:56.029569] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-09-14T18:54:56.029720] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-09-14T18:54:56.030848] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-09-14T18:54:56.030978] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-09-14T18:54:56.055050] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-14T18:54:56.055189] [DEBUG] [LOCAL ] MA: Trimmed 57208 records to 39448 (keeping 150 days of data) [2025-09-14T18:54:56.323204] [DEBUG] [LOCAL ] MA: Primary data saved (39448 records). [2025-09-14T18:54:56.323454] [INFO ] [MAIN ] MA: Full history saved. [2025-09-14T18:54:56.323592] [INFO ] [MAIN ] Update Progress: 1299/2370 symbols completed. MA took 18.4s. Estimated remaining: 1h 53m 34s. Rate: 9.4 symbols/min [2025-09-14T18:54:56.502610] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:54:56.520278] [DEBUG] [LOCAL ] MAGN: Loaded 15487 existing records from primary storage. [2025-09-14T18:54:56.520472] [INFO ] [MAIN ] MAGN: Loaded 15487 existing records. [2025-09-14T18:54:56.564089] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-09-14T18:54:56.709543] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:54:56.709830] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-09-14T18:54:56.709904] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-09-14T18:54:56.710434] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-09-14T18:54:56.710510] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-09-14T18:54:57.083980] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:54:57.358842] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-09-14T18:54:57.482177] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T18:54:58.158883] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-09-14T18:54:58.634301] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-14T18:54:58.958901] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-09-14T18:54:59.032152] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T18:54:59.444793] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-14T18:54:59.758885] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-09-14T18:55:00.558840] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-09-14T18:55:00.817179] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-14T18:55:01.358890] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-09-14T18:55:01.652466] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-14T18:55:02.158901] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-09-14T18:55:02.770153] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-14T18:55:02.869794] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-14T18:55:02.958879] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-09-14T18:55:03.758854] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-09-14T18:55:04.011693] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-14T18:55:04.535462] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T18:55:04.558794] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-09-14T18:55:05.358831] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-09-14T18:55:05.503812] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-14T18:55:06.058318] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T18:55:06.064006] [INFO ] [REMOTE ] M: Full fetch complete (58189 records). [2025-09-14T18:55:06.064173] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-09-14T18:55:06.165516] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-09-14T18:55:06.448960] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-09-14T18:55:06.449104] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-09-14T18:55:06.450260] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-09-14T18:55:06.450458] [DEBUG] [LOCAL ] M: Saving primary data. [2025-09-14T18:55:06.452181] [DEBUG] [LOCAL ] M: Trimmed 58189 records to 40298 (keeping 150 days of data) [2025-09-14T18:55:06.567765] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-14T18:55:06.741228] [DEBUG] [LOCAL ] M: Primary data saved (40298 records). [2025-09-14T18:55:06.741401] [INFO ] [MAIN ] M: Full history saved. [2025-09-14T18:55:06.741521] [INFO ] [MAIN ] Update Progress: 1300/2370 symbols completed. M took 31.8s. Estimated remaining: 1h 53m 31s. Rate: 9.4 symbols/min [2025-09-14T18:55:06.917902] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:55:06.936430] [DEBUG] [LOCAL ] MAIN: Loaded 18104 existing records from primary storage. [2025-09-14T18:55:06.936593] [INFO ] [MAIN ] MAIN: Loaded 18104 existing records. [2025-09-14T18:55:06.967715] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-09-14T18:55:07.116810] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:55:07.117069] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-09-14T18:55:07.117131] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-09-14T18:55:07.117922] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-09-14T18:55:07.117999] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-09-14T18:55:07.474558] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:55:07.758839] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-09-14T18:55:08.074221] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-14T18:55:08.558901] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-09-14T18:55:08.828092] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-14T18:55:09.358841] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-09-14T18:55:09.665661] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-14T18:55:10.158871] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-09-14T18:55:10.399222] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-14T18:55:10.835920] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-14T18:55:10.958826] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-09-14T18:55:11.546877] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-14T18:55:11.758873] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-09-14T18:55:12.558938] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-09-14T18:55:12.790426] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-14T18:55:13.236123] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-14T18:55:13.358837] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-09-14T18:55:14.036751] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:55:14.041254] [INFO ] [REMOTE ] MAA: Full fetch complete (46743 records). [2025-09-14T18:55:14.041384] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-09-14T18:55:14.163916] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-09-14T18:55:14.429500] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-09-14T18:55:14.429687] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-09-14T18:55:14.430665] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-09-14T18:55:14.430865] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-09-14T18:55:14.432220] [DEBUG] [LOCAL ] MAA: Trimmed 46743 records to 32420 (keeping 150 days of data) [2025-09-14T18:55:14.582957] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-14T18:55:14.685001] [DEBUG] [LOCAL ] MAA: Primary data saved (32420 records). [2025-09-14T18:55:14.685199] [INFO ] [MAIN ] MAA: Full history saved. [2025-09-14T18:55:14.685339] [INFO ] [MAIN ] Update Progress: 1301/2370 symbols completed. MAA took 34.3s. Estimated remaining: 1h 53m 26s. Rate: 9.4 symbols/min [2025-09-14T18:55:14.919732] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:55:14.947502] [DEBUG] [LOCAL ] MAN: Loaded 19941 existing records from primary storage. [2025-09-14T18:55:14.947740] [INFO ] [MAIN ] MAN: Loaded 19941 existing records. [2025-09-14T18:55:14.969271] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-09-14T18:55:15.151451] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:55:15.151860] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-09-14T18:55:15.151926] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-09-14T18:55:15.152772] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-09-14T18:55:15.152869] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-09-14T18:55:15.554147] [INFO ] [REMOTE ] MAN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:55:15.758830] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-09-14T18:55:15.943424] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-14T18:55:16.474994] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-14T18:55:16.481003] [INFO ] [REMOTE ] MAC: Full fetch complete (53886 records). [2025-09-14T18:55:16.481119] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-09-14T18:55:16.563904] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-09-14T18:55:16.866442] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-09-14T18:55:16.866556] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-09-14T18:55:16.867523] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-09-14T18:55:16.867593] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-09-14T18:55:16.868784] [DEBUG] [LOCAL ] MAC: Trimmed 53886 records to 37163 (keeping 150 days of data) [2025-09-14T18:55:17.004308] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-14T18:55:17.177922] [DEBUG] [LOCAL ] MAC: Primary data saved (37163 records). [2025-09-14T18:55:17.178133] [INFO ] [MAIN ] MAC: Full history saved. [2025-09-14T18:55:17.178254] [INFO ] [MAIN ] Update Progress: 1302/2370 symbols completed. MAC took 27.3s. Estimated remaining: 1h 53m 16s. Rate: 9.4 symbols/min [2025-09-14T18:55:17.359190] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-09-14T18:55:17.360587] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:55:17.375016] [DEBUG] [LOCAL ] MANU: Loaded 12034 existing records from primary storage. [2025-09-14T18:55:17.375247] [INFO ] [MAIN ] MANU: Loaded 12034 existing records. [2025-09-14T18:55:17.560509] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:55:17.560766] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-09-14T18:55:17.560843] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-09-14T18:55:17.561219] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-09-14T18:55:17.561281] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-09-14T18:55:17.928963] [INFO ] [REMOTE ] MANU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:55:18.023598] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-14T18:55:18.158825] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-09-14T18:55:18.558001] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-14T18:55:18.958777] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-09-14T18:55:19.305683] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-14T18:55:19.309435] [INFO ] [REMOTE ] MAGN: Full fetch complete (38423 records). [2025-09-14T18:55:19.309565] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-09-14T18:55:19.679683] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-09-14T18:55:19.679806] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-09-14T18:55:19.680613] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-09-14T18:55:19.680701] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-09-14T18:55:19.681752] [DEBUG] [LOCAL ] MAGN: Trimmed 38423 records to 26412 (keeping 150 days of data) [2025-09-14T18:55:19.777955] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-09-14T18:55:19.852205] [DEBUG] [LOCAL ] MAGN: Primary data saved (26412 records). [2025-09-14T18:55:19.852384] [INFO ] [MAIN ] MAGN: Full history saved. [2025-09-14T18:55:19.852576] [INFO ] [MAIN ] Update Progress: 1303/2370 symbols completed. MAGN took 23.5s. Estimated remaining: 1h 53m 7s. Rate: 9.4 symbols/min [2025-09-14T18:55:20.021086] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:55:20.043042] [DEBUG] [LOCAL ] MAS: Loaded 23410 existing records from primary storage. [2025-09-14T18:55:20.043200] [INFO ] [MAIN ] MAS: Loaded 23410 existing records. [2025-09-14T18:55:20.221454] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:55:20.221735] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-09-14T18:55:20.221809] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-09-14T18:55:20.222483] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-09-14T18:55:20.222546] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-09-14T18:55:20.573913] [INFO ] [REMOTE ] MAS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:55:20.573989] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-09-14T18:55:20.604239] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-14T18:55:20.992397] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-14T18:55:21.358827] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-09-14T18:55:22.158833] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-09-14T18:55:22.194354] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-14T18:55:22.809212] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-14T18:55:22.958840] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-09-14T18:55:23.721555] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-14T18:55:23.758798] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-09-14T18:55:24.244474] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-14T18:55:24.558822] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-09-14T18:55:25.358849] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-09-14T18:55:25.608028] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-14T18:55:26.158831] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-09-14T18:55:26.331714] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-14T18:55:26.775479] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-14T18:55:26.958835] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-09-14T18:55:27.322837] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-14T18:55:27.758812] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-09-14T18:55:28.558869] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-09-14T18:55:28.684046] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T18:55:29.310221] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T18:55:29.358811] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-09-14T18:55:30.158940] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-09-14T18:55:30.515240] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-14T18:55:30.905493] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T18:55:30.958895] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-09-14T18:55:31.759539] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-09-14T18:55:31.890200] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T18:55:32.558854] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-09-14T18:55:32.801295] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T18:55:33.007847] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-14T18:55:33.358862] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-09-14T18:55:34.077579] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T18:55:34.158836] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-09-14T18:55:34.877695] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-14T18:55:34.882668] [INFO ] [REMOTE ] MAIN: Full fetch complete (44992 records). [2025-09-14T18:55:34.882798] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-09-14T18:55:34.963911] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-09-14T18:55:35.264264] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-09-14T18:55:35.264381] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-09-14T18:55:35.265195] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-09-14T18:55:35.265255] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-09-14T18:55:35.266457] [DEBUG] [LOCAL ] MAIN: Trimmed 44992 records to 30873 (keeping 150 days of data) [2025-09-14T18:55:35.480426] [DEBUG] [LOCAL ] MAIN: Primary data saved (30873 records). [2025-09-14T18:55:35.480682] [INFO ] [MAIN ] MAIN: Full history saved. [2025-09-14T18:55:35.480929] [INFO ] [MAIN ] Update Progress: 1304/2370 symbols completed. MAIN took 28.7s. Estimated remaining: 1h 53m 8s. Rate: 9.4 symbols/min [2025-09-14T18:55:35.670751] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:55:35.689016] [DEBUG] [LOCAL ] MATV: Loaded 16017 existing records from primary storage. [2025-09-14T18:55:35.689220] [INFO ] [MAIN ] MATV: Loaded 16017 existing records. [2025-09-14T18:55:35.768459] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-09-14T18:55:35.891371] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:55:35.891816] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-09-14T18:55:35.891951] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-09-14T18:55:35.892556] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-09-14T18:55:35.892733] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-09-14T18:55:36.176874] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-14T18:55:36.242287] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-14T18:55:36.261400] [INFO ] [REMOTE ] MANU: Full fetch complete (29367 records). [2025-09-14T18:55:36.295094] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-09-14T18:55:36.322265] [INFO ] [REMOTE ] MATV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:55:36.569775] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-09-14T18:55:36.693228] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-09-14T18:55:36.693345] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-09-14T18:55:36.694048] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-09-14T18:55:36.694119] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-09-14T18:55:36.695131] [DEBUG] [LOCAL ] MANU: Trimmed 29367 records to 19444 (keeping 150 days of data) [2025-09-14T18:55:36.813563] [DEBUG] [LOCAL ] MANU: Primary data saved (19444 records). [2025-09-14T18:55:36.813752] [INFO ] [MAIN ] MANU: Full history saved. [2025-09-14T18:55:36.813863] [INFO ] [MAIN ] Update Progress: 1305/2370 symbols completed. MANU took 19.6s. Estimated remaining: 1h 52m 58s. Rate: 9.4 symbols/min [2025-09-14T18:55:36.981398] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:55:36.996822] [DEBUG] [LOCAL ] MATX: Loaded 13407 existing records from primary storage. [2025-09-14T18:55:36.996976] [INFO ] [MAIN ] MATX: Loaded 13407 existing records. [2025-09-14T18:55:37.173069] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:55:37.173371] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-09-14T18:55:37.173443] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-09-14T18:55:37.174184] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-09-14T18:55:37.174254] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-09-14T18:55:37.384884] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-09-14T18:55:37.530683] [INFO ] [REMOTE ] MATX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:55:37.689082] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-14T18:55:38.158892] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-09-14T18:55:38.273444] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-14T18:55:38.796798] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-14T18:55:38.958841] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-09-14T18:55:39.752334] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-14T18:55:39.763255] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-09-14T18:55:40.558851] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-09-14T18:55:40.709048] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T18:55:41.358919] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-09-14T18:55:41.448541] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-14T18:55:42.045792] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T18:55:42.158831] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-09-14T18:55:42.871276] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T18:55:42.877365] [INFO ] [REMOTE ] MAS: Full fetch complete (56788 records). [2025-09-14T18:55:42.877559] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-09-14T18:55:42.963142] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-09-14T18:55:43.299357] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-09-14T18:55:43.299739] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-09-14T18:55:43.301246] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-09-14T18:55:43.302960] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-14T18:55:43.315711] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-09-14T18:55:43.318038] [DEBUG] [LOCAL ] MAS: Trimmed 56788 records to 39365 (keeping 150 days of data) [2025-09-14T18:55:43.578432] [DEBUG] [LOCAL ] MAS: Primary data saved (39365 records). [2025-09-14T18:55:43.578620] [INFO ] [MAIN ] MAS: Full history saved. [2025-09-14T18:55:43.578755] [INFO ] [MAIN ] Update Progress: 1306/2370 symbols completed. MAS took 23.7s. Estimated remaining: 1h 52m 52s. Rate: 9.4 symbols/min [2025-09-14T18:55:43.747978] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:55:43.762292] [DEBUG] [LOCAL ] MAX: Loaded 13410 existing records from primary storage. [2025-09-14T18:55:43.762534] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-09-14T18:55:43.763042] [INFO ] [MAIN ] MAX: Loaded 13410 existing records. [2025-09-14T18:55:43.955128] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-14T18:55:43.960628] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:55:43.961094] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-09-14T18:55:43.965623] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-09-14T18:55:43.966723] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-09-14T18:55:43.966839] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-09-14T18:55:43.966997] [INFO ] [REMOTE ] MAN: Full fetch complete (46987 records). [2025-09-14T18:55:44.034961] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-09-14T18:55:44.587157] [INFO ] [REMOTE ] MAX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:55:44.577100] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-09-14T18:55:44.698486] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-09-14T18:55:44.698581] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-09-14T18:55:44.699431] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-09-14T18:55:44.699492] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-09-14T18:55:44.700614] [DEBUG] [LOCAL ] MAN: Trimmed 46987 records to 33038 (keeping 150 days of data) [2025-09-14T18:55:44.917940] [DEBUG] [LOCAL ] MAN: Primary data saved (33038 records). [2025-09-14T18:55:44.918133] [INFO ] [MAIN ] MAN: Full history saved. [2025-09-14T18:55:44.918247] [INFO ] [MAIN ] Update Progress: 1307/2370 symbols completed. MAN took 30.2s. Estimated remaining: 1h 52m 41s. Rate: 9.4 symbols/min [2025-09-14T18:55:45.091914] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:55:45.111612] [DEBUG] [LOCAL ] MBC: Loaded 19265 existing records from primary storage. [2025-09-14T18:55:45.111809] [INFO ] [MAIN ] MBC: Loaded 19265 existing records. [2025-09-14T18:55:45.294708] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:55:45.294994] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-09-14T18:55:45.295061] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-09-14T18:55:45.295758] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-09-14T18:55:45.295829] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-09-14T18:55:45.363980] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-09-14T18:55:45.703534] [INFO ] [REMOTE ] MBC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:55:45.706911] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-14T18:55:46.040117] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-14T18:55:46.158868] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-09-14T18:55:46.871858] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T18:55:46.958898] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-09-14T18:55:47.603885] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-14T18:55:47.758877] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-09-14T18:55:48.558853] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-09-14T18:55:48.618990] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T18:55:49.225179] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-14T18:55:49.358786] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-09-14T18:55:49.596257] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-14T18:55:50.158879] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-09-14T18:55:50.913520] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T18:55:50.958805] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-09-14T18:55:51.401915] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-14T18:55:51.758883] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-09-14T18:55:52.295765] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-14T18:55:52.558838] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-09-14T18:55:53.358848] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-09-14T18:55:53.384895] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T18:55:54.025508] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-14T18:55:54.158811] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-09-14T18:55:54.872835] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T18:55:54.958799] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-09-14T18:55:55.765892] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-09-14T18:55:55.783985] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T18:55:56.504175] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T18:55:56.558811] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-09-14T18:55:57.200548] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-14T18:55:57.358888] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-09-14T18:55:57.936399] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T18:55:57.939740] [INFO ] [REMOTE ] MATX: Full fetch complete (34308 records). [2025-09-14T18:55:57.939842] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-09-14T18:55:58.167927] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-09-14T18:55:58.342479] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T18:55:58.385046] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-09-14T18:55:58.385210] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-09-14T18:55:58.386409] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-09-14T18:55:58.386484] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-09-14T18:55:58.387939] [DEBUG] [LOCAL ] MATX: Trimmed 34308 records to 24183 (keeping 150 days of data) [2025-09-14T18:55:58.543920] [DEBUG] [LOCAL ] MATX: Primary data saved (24183 records). [2025-09-14T18:55:58.544089] [INFO ] [MAIN ] MATX: Full history saved. [2025-09-14T18:55:58.544260] [INFO ] [MAIN ] Update Progress: 1308/2370 symbols completed. MATX took 21.7s. Estimated remaining: 1h 52m 41s. Rate: 9.4 symbols/min [2025-09-14T18:55:58.738925] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:55:58.749908] [DEBUG] [LOCAL ] MBI: Loaded 10850 existing records from primary storage. [2025-09-14T18:55:58.750047] [INFO ] [MAIN ] MBI: Loaded 10850 existing records. [2025-09-14T18:55:58.924197] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:55:58.924617] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-09-14T18:55:58.924740] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-09-14T18:55:58.930372] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-09-14T18:55:58.934510] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-09-14T18:55:58.963994] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-09-14T18:55:58.965810] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-14T18:55:59.043555] [INFO ] [REMOTE ] MATV: Full fetch complete (41371 records). [2025-09-14T18:55:59.043902] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-09-14T18:55:59.664448] [INFO ] [REMOTE ] MBI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:55:59.739984] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-09-14T18:55:59.740118] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-09-14T18:55:59.740926] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-09-14T18:55:59.740993] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-09-14T18:55:59.742233] [DEBUG] [LOCAL ] MATV: Trimmed 41371 records to 27232 (keeping 150 days of data) [2025-09-14T18:55:59.793813] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-09-14T18:55:59.916988] [DEBUG] [LOCAL ] MATV: Primary data saved (27232 records). [2025-09-14T18:55:59.917184] [INFO ] [MAIN ] MATV: Full history saved. [2025-09-14T18:55:59.917292] [INFO ] [MAIN ] Update Progress: 1309/2370 symbols completed. MATV took 24.4s. Estimated remaining: 1h 52m 30s. Rate: 9.4 symbols/min [2025-09-14T18:56:00.087448] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:56:00.106545] [DEBUG] [LOCAL ] MC: Loaded 19164 existing records from primary storage. [2025-09-14T18:56:00.106735] [INFO ] [MAIN ] MC: Loaded 19164 existing records. [2025-09-14T18:56:00.280453] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:56:00.280719] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-09-14T18:56:00.280781] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-09-14T18:56:00.281406] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-09-14T18:56:00.281475] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-09-14T18:56:00.563976] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-09-14T18:56:00.645570] [INFO ] [REMOTE ] MC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:56:00.671466] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-14T18:56:01.098908] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-14T18:56:01.358840] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-09-14T18:56:01.931089] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T18:56:02.158858] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-09-14T18:56:02.194897] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-14T18:56:02.958847] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-09-14T18:56:03.758891] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-09-14T18:56:03.851001] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T18:56:03.882969] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T18:56:04.558829] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-09-14T18:56:04.739288] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-14T18:56:05.358815] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-09-14T18:56:05.409198] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-14T18:56:06.158877] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-09-14T18:56:06.876723] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-14T18:56:06.958867] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-09-14T18:56:07.499056] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-14T18:56:07.758894] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-09-14T18:56:08.558846] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-09-14T18:56:08.592727] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-14T18:56:09.045816] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-14T18:56:09.050050] [INFO ] [REMOTE ] MAX: Full fetch complete (33898 records). [2025-09-14T18:56:09.050157] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-09-14T18:56:09.374077] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-09-14T18:56:09.421711] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-09-14T18:56:09.421854] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-09-14T18:56:09.422637] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-09-14T18:56:09.422863] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-09-14T18:56:09.423943] [DEBUG] [LOCAL ] MAX: Trimmed 33898 records to 22509 (keeping 150 days of data) [2025-09-14T18:56:09.560694] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-14T18:56:09.601290] [DEBUG] [LOCAL ] MAX: Primary data saved (22509 records). [2025-09-14T18:56:09.601544] [INFO ] [MAIN ] MAX: Full history saved. [2025-09-14T18:56:09.601712] [INFO ] [MAIN ] Update Progress: 1310/2370 symbols completed. MAX took 26.0s. Estimated remaining: 1h 52m 27s. Rate: 9.4 symbols/min [2025-09-14T18:56:09.803581] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:56:09.811633] [DEBUG] [LOCAL ] MCB: Loaded 4768 existing records from primary storage. [2025-09-14T18:56:09.811891] [INFO ] [MAIN ] MCB: Loaded 4768 existing records. [2025-09-14T18:56:09.999145] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:56:09.999506] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-09-14T18:56:09.999567] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-09-14T18:56:09.999882] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-09-14T18:56:09.999948] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-09-14T18:56:10.161262] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-09-14T18:56:10.362156] [INFO ] [REMOTE ] MCB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:56:10.958871] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-09-14T18:56:11.029297] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-14T18:56:11.758857] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-09-14T18:56:11.869452] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T18:56:11.958519] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-14T18:56:12.425718] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:56:12.430693] [INFO ] [REMOTE ] MBC: Full fetch complete (46727 records). [2025-09-14T18:56:12.430920] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-09-14T18:56:12.572240] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-09-14T18:56:12.813608] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-09-14T18:56:12.813786] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-09-14T18:56:12.814559] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-09-14T18:56:12.814613] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-09-14T18:56:12.815669] [DEBUG] [LOCAL ] MBC: Trimmed 46727 records to 32070 (keeping 150 days of data) [2025-09-14T18:56:13.017586] [DEBUG] [LOCAL ] MBC: Primary data saved (32070 records). [2025-09-14T18:56:13.017764] [INFO ] [MAIN ] MBC: Full history saved. [2025-09-14T18:56:13.017865] [INFO ] [MAIN ] Update Progress: 1311/2370 symbols completed. MBC took 28.1s. Estimated remaining: 1h 52m 18s. Rate: 9.4 symbols/min [2025-09-14T18:56:13.189027] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:56:13.213598] [DEBUG] [LOCAL ] MCD: Loaded 24009 existing records from primary storage. [2025-09-14T18:56:13.213820] [INFO ] [MAIN ] MCD: Loaded 24009 existing records. [2025-09-14T18:56:13.364095] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-09-14T18:56:13.401956] [WARN ] [MAIN ] MCD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:56:13.402467] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-09-14T18:56:13.402536] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-14T18:56:13.403390] [DEBUG] [LOCAL ] MCD: Deleted primary data file. [2025-09-14T18:56:13.403458] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-09-14T18:56:13.761592] [INFO ] [REMOTE ] MCD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:56:13.788210] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-14T18:56:14.158861] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-09-14T18:56:14.432958] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T18:56:14.958792] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-09-14T18:56:15.127038] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-14T18:56:15.758838] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-09-14T18:56:15.949164] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-14T18:56:16.558832] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-09-14T18:56:16.594226] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-14T18:56:17.358834] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-09-14T18:56:17.529689] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-14T18:56:18.158794] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-09-14T18:56:18.471391] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-14T18:56:18.958841] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-09-14T18:56:19.020274] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-14T18:56:19.758809] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-09-14T18:56:19.836591] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-14T18:56:20.558847] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-09-14T18:56:21.146658] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T18:56:21.150694] [INFO ] [REMOTE ] MC: Full fetch complete (48381 records). [2025-09-14T18:56:21.150838] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-09-14T18:56:21.365743] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-09-14T18:56:21.557255] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-14T18:56:21.557428] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-09-14T18:56:21.563858] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-09-14T18:56:21.565065] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-09-14T18:56:21.565137] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-09-14T18:56:21.566467] [DEBUG] [LOCAL ] MC: Trimmed 48381 records to 33022 (keeping 150 days of data) [2025-09-14T18:56:21.767608] [DEBUG] [LOCAL ] MC: Primary data saved (33022 records). [2025-09-14T18:56:21.767788] [INFO ] [MAIN ] MC: Full history saved. [2025-09-14T18:56:21.767888] [INFO ] [MAIN ] Update Progress: 1312/2370 symbols completed. MC took 21.9s. Estimated remaining: 1h 52m 14s. Rate: 9.4 symbols/min [2025-09-14T18:56:21.935939] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:56:21.940466] [DEBUG] [LOCAL ] MCI: Loaded 2406 existing records from primary storage. [2025-09-14T18:56:21.940575] [INFO ] [MAIN ] MCI: Loaded 2406 existing records. [2025-09-14T18:56:22.148908] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:56:22.150545] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-09-14T18:56:22.150626] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-09-14T18:56:22.151821] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-09-14T18:56:22.151893] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-09-14T18:56:22.164230] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-09-14T18:56:22.523177] [INFO ] [REMOTE ] MCI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:56:22.532415] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-14T18:56:22.958836] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-09-14T18:56:23.229373] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-14T18:56:23.758843] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-09-14T18:56:23.998274] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-14T18:56:24.487217] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-14T18:56:24.558870] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-09-14T18:56:25.358819] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-09-14T18:56:25.653845] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-14T18:56:25.656605] [INFO ] [REMOTE ] MBI: Full fetch complete (27267 records). [2025-09-14T18:56:25.656713] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-09-14T18:56:26.035181] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-09-14T18:56:26.035360] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-09-14T18:56:26.036124] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-09-14T18:56:26.036251] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-09-14T18:56:26.044081] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-14T18:56:26.047044] [DEBUG] [LOCAL ] MBI: Trimmed 27267 records to 17956 (keeping 150 days of data) [2025-09-14T18:56:26.147974] [DEBUG] [LOCAL ] MBI: Primary data saved (17956 records). [2025-09-14T18:56:26.148170] [INFO ] [MAIN ] MBI: Full history saved. [2025-09-14T18:56:26.148309] [INFO ] [MAIN ] Update Progress: 1313/2370 symbols completed. MBI took 27.6s. Estimated remaining: 1h 52m 6s. Rate: 9.4 symbols/min [2025-09-14T18:56:26.168989] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-09-14T18:56:26.319726] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:56:26.336340] [DEBUG] [LOCAL ] MCK: Loaded 16306 existing records from primary storage. [2025-09-14T18:56:26.336516] [INFO ] [MAIN ] MCK: Loaded 16306 existing records. [2025-09-14T18:56:26.532115] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:56:26.532414] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-09-14T18:56:26.532475] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-09-14T18:56:26.533109] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-09-14T18:56:26.533172] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-09-14T18:56:26.900690] [INFO ] [REMOTE ] MCK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:56:26.958770] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-09-14T18:56:27.077863] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T18:56:27.758889] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-09-14T18:56:28.558836] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-09-14T18:56:28.615691] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T18:56:28.754799] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-14T18:56:29.358838] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-09-14T18:56:29.372405] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T18:56:30.158865] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-09-14T18:56:30.196838] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-14T18:56:30.849338] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-14T18:56:30.958849] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-09-14T18:56:31.758874] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-09-14T18:56:31.814542] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T18:56:32.558825] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-09-14T18:56:32.696074] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-14T18:56:33.358856] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-09-14T18:56:34.158801] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-09-14T18:56:34.282333] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T18:56:34.329313] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-14T18:56:34.743586] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-14T18:56:34.958892] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-09-14T18:56:35.694429] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T18:56:35.696062] [INFO ] [REMOTE ] MCB: Full fetch complete (12503 records). [2025-09-14T18:56:35.696149] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-09-14T18:56:35.764157] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-09-14T18:56:36.057679] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-09-14T18:56:36.057827] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-09-14T18:56:36.058258] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-09-14T18:56:36.058331] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-09-14T18:56:36.058911] [DEBUG] [LOCAL ] MCB: Trimmed 12503 records to 8245 (keeping 150 days of data) [2025-09-14T18:56:36.109481] [DEBUG] [LOCAL ] MCB: Primary data saved (8245 records). [2025-09-14T18:56:36.109684] [INFO ] [MAIN ] MCB: Full history saved. [2025-09-14T18:56:36.109811] [INFO ] [MAIN ] Update Progress: 1314/2370 symbols completed. MCB took 26.5s. Estimated remaining: 1h 52m 2s. Rate: 9.4 symbols/min [2025-09-14T18:56:36.279617] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:56:36.284994] [DEBUG] [LOCAL ] MCN: Loaded 3513 existing records from primary storage. [2025-09-14T18:56:36.285181] [INFO ] [MAIN ] MCN: Loaded 3513 existing records. [2025-09-14T18:56:36.460597] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:56:36.460917] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-09-14T18:56:36.460989] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-09-14T18:56:36.461298] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-09-14T18:56:36.461377] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-09-14T18:56:36.562872] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-09-14T18:56:36.827804] [INFO ] [REMOTE ] MCN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:56:36.842150] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-14T18:56:36.847922] [INFO ] [REMOTE ] MCD: Full fetch complete (58137 records). [2025-09-14T18:56:36.848066] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-09-14T18:56:37.236598] [DEBUG] [VALIDATOR ] MCD: All expected trading days are present. [2025-09-14T18:56:37.236755] [DEBUG] [VALIDATOR ] MCD: Primary data validation passed. [2025-09-14T18:56:37.237763] [INFO ] [MAIN ] MCD: Fetched primary data is valid. [2025-09-14T18:56:37.237824] [DEBUG] [LOCAL ] MCD: Saving primary data. [2025-09-14T18:56:37.239358] [DEBUG] [LOCAL ] MCD: Trimmed 58137 records to 40241 (keeping 150 days of data) [2025-09-14T18:56:37.361880] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-09-14T18:56:37.483480] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-14T18:56:37.535089] [DEBUG] [LOCAL ] MCD: Primary data saved (40241 records). [2025-09-14T18:56:37.535282] [INFO ] [MAIN ] MCD: Full history saved. [2025-09-14T18:56:37.535384] [INFO ] [MAIN ] Update Progress: 1315/2370 symbols completed. MCD took 24.5s. Estimated remaining: 1h 51m 52s. Rate: 9.4 symbols/min [2025-09-14T18:56:37.707048] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:56:37.724304] [DEBUG] [LOCAL ] MCO: Loaded 16749 existing records from primary storage. [2025-09-14T18:56:37.724466] [INFO ] [MAIN ] MCO: Loaded 16749 existing records. [2025-09-14T18:56:37.899231] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:56:37.899510] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-09-14T18:56:37.899582] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-09-14T18:56:37.900147] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-09-14T18:56:37.900210] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-09-14T18:56:38.166481] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-09-14T18:56:38.253054] [INFO ] [REMOTE ] MCO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:56:38.347952] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-14T18:56:38.888016] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-14T18:56:38.958788] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-09-14T18:56:39.599331] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-14T18:56:39.758849] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-09-14T18:56:40.360408] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T18:56:40.361964] [INFO ] [REMOTE ] MCI: Full fetch complete (7519 records). [2025-09-14T18:56:40.362056] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-09-14T18:56:40.566476] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-09-14T18:56:40.747512] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-09-14T18:56:40.747667] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-09-14T18:56:40.747968] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-09-14T18:56:40.748028] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-09-14T18:56:40.748696] [DEBUG] [LOCAL ] MCI: Trimmed 7519 records to 4648 (keeping 150 days of data) [2025-09-14T18:56:40.778618] [DEBUG] [LOCAL ] MCI: Primary data saved (4648 records). [2025-09-14T18:56:40.778808] [INFO ] [MAIN ] MCI: Full history saved. [2025-09-14T18:56:40.778938] [INFO ] [MAIN ] Update Progress: 1316/2370 symbols completed. MCI took 19.0s. Estimated remaining: 1h 51m 43s. Rate: 9.4 symbols/min [2025-09-14T18:56:40.948454] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:56:40.954512] [DEBUG] [LOCAL ] MCR: Loaded 4125 existing records from primary storage. [2025-09-14T18:56:40.954691] [INFO ] [MAIN ] MCR: Loaded 4125 existing records. [2025-09-14T18:56:41.129481] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:56:41.129792] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-09-14T18:56:41.129854] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-09-14T18:56:41.130225] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-09-14T18:56:41.130285] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-09-14T18:56:41.367908] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-09-14T18:56:41.488722] [INFO ] [REMOTE ] MCR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:56:42.158934] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-09-14T18:56:42.329221] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T18:56:42.958862] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-09-14T18:56:42.991336] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T18:56:43.077748] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T18:56:43.758885] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-09-14T18:56:44.558872] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-09-14T18:56:44.820626] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T18:56:45.362186] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-09-14T18:56:45.364739] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T18:56:45.571234] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-14T18:56:46.158859] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-09-14T18:56:46.167312] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T18:56:46.958901] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-09-14T18:56:47.685121] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-14T18:56:47.758843] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-09-14T18:56:47.854623] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-14T18:56:48.558833] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-09-14T18:56:49.358924] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-09-14T18:56:49.708690] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-14T18:56:50.080115] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-14T18:56:50.158788] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-09-14T18:56:50.220971] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T18:56:50.958918] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-09-14T18:56:51.758867] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-09-14T18:56:51.795032] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-14T18:56:51.915013] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-14T18:56:52.558861] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-09-14T18:56:53.232803] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T18:56:53.241142] [INFO ] [REMOTE ] MCK: Full fetch complete (43211 records). [2025-09-14T18:56:53.241397] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-09-14T18:56:53.359940] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-09-14T18:56:53.620765] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-09-14T18:56:53.620981] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-09-14T18:56:53.621877] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-09-14T18:56:53.622024] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-09-14T18:56:53.643255] [DEBUG] [LOCAL ] MCK: Trimmed 43211 records to 28906 (keeping 150 days of data) [2025-09-14T18:56:53.644141] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-14T18:56:53.852220] [DEBUG] [LOCAL ] MCK: Primary data saved (28906 records). [2025-09-14T18:56:53.852408] [INFO ] [MAIN ] MCK: Full history saved. [2025-09-14T18:56:53.852565] [INFO ] [MAIN ] Update Progress: 1317/2370 symbols completed. MCK took 27.7s. Estimated remaining: 1h 51m 42s. Rate: 9.4 symbols/min [2025-09-14T18:56:54.158842] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-09-14T18:56:54.252232] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-14T18:56:54.958879] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-09-14T18:56:55.014339] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T18:56:55.724238] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-14T18:56:55.758769] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-09-14T18:56:56.519704] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-14T18:56:56.558783] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-09-14T18:56:57.160922] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T18:56:57.162134] [INFO ] [REMOTE ] MCN: Full fetch complete (8900 records). [2025-09-14T18:56:57.162218] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-09-14T18:56:57.371035] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-09-14T18:56:57.517822] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-09-14T18:56:57.517921] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-09-14T18:56:57.518149] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-09-14T18:56:57.518201] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-09-14T18:56:57.518691] [DEBUG] [LOCAL ] MCN: Trimmed 8900 records to 6090 (keeping 150 days of data) [2025-09-14T18:56:57.554121] [DEBUG] [LOCAL ] MCN: Primary data saved (6090 records). [2025-09-14T18:56:57.554215] [INFO ] [MAIN ] MCN: Full history saved. [2025-09-14T18:56:57.554315] [INFO ] [MAIN ] Update Progress: 1318/2370 symbols completed. MCN took 21.4s. Estimated remaining: 1h 51m 33s. Rate: 9.4 symbols/min [2025-09-14T18:56:58.158874] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-09-14T18:56:58.984125] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T18:56:58.986871] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-09-14T18:56:59.008302] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T18:56:59.758824] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-09-14T18:56:59.825595] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-14T18:57:00.558830] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-09-14T18:57:01.648590] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-14T18:57:01.657752] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-09-14T18:57:02.001787] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-14T18:57:02.158881] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-09-14T18:57:04.149567] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-14T18:57:04.150948] [INFO ] [REMOTE ] MCR: Full fetch complete (9830 records). [2025-09-14T18:57:04.151044] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-09-14T18:57:04.522935] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-09-14T18:57:04.523152] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-09-14T18:57:04.523504] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-09-14T18:57:04.523587] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-09-14T18:57:04.524198] [DEBUG] [LOCAL ] MCR: Trimmed 9830 records to 6717 (keeping 150 days of data) [2025-09-14T18:57:04.582631] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (2.92 seconds). [2025-09-14T18:57:04.584670] [DEBUG] [LOCAL ] MCR: Primary data saved (6717 records). [2025-09-14T18:57:04.592143] [INFO ] [MAIN ] MCR: Full history saved. [2025-09-14T18:57:04.592521] [INFO ] [MAIN ] Update Progress: 1319/2370 symbols completed. MCR took 23.8s. Estimated remaining: 1h 51m 28s. Rate: 9.4 symbols/min [2025-09-14T18:57:04.593159] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-09-14T18:57:06.227029] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-14T18:57:06.231175] [INFO ] [REMOTE ] MCO: Full fetch complete (43682 records). [2025-09-14T18:57:06.231283] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-09-14T18:57:06.602606] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-09-14T18:57:06.602734] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-09-14T18:57:06.603497] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-09-14T18:57:06.603552] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-09-14T18:57:06.604619] [DEBUG] [LOCAL ] MCO: Trimmed 43682 records to 28401 (keeping 150 days of data) [2025-09-14T18:57:06.801262] [DEBUG] [LOCAL ] MCO: Primary data saved (28401 records). [2025-09-14T18:57:06.801454] [INFO ] [MAIN ] MCO: Full history saved. [2025-09-14T18:57:06.801592] [INFO ] [MAIN ] Update Progress: 1320/2370 symbols completed. MCO took 29.3s. Estimated remaining: 1h 51m 18s. Rate: 9.4 symbols/min [2025-09-14T18:57:07.451939] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:57:07.483914] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:57:07.453676] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:57:07.534886] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:57:07.542975] [DEBUG] [LOCAL ] MDST: Loaded 2815 existing records from primary storage. [2025-09-14T18:57:07.546108] [INFO ] [MAIN ] MDST: Loaded 2815 existing records. [2025-09-14T18:57:07.641293] [DEBUG] [LOCAL ] MCS: Loaded 9960 existing records from primary storage. [2025-09-14T18:57:07.657044] [DEBUG] [LOCAL ] MCY: Loaded 10095 existing records from primary storage. [2025-09-14T18:57:07.669286] [INFO ] [MAIN ] MCS: Loaded 9960 existing records. [2025-09-14T18:57:07.657745] [DEBUG] [LOCAL ] MD: Loaded 17246 existing records from primary storage. [2025-09-14T18:57:07.683532] [INFO ] [MAIN ] MCY: Loaded 10095 existing records. [2025-09-14T18:57:07.740817] [INFO ] [MAIN ] MD: Loaded 17246 existing records. [2025-09-14T18:57:07.952882] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:57:08.056622] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-09-14T18:57:08.101709] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-09-14T18:57:08.117222] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-09-14T18:57:08.172578] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-09-14T18:57:08.276226] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:57:08.348961] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-09-14T18:57:08.349224] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-09-14T18:57:08.328006] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:57:08.349137] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:57:08.408342] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-09-14T18:57:08.407755] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-09-14T18:57:08.408152] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-09-14T18:57:08.408816] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-09-14T18:57:08.408933] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-09-14T18:57:08.419448] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-09-14T18:57:08.484180] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-09-14T18:57:08.525949] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-09-14T18:57:08.531234] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-09-14T18:57:08.668901] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-09-14T18:57:09.180146] [INFO ] [REMOTE ] MDST: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:57:09.212087] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-09-14T18:57:09.493003] [INFO ] [REMOTE ] MCS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:57:09.553782] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-09-14T18:57:09.731590] [INFO ] [REMOTE ] MD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:57:09.769573] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-09-14T18:57:09.797510] [INFO ] [REMOTE ] MCY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:57:09.797938] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-09-14T18:57:10.442565] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-14T18:57:10.444561] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-09-14T18:57:10.789004] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-14T18:57:10.793497] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-09-14T18:57:10.996056] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-14T18:57:10.998369] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-09-14T18:57:11.311446] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T18:57:11.319591] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-09-14T18:57:11.347978] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-14T18:57:11.355464] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-09-14T18:57:11.514767] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-14T18:57:11.516588] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-09-14T18:57:11.677670] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T18:57:11.758809] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-09-14T18:57:12.155230] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-14T18:57:12.558860] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-09-14T18:57:12.828580] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T18:57:12.850074] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T18:57:12.996123] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-14T18:57:13.011665] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-14T18:57:13.358847] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-09-14T18:57:14.158858] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-09-14T18:57:14.958854] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-09-14T18:57:15.389125] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-14T18:57:15.758875] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-09-14T18:57:16.209440] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-14T18:57:16.557564] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-14T18:57:16.561923] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-09-14T18:57:17.358881] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-09-14T18:57:17.470871] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T18:57:17.976335] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-14T18:57:18.158872] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-09-14T18:57:18.753015] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-14T18:57:18.892447] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-14T18:57:18.958841] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-09-14T18:57:19.555829] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T18:57:19.557095] [INFO ] [REMOTE ] MDST: Full fetch complete (5950 records). [2025-09-14T18:57:19.557180] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-09-14T18:57:19.768962] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-09-14T18:57:19.925198] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-09-14T18:57:19.925319] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-09-14T18:57:19.925513] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-09-14T18:57:19.925621] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-09-14T18:57:19.926135] [DEBUG] [LOCAL ] MDST: Trimmed 5950 records to 4014 (keeping 150 days of data) [2025-09-14T18:57:19.953146] [DEBUG] [LOCAL ] MDST: Primary data saved (4014 records). [2025-09-14T18:57:19.953305] [INFO ] [MAIN ] MDST: Full history saved. [2025-09-14T18:57:19.953441] [INFO ] [MAIN ] Update Progress: 1321/2370 symbols completed. MDST took 13.2s. Estimated remaining: 1h 51m 17s. Rate: 9.4 symbols/min [2025-09-14T18:57:20.134116] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:57:20.157548] [DEBUG] [LOCAL ] MDT: Loaded 24089 existing records from primary storage. [2025-09-14T18:57:20.157750] [INFO ] [MAIN ] MDT: Loaded 24089 existing records. [2025-09-14T18:57:20.344952] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:57:20.345256] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-09-14T18:57:20.345319] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-09-14T18:57:20.346117] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-09-14T18:57:20.346193] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-09-14T18:57:20.564134] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-09-14T18:57:20.710096] [INFO ] [REMOTE ] MDT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:57:21.115971] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-14T18:57:21.358831] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-09-14T18:57:21.631974] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-14T18:57:22.158864] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-09-14T18:57:22.897333] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-14T18:57:22.958794] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-09-14T18:57:23.698221] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-14T18:57:23.758835] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-09-14T18:57:23.957617] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T18:57:23.960285] [INFO ] [REMOTE ] MCS: Full fetch complete (23293 records). [2025-09-14T18:57:23.960402] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-09-14T18:57:24.336610] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-09-14T18:57:24.336742] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-09-14T18:57:24.337280] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-09-14T18:57:24.337339] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-09-14T18:57:24.338046] [DEBUG] [LOCAL ] MCS: Trimmed 23293 records to 15625 (keeping 150 days of data) [2025-09-14T18:57:24.452220] [DEBUG] [LOCAL ] MCS: Primary data saved (15625 records). [2025-09-14T18:57:24.452610] [INFO ] [MAIN ] MCS: Full history saved. [2025-09-14T18:57:24.452840] [INFO ] [MAIN ] Update Progress: 1322/2370 symbols completed. MCS took 17.7s. Estimated remaining: 1h 51m 9s. Rate: 9.4 symbols/min [2025-09-14T18:57:24.560004] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-09-14T18:57:24.660455] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:57:24.684892] [DEBUG] [LOCAL ] MDU: Loaded 21338 existing records from primary storage. [2025-09-14T18:57:24.685181] [INFO ] [MAIN ] MDU: Loaded 21338 existing records. [2025-09-14T18:57:24.877745] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:57:24.878103] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-09-14T18:57:24.878171] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-09-14T18:57:24.878881] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-09-14T18:57:24.878954] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-09-14T18:57:25.255956] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-14T18:57:25.283303] [INFO ] [REMOTE ] MDU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:57:25.358810] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-09-14T18:57:25.915167] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T18:57:25.917677] [INFO ] [REMOTE ] MCY: Full fetch complete (29779 records). [2025-09-14T18:57:25.917786] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-09-14T18:57:26.167340] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-09-14T18:57:26.321833] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-09-14T18:57:26.322018] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-09-14T18:57:26.323471] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-09-14T18:57:26.323617] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-09-14T18:57:26.353349] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T18:57:26.353539] [DEBUG] [LOCAL ] MCY: Trimmed 29779 records to 17957 (keeping 150 days of data) [2025-09-14T18:57:26.494408] [DEBUG] [LOCAL ] MCY: Primary data saved (17957 records). [2025-09-14T18:57:26.494770] [INFO ] [MAIN ] MCY: Full history saved. [2025-09-14T18:57:26.494991] [INFO ] [MAIN ] Update Progress: 1323/2370 symbols completed. MCY took 19.7s. Estimated remaining: 1h 50m 59s. Rate: 9.4 symbols/min [2025-09-14T18:57:26.679522] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:57:26.687738] [DEBUG] [LOCAL ] MDV: Loaded 3815 existing records from primary storage. [2025-09-14T18:57:26.687949] [INFO ] [MAIN ] MDV: Loaded 3815 existing records. [2025-09-14T18:57:26.877765] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:57:26.878135] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-09-14T18:57:26.878207] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-09-14T18:57:26.878546] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-09-14T18:57:26.878617] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-09-14T18:57:26.964016] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-09-14T18:57:27.246783] [INFO ] [REMOTE ] MDV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:57:27.758832] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-09-14T18:57:28.286600] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-14T18:57:28.513808] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-14T18:57:28.558821] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-09-14T18:57:28.862448] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-14T18:57:29.247449] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-14T18:57:29.358888] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-09-14T18:57:30.158900] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-09-14T18:57:30.297449] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-14T18:57:30.958878] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-09-14T18:57:31.740336] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-14T18:57:31.758769] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-09-14T18:57:32.558805] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-09-14T18:57:33.064743] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-14T18:57:33.360149] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-09-14T18:57:33.377171] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T18:57:33.378778] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-14T18:57:34.158859] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-09-14T18:57:34.958912] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-09-14T18:57:35.028620] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T18:57:35.579994] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-14T18:57:35.758935] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-09-14T18:57:36.558890] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-09-14T18:57:36.626253] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-14T18:57:37.358879] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-09-14T18:57:37.940197] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-14T18:57:38.158908] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-09-14T18:57:38.188075] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-14T18:57:38.232570] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T18:57:38.958869] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-09-14T18:57:39.665988] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T18:57:39.670265] [INFO ] [REMOTE ] MD: Full fetch complete (42105 records). [2025-09-14T18:57:39.670406] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-09-14T18:57:39.762959] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-09-14T18:57:40.060531] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-09-14T18:57:40.060742] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-09-14T18:57:40.061801] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-09-14T18:57:40.061880] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-09-14T18:57:40.091160] [DEBUG] [LOCAL ] MD: Trimmed 42105 records to 29282 (keeping 150 days of data) [2025-09-14T18:57:40.092311] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-14T18:57:40.286093] [DEBUG] [LOCAL ] MD: Primary data saved (29282 records). [2025-09-14T18:57:40.286273] [INFO ] [MAIN ] MD: Full history saved. [2025-09-14T18:57:40.286443] [INFO ] [MAIN ] Update Progress: 1324/2370 symbols completed. MD took 33.5s. Estimated remaining: 1h 50m 59s. Rate: 9.4 symbols/min [2025-09-14T18:57:40.471681] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:57:40.481242] [DEBUG] [LOCAL ] MEC: Loaded 7311 existing records from primary storage. [2025-09-14T18:57:40.481407] [INFO ] [MAIN ] MEC: Loaded 7311 existing records. [2025-09-14T18:57:40.564112] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-09-14T18:57:40.671467] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:57:40.672040] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-09-14T18:57:40.678780] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-09-14T18:57:40.679050] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-14T18:57:40.681364] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-09-14T18:57:40.682100] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-09-14T18:57:41.051600] [INFO ] [REMOTE ] MEC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:57:41.358898] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-09-14T18:57:42.158856] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-09-14T18:57:42.212287] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-14T18:57:42.501939] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-14T18:57:42.748264] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T18:57:42.750676] [INFO ] [REMOTE ] MDV: Full fetch complete (9362 records). [2025-09-14T18:57:42.750941] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-09-14T18:57:42.964029] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-09-14T18:57:43.121297] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-09-14T18:57:43.121444] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-09-14T18:57:43.121873] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-09-14T18:57:43.121952] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-09-14T18:57:43.122570] [DEBUG] [LOCAL ] MDV: Trimmed 9362 records to 6596 (keeping 150 days of data) [2025-09-14T18:57:43.163806] [DEBUG] [LOCAL ] MDV: Primary data saved (6596 records). [2025-09-14T18:57:43.163986] [INFO ] [MAIN ] MDV: Full history saved. [2025-09-14T18:57:43.164147] [INFO ] [MAIN ] Update Progress: 1325/2370 symbols completed. MDV took 16.7s. Estimated remaining: 1h 50m 50s. Rate: 9.4 symbols/min [2025-09-14T18:57:43.332035] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:57:43.342995] [DEBUG] [LOCAL ] MED: Loaded 9439 existing records from primary storage. [2025-09-14T18:57:43.343155] [INFO ] [MAIN ] MED: Loaded 9439 existing records. [2025-09-14T18:57:43.517634] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:57:43.517956] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-09-14T18:57:43.518053] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-09-14T18:57:43.518535] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-09-14T18:57:43.518610] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-09-14T18:57:43.767144] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-09-14T18:57:43.903968] [INFO ] [REMOTE ] MED: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:57:44.558810] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-09-14T18:57:44.866491] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-14T18:57:45.162743] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-14T18:57:45.358836] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-09-14T18:57:45.701314] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T18:57:46.058914] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T18:57:46.064407] [INFO ] [REMOTE ] MDT: Full fetch complete (58357 records). [2025-09-14T18:57:46.064619] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-09-14T18:57:46.166573] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-09-14T18:57:46.451003] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-09-14T18:57:46.451151] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-09-14T18:57:46.452139] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-09-14T18:57:46.452199] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-09-14T18:57:46.453666] [DEBUG] [LOCAL ] MDT: Trimmed 58357 records to 40418 (keeping 150 days of data) [2025-09-14T18:57:46.737941] [DEBUG] [LOCAL ] MDT: Primary data saved (40418 records). [2025-09-14T18:57:46.738093] [INFO ] [MAIN ] MDT: Full history saved. [2025-09-14T18:57:46.738211] [INFO ] [MAIN ] Update Progress: 1326/2370 symbols completed. MDT took 26.8s. Estimated remaining: 1h 50m 41s. Rate: 9.4 symbols/min [2025-09-14T18:57:46.905841] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:57:46.920952] [DEBUG] [LOCAL ] MEG: Loaded 13436 existing records from primary storage. [2025-09-14T18:57:46.921110] [INFO ] [MAIN ] MEG: Loaded 13436 existing records. [2025-09-14T18:57:46.967543] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-09-14T18:57:47.110748] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:57:47.111052] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-09-14T18:57:47.111118] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-09-14T18:57:47.111619] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-09-14T18:57:47.111713] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-09-14T18:57:47.459500] [INFO ] [REMOTE ] MEG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:57:47.758868] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-09-14T18:57:47.836999] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-14T18:57:47.897681] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-14T18:57:48.558854] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-09-14T18:57:49.245695] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T18:57:49.358862] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-09-14T18:57:49.536479] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-14T18:57:50.158901] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-09-14T18:57:50.635616] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-14T18:57:50.958834] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-09-14T18:57:51.758878] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-09-14T18:57:51.913940] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-14T18:57:51.976386] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T18:57:52.558834] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-09-14T18:57:53.274918] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T18:57:53.358833] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-09-14T18:57:53.990032] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-14T18:57:54.158820] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-09-14T18:57:54.868778] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T18:57:54.888141] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-14T18:57:54.958860] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-09-14T18:57:55.758823] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-09-14T18:57:56.068092] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T18:57:56.558852] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-09-14T18:57:56.794022] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-14T18:57:57.358867] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-09-14T18:57:57.611490] [DEBUG] [REMOTE ] MEG: Error fetching primary data for 2025-05: ("Connection broken: InvalidChunkLength(got length b'', 0 bytes read)", InvalidChunkLength(got length b'', 0 bytes read)) [2025-09-14T18:57:57.611713] [WARN ] [REMOTE ] MEG: No data returned for month 2025-05 [2025-09-14T18:57:58.158855] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-09-14T18:57:58.670699] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T18:57:58.958882] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-09-14T18:57:59.758916] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-09-14T18:57:59.970193] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-14T18:58:00.021313] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-14T18:58:00.558893] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-09-14T18:58:01.053258] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T18:58:01.358798] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-09-14T18:58:02.158858] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-09-14T18:58:02.172755] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T18:58:02.941090] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T18:58:02.958832] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-09-14T18:58:03.014961] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-14T18:58:03.758851] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-09-14T18:58:04.558845] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-09-14T18:58:04.730586] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-14T18:58:04.734089] [INFO ] [REMOTE ] MED: Full fetch complete (24545 records). [2025-09-14T18:58:04.734236] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-09-14T18:58:05.116556] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-09-14T18:58:05.116789] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-09-14T18:58:05.117350] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-09-14T18:58:05.117420] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-09-14T18:58:05.118471] [DEBUG] [LOCAL ] MED: Trimmed 24545 records to 16010 (keeping 150 days of data) [2025-09-14T18:58:05.228433] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-14T18:58:05.266361] [DEBUG] [LOCAL ] MED: Primary data saved (16010 records). [2025-09-14T18:58:05.266574] [INFO ] [MAIN ] MED: Full history saved. [2025-09-14T18:58:05.266715] [INFO ] [MAIN ] Update Progress: 1327/2370 symbols completed. MED took 22.1s. Estimated remaining: 1h 50m 44s. Rate: 9.4 symbols/min [2025-09-14T18:58:05.364168] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-09-14T18:58:05.438824] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:58:05.450827] [DEBUG] [LOCAL ] MEGI: Loaded 9860 existing records from primary storage. [2025-09-14T18:58:05.450998] [INFO ] [MAIN ] MEGI: Loaded 9860 existing records. [2025-09-14T18:58:05.584504] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-14T18:58:05.636930] [INFO ] [REMOTE ] MEC: Full fetch complete (17378 records). [2025-09-14T18:58:05.640540] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:58:05.640826] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-09-14T18:58:05.641491] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-09-14T18:58:05.641579] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-09-14T18:58:05.642076] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-09-14T18:58:05.675397] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-09-14T18:58:06.168914] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-09-14T18:58:06.422323] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-09-14T18:58:06.425615] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:58:06.426131] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-09-14T18:58:06.427111] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-09-14T18:58:06.427182] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-09-14T18:58:06.428472] [DEBUG] [LOCAL ] MEC: Trimmed 17378 records to 12468 (keeping 150 days of data) [2025-09-14T18:58:06.506622] [DEBUG] [LOCAL ] MEC: Primary data saved (12468 records). [2025-09-14T18:58:06.506855] [INFO ] [MAIN ] MEC: Full history saved. [2025-09-14T18:58:06.506973] [INFO ] [MAIN ] Update Progress: 1328/2370 symbols completed. MEC took 26.2s. Estimated remaining: 1h 50m 34s. Rate: 9.4 symbols/min [2025-09-14T18:58:06.682119] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:58:06.698628] [DEBUG] [LOCAL ] MEI: Loaded 15302 existing records from primary storage. [2025-09-14T18:58:06.698860] [INFO ] [MAIN ] MEI: Loaded 15302 existing records. [2025-09-14T18:58:06.880669] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:58:06.880956] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-09-14T18:58:06.881019] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-09-14T18:58:06.881592] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-09-14T18:58:06.881682] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-09-14T18:58:06.961899] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-09-14T18:58:07.189135] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-14T18:58:07.265367] [INFO ] [REMOTE ] MDU: Full fetch complete (52289 records). [2025-09-14T18:58:07.269543] [INFO ] [REMOTE ] MEI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:58:07.279671] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-09-14T18:58:07.363533] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-14T18:58:07.710389] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-09-14T18:58:07.710551] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-09-14T18:58:07.712154] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-09-14T18:58:07.712233] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-09-14T18:58:07.714131] [DEBUG] [LOCAL ] MDU: Trimmed 52289 records to 35398 (keeping 150 days of data) [2025-09-14T18:58:07.778706] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-09-14T18:58:07.967065] [DEBUG] [LOCAL ] MDU: Primary data saved (35398 records). [2025-09-14T18:58:07.967260] [INFO ] [MAIN ] MDU: Full history saved. [2025-09-14T18:58:07.967371] [INFO ] [MAIN ] Update Progress: 1329/2370 symbols completed. MDU took 43.5s. Estimated remaining: 1h 50m 24s. Rate: 9.4 symbols/min [2025-09-14T18:58:08.141091] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:58:08.156200] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-14T18:58:08.182448] [DEBUG] [LOCAL ] MET: Loaded 23940 existing records from primary storage. [2025-09-14T18:58:08.182686] [INFO ] [MAIN ] MET: Loaded 23940 existing records. [2025-09-14T18:58:08.363658] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:58:08.363980] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-09-14T18:58:08.364044] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-09-14T18:58:08.364819] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-09-14T18:58:08.364888] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-09-14T18:58:08.564025] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-09-14T18:58:08.741500] [INFO ] [REMOTE ] MET: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:58:09.040445] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-14T18:58:09.045766] [INFO ] [REMOTE ] MEG: Full fetch complete (30134 records). [2025-09-14T18:58:09.045920] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-09-14T18:58:09.228195] [WARN ] [VALIDATOR ] MEG: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-14T18:58:09.228652] [FATAL] [MAIN ] MEG: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:58:09.228709] [WARN ] [MAIN ] MEG: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:58:09.228751] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-09-14T18:58:09.228819] [DEBUG] [LOCAL ] MEG: No primary data file found to delete. [2025-09-14T18:58:09.228907] [INFO ] [LOCAL ] MEG: Starting deletion of derivative data. [2025-09-14T18:58:09.228978] [DEBUG] [LOCAL ] MEG: No derivative data file found to delete. [2025-09-14T18:58:09.229080] [INFO ] [MAIN ] Update Progress: 1330/2370 symbols completed. MEG took 22.5s. Estimated remaining: 1h 50m 13s. Rate: 9.4 symbols/min [2025-09-14T18:58:09.369725] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-09-14T18:58:09.401183] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:58:09.423918] [DEBUG] [LOCAL ] MFA: Loaded 20210 existing records from primary storage. [2025-09-14T18:58:09.424096] [INFO ] [MAIN ] MFA: Loaded 20210 existing records. [2025-09-14T18:58:09.599631] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:58:09.599942] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-09-14T18:58:09.600003] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-09-14T18:58:09.600634] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-09-14T18:58:09.600747] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-09-14T18:58:09.958139] [INFO ] [REMOTE ] MFA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:58:10.104205] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-14T18:58:10.158774] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-09-14T18:58:10.488447] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-14T18:58:10.958885] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-09-14T18:58:11.681011] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-14T18:58:11.745857] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-14T18:58:11.758788] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-09-14T18:58:12.558793] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-09-14T18:58:12.879342] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T18:58:13.358845] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-09-14T18:58:14.158874] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-09-14T18:58:14.318957] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T18:58:14.748751] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T18:58:14.958858] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-09-14T18:58:15.173983] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-14T18:58:15.758885] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-09-14T18:58:16.558865] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-09-14T18:58:16.673712] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T18:58:17.358846] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-09-14T18:58:17.647188] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-14T18:58:18.158849] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-09-14T18:58:18.524597] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-14T18:58:18.670759] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-14T18:58:18.958880] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-09-14T18:58:19.494506] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-14T18:58:19.758825] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-09-14T18:58:20.558851] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-09-14T18:58:20.941961] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T18:58:20.971274] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-14T18:58:21.358874] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-09-14T18:58:21.782250] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-14T18:58:22.158896] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-09-14T18:58:22.958845] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-09-14T18:58:23.348323] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-14T18:58:23.758825] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-09-14T18:58:23.930260] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T18:58:24.558827] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-09-14T18:58:24.895207] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-14T18:58:25.358837] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-09-14T18:58:25.651268] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-14T18:58:25.653533] [INFO ] [REMOTE ] MEGI: Full fetch complete (21961 records). [2025-09-14T18:58:25.653770] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-09-14T18:58:25.781466] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-14T18:58:26.069018] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-09-14T18:58:26.069138] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-09-14T18:58:26.069688] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-09-14T18:58:26.069817] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-09-14T18:58:26.070463] [DEBUG] [LOCAL ] MEGI: Trimmed 21961 records to 14929 (keeping 150 days of data) [2025-09-14T18:58:26.159103] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-09-14T18:58:26.167711] [DEBUG] [LOCAL ] MEGI: Primary data saved (14929 records). [2025-09-14T18:58:26.167828] [INFO ] [MAIN ] MEGI: Full history saved. [2025-09-14T18:58:26.167924] [INFO ] [MAIN ] Update Progress: 1331/2370 symbols completed. MEGI took 20.9s. Estimated remaining: 1h 50m 15s. Rate: 9.4 symbols/min [2025-09-14T18:58:26.338734] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:58:26.342350] [DEBUG] [LOCAL ] MFAN: Loaded 1790 existing records from primary storage. [2025-09-14T18:58:26.342460] [INFO ] [MAIN ] MFAN: Loaded 1790 existing records. [2025-09-14T18:58:26.516025] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:58:26.516298] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-09-14T18:58:26.516355] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-09-14T18:58:26.516591] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-09-14T18:58:26.516677] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-09-14T18:58:26.866631] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:58:26.885187] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-14T18:58:26.958823] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-09-14T18:58:27.758803] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-09-14T18:58:28.230634] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-14T18:58:28.269584] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-14T18:58:28.276452] [INFO ] [REMOTE ] MEI: Full fetch complete (34519 records). [2025-09-14T18:58:28.276770] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-09-14T18:58:28.431708] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-14T18:58:28.564010] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-09-14T18:58:28.805010] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-09-14T18:58:28.805191] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-09-14T18:58:28.806376] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-09-14T18:58:28.806453] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-09-14T18:58:28.807887] [DEBUG] [LOCAL ] MEI: Trimmed 34519 records to 23507 (keeping 150 days of data) [2025-09-14T18:58:29.027432] [DEBUG] [LOCAL ] MEI: Primary data saved (23507 records). [2025-09-14T18:58:29.027689] [INFO ] [MAIN ] MEI: Full history saved. [2025-09-14T18:58:29.027826] [INFO ] [MAIN ] Update Progress: 1332/2370 symbols completed. MEI took 22.5s. Estimated remaining: 1h 50m 6s. Rate: 9.4 symbols/min [2025-09-14T18:58:29.282492] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:58:29.287707] [DEBUG] [LOCAL ] MFAO: Loaded 1563 existing records from primary storage. [2025-09-14T18:58:29.287903] [INFO ] [MAIN ] MFAO: Loaded 1563 existing records. [2025-09-14T18:58:29.364083] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-09-14T18:58:29.551347] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:58:29.551658] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-09-14T18:58:29.551766] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-09-14T18:58:29.551996] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-09-14T18:58:29.552054] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-09-14T18:58:29.926361] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:58:30.076801] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-14T18:58:30.158797] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-09-14T18:58:30.572851] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-14T18:58:30.958817] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-09-14T18:58:31.504295] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T18:58:31.758795] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-09-14T18:58:32.558896] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-09-14T18:58:32.869130] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-14T18:58:33.358896] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-09-14T18:58:33.385411] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T18:58:33.425735] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-14T18:58:34.037421] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T18:58:34.043120] [INFO ] [REMOTE ] MET: Full fetch complete (57951 records). [2025-09-14T18:58:34.043293] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-09-14T18:58:34.164025] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-09-14T18:58:34.429767] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-09-14T18:58:34.429882] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-09-14T18:58:34.430882] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-09-14T18:58:34.430955] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-09-14T18:58:34.432172] [DEBUG] [LOCAL ] MET: Trimmed 57951 records to 40097 (keeping 150 days of data) [2025-09-14T18:58:34.696286] [DEBUG] [LOCAL ] MET: Primary data saved (40097 records). [2025-09-14T18:58:34.696445] [INFO ] [MAIN ] MET: Full history saved. [2025-09-14T18:58:34.696547] [INFO ] [MAIN ] Update Progress: 1333/2370 symbols completed. MET took 26.7s. Estimated remaining: 1h 49m 59s. Rate: 9.4 symbols/min [2025-09-14T18:58:34.804938] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-14T18:58:34.876065] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:58:34.900078] [DEBUG] [LOCAL ] MFC: Loaded 22909 existing records from primary storage. [2025-09-14T18:58:34.900251] [INFO ] [MAIN ] MFC: Loaded 22909 existing records. [2025-09-14T18:58:34.964098] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-09-14T18:58:35.086123] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:58:35.086435] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-09-14T18:58:35.086496] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-09-14T18:58:35.087178] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-09-14T18:58:35.087252] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-09-14T18:58:35.471913] [INFO ] [REMOTE ] MFC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:58:35.710276] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-14T18:58:35.758835] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-09-14T18:58:36.558912] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-09-14T18:58:37.288403] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-14T18:58:37.324012] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-14T18:58:37.358835] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-09-14T18:58:38.158861] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-09-14T18:58:38.795165] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-14T18:58:38.799932] [INFO ] [REMOTE ] MFA: Full fetch complete (48924 records). [2025-09-14T18:58:38.800055] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-09-14T18:58:38.961143] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-09-14T18:58:39.183090] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-09-14T18:58:39.183251] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-09-14T18:58:39.184069] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-09-14T18:58:39.184185] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-09-14T18:58:39.185686] [DEBUG] [LOCAL ] MFA: Trimmed 48924 records to 33621 (keeping 150 days of data) [2025-09-14T18:58:39.301077] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-14T18:58:39.437581] [DEBUG] [LOCAL ] MFA: Primary data saved (33621 records). [2025-09-14T18:58:39.437745] [INFO ] [MAIN ] MFA: Full history saved. [2025-09-14T18:58:39.437843] [INFO ] [MAIN ] Update Progress: 1334/2370 symbols completed. MFA took 30.2s. Estimated remaining: 1h 49m 52s. Rate: 9.4 symbols/min [2025-09-14T18:58:39.612717] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:58:39.633449] [DEBUG] [LOCAL ] MFG: Loaded 22163 existing records from primary storage. [2025-09-14T18:58:39.633630] [INFO ] [MAIN ] MFG: Loaded 22163 existing records. [2025-09-14T18:58:39.783014] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T18:58:39.759733] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-09-14T18:58:39.817433] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:58:39.818318] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-09-14T18:58:39.818387] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-09-14T18:58:39.819144] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-09-14T18:58:39.819206] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-09-14T18:58:40.166467] [INFO ] [REMOTE ] MFG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:58:40.550589] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-14T18:58:40.558765] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-09-14T18:58:41.121693] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-14T18:58:41.358849] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-09-14T18:58:41.987837] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-14T18:58:42.158865] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-09-14T18:58:42.958807] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-09-14T18:58:43.043437] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T18:58:43.591956] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-14T18:58:43.758824] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-09-14T18:58:44.372338] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-14T18:58:44.558869] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-09-14T18:58:45.358816] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-09-14T18:58:45.428374] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-14T18:58:46.051883] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-14T18:58:46.158831] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-09-14T18:58:46.958837] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-09-14T18:58:47.229887] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-14T18:58:47.758827] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-09-14T18:58:48.277223] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-14T18:58:48.295935] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T18:58:48.296988] [INFO ] [REMOTE ] MFAN: Full fetch complete (4536 records). [2025-09-14T18:58:48.297087] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-09-14T18:58:48.565307] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-09-14T18:58:48.655776] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-09-14T18:58:48.655915] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-09-14T18:58:48.656132] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-09-14T18:58:48.656213] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-09-14T18:58:48.656689] [DEBUG] [LOCAL ] MFAN: Trimmed 4536 records to 3076 (keeping 150 days of data) [2025-09-14T18:58:48.675529] [DEBUG] [LOCAL ] MFAN: Primary data saved (3076 records). [2025-09-14T18:58:48.675661] [INFO ] [MAIN ] MFAN: Full history saved. [2025-09-14T18:58:48.675824] [INFO ] [MAIN ] Update Progress: 1335/2370 symbols completed. MFAN took 22.5s. Estimated remaining: 1h 49m 48s. Rate: 9.4 symbols/min [2025-09-14T18:58:48.842680] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:58:48.850187] [DEBUG] [LOCAL ] MFM: Loaded 5657 existing records from primary storage. [2025-09-14T18:58:48.850325] [INFO ] [MAIN ] MFM: Loaded 5657 existing records. [2025-09-14T18:58:49.028900] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:58:49.029224] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-09-14T18:58:49.029300] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-09-14T18:58:49.029743] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-09-14T18:58:49.029821] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-09-14T18:58:49.323906] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-14T18:58:49.364512] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-09-14T18:58:49.402453] [INFO ] [REMOTE ] MFM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:58:50.158860] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-09-14T18:58:50.237223] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T18:58:50.682963] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T18:58:50.684008] [INFO ] [REMOTE ] MFAO: Full fetch complete (4192 records). [2025-09-14T18:58:50.684099] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-09-14T18:58:50.960367] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-09-14T18:58:51.037476] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-09-14T18:58:51.037589] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-09-14T18:58:51.037839] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-09-14T18:58:51.037897] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-09-14T18:58:51.038293] [DEBUG] [LOCAL ] MFAO: Trimmed 4192 records to 2960 (keeping 150 days of data) [2025-09-14T18:58:51.056889] [DEBUG] [LOCAL ] MFAO: Primary data saved (2960 records). [2025-09-14T18:58:51.056999] [INFO ] [MAIN ] MFAO: Full history saved. [2025-09-14T18:58:51.057093] [INFO ] [MAIN ] Update Progress: 1336/2370 symbols completed. MFAO took 22.0s. Estimated remaining: 1h 49m 38s. Rate: 9.4 symbols/min [2025-09-14T18:58:51.230962] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:58:51.234746] [DEBUG] [LOCAL ] MFSB: Loaded 895 existing records from primary storage. [2025-09-14T18:58:51.234849] [INFO ] [MAIN ] MFSB: Loaded 895 existing records. [2025-09-14T18:58:51.413927] [WARN ] [MAIN ] MFSB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:58:51.414278] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-09-14T18:58:51.414347] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-14T18:58:51.414763] [DEBUG] [LOCAL ] MFSB: Deleted primary data file. [2025-09-14T18:58:51.414830] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-09-14T18:58:51.768147] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-09-14T18:58:51.791385] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:58:52.558901] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-09-14T18:58:52.646027] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-14T18:58:52.663597] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-14T18:58:52.849612] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-14T18:58:53.358848] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-09-14T18:58:54.158802] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-09-14T18:58:54.271214] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-14T18:58:54.958848] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-09-14T18:58:55.047967] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T18:58:55.343503] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-14T18:58:55.758835] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-09-14T18:58:56.113868] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-14T18:58:56.558841] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-09-14T18:58:56.919061] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-14T18:58:57.358882] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-09-14T18:58:58.158891] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-09-14T18:58:58.529180] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-14T18:58:58.958982] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T18:58:58.959057] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-09-14T18:58:59.403110] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-14T18:58:59.758818] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-09-14T18:59:00.291219] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-14T18:59:00.558835] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-09-14T18:59:01.358883] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-09-14T18:59:01.874756] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T18:59:01.875921] [INFO ] [REMOTE ] MFSB: Full fetch complete (1089 records). [2025-09-14T18:59:01.876018] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-09-14T18:59:02.087690] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 132 unique days, need 150 days [2025-09-14T18:59:02.087913] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-09-14T18:59:02.087965] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-09-14T18:59:02.088022] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-14T18:59:02.088126] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-14T18:59:02.088176] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-09-14T18:59:02.088250] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-09-14T18:59:02.088354] [INFO ] [MAIN ] Update Progress: 1337/2370 symbols completed. MFSB took 11.0s. Estimated remaining: 1h 49m 35s. Rate: 9.4 symbols/min [2025-09-14T18:59:02.164012] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-09-14T18:59:02.260283] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:59:02.264900] [DEBUG] [LOCAL ] MFSG: Loaded 2707 existing records from primary storage. [2025-09-14T18:59:02.265014] [INFO ] [MAIN ] MFSG: Loaded 2707 existing records. [2025-09-14T18:59:02.453087] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:59:02.453388] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-09-14T18:59:02.453451] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-09-14T18:59:02.453727] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-09-14T18:59:02.453789] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-09-14T18:59:02.809105] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:59:02.846659] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-14T18:59:02.958876] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-09-14T18:59:03.473582] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-14T18:59:03.506962] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-14T18:59:03.758843] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-09-14T18:59:04.558856] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-09-14T18:59:05.043978] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-14T18:59:05.358850] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-09-14T18:59:05.548503] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-14T18:59:06.158881] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-09-14T18:59:06.294519] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-14T18:59:06.902170] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-14T18:59:06.958840] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-09-14T18:59:07.758830] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-09-14T18:59:08.558867] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-09-14T18:59:08.805238] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-14T18:59:08.914267] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-14T18:59:09.201313] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-14T18:59:09.358869] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-09-14T18:59:10.013679] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-14T18:59:10.158887] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-09-14T18:59:10.819391] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-14T18:59:10.958810] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-09-14T18:59:11.614504] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-14T18:59:11.758837] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-09-14T18:59:12.493130] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T18:59:12.498399] [INFO ] [REMOTE ] MFC: Full fetch complete (55980 records). [2025-09-14T18:59:12.498540] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-09-14T18:59:12.564063] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-09-14T18:59:12.885143] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-09-14T18:59:12.885265] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-09-14T18:59:12.886216] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-09-14T18:59:12.886283] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-09-14T18:59:12.887502] [DEBUG] [LOCAL ] MFC: Trimmed 55980 records to 38397 (keeping 150 days of data) [2025-09-14T18:59:13.137013] [DEBUG] [LOCAL ] MFC: Primary data saved (38397 records). [2025-09-14T18:59:13.137206] [INFO ] [MAIN ] MFC: Full history saved. [2025-09-14T18:59:13.137359] [INFO ] [MAIN ] Update Progress: 1338/2370 symbols completed. MFC took 38.4s. Estimated remaining: 1h 49m 33s. Rate: 9.4 symbols/min [2025-09-14T18:59:13.310152] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:59:13.318343] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-14T18:59:13.327947] [DEBUG] [LOCAL ] MFSI: Loaded 6353 existing records from primary storage. [2025-09-14T18:59:13.328170] [INFO ] [MAIN ] MFSI: Loaded 6353 existing records. [2025-09-14T18:59:13.364053] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-09-14T18:59:13.519707] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:59:13.520040] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-09-14T18:59:13.520115] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-09-14T18:59:13.520494] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-09-14T18:59:13.520558] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-09-14T18:59:13.893632] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:59:14.158823] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-09-14T18:59:14.555400] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-14T18:59:14.866418] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-14T18:59:14.958839] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-09-14T18:59:15.758867] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-09-14T18:59:15.859224] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-14T18:59:16.558828] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-09-14T18:59:17.358853] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-09-14T18:59:17.479210] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-14T18:59:17.480558] [INFO ] [REMOTE ] MFSG: Full fetch complete (4842 records). [2025-09-14T18:59:17.480678] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-09-14T18:59:17.894446] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-09-14T18:59:17.895557] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-14T18:59:17.896736] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-09-14T18:59:17.900667] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-14T18:59:17.913564] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-09-14T18:59:17.913778] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-09-14T18:59:17.914606] [DEBUG] [LOCAL ] MFSG: Trimmed 4842 records to 3948 (keeping 150 days of data) [2025-09-14T18:59:17.943549] [DEBUG] [LOCAL ] MFSG: Primary data saved (3948 records). [2025-09-14T18:59:17.943717] [INFO ] [MAIN ] MFSG: Full history saved. [2025-09-14T18:59:17.943845] [INFO ] [MAIN ] Update Progress: 1339/2370 symbols completed. MFSG took 15.9s. Estimated remaining: 1h 49m 25s. Rate: 9.4 symbols/min [2025-09-14T18:59:18.116662] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:59:18.120619] [DEBUG] [LOCAL ] MFSV: Loaded 1220 existing records from primary storage. [2025-09-14T18:59:18.120814] [INFO ] [MAIN ] MFSV: Loaded 1220 existing records. [2025-09-14T18:59:18.164020] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-09-14T18:59:18.313743] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:59:18.314087] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-09-14T18:59:18.314154] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-09-14T18:59:18.314390] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-09-14T18:59:18.314452] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-09-14T18:59:18.676060] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:59:18.754697] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-14T18:59:18.958825] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-09-14T18:59:19.758175] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-14T18:59:19.760324] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-09-14T18:59:20.369181] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-14T18:59:20.558838] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-09-14T18:59:20.973870] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-14T18:59:21.358910] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-09-14T18:59:22.158885] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-09-14T18:59:22.299086] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-14T18:59:22.958860] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-09-14T18:59:23.438085] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-14T18:59:23.641229] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-14T18:59:23.647840] [INFO ] [REMOTE ] MFG: Full fetch complete (52755 records). [2025-09-14T18:59:23.648101] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-09-14T18:59:23.763998] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-09-14T18:59:24.070590] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-09-14T18:59:24.070754] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-09-14T18:59:24.072346] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-09-14T18:59:24.072416] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-09-14T18:59:24.074019] [DEBUG] [LOCAL ] MFG: Trimmed 52755 records to 37293 (keeping 150 days of data) [2025-09-14T18:59:24.283402] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-14T18:59:24.323552] [DEBUG] [LOCAL ] MFG: Primary data saved (37293 records). [2025-09-14T18:59:24.323799] [INFO ] [MAIN ] MFG: Full history saved. [2025-09-14T18:59:24.323940] [INFO ] [MAIN ] Update Progress: 1340/2370 symbols completed. MFG took 44.9s. Estimated remaining: 1h 49m 19s. Rate: 9.4 symbols/min [2025-09-14T18:59:24.502047] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:59:24.511476] [DEBUG] [LOCAL ] MG: Loaded 6432 existing records from primary storage. [2025-09-14T18:59:24.511732] [INFO ] [MAIN ] MG: Loaded 6432 existing records. [2025-09-14T18:59:24.569274] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-09-14T18:59:24.716164] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:59:24.716548] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-09-14T18:59:24.716635] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-09-14T18:59:24.717052] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-09-14T18:59:24.717120] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-09-14T18:59:25.079595] [INFO ] [REMOTE ] MG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:59:25.358810] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-09-14T18:59:25.661675] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-14T18:59:25.842360] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-14T18:59:26.158857] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-09-14T18:59:26.916210] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T18:59:26.918221] [INFO ] [REMOTE ] MFM: Full fetch complete (15256 records). [2025-09-14T18:59:26.918318] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-09-14T18:59:26.963961] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-09-14T18:59:27.304395] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-09-14T18:59:27.304572] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-09-14T18:59:27.305501] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-09-14T18:59:27.305615] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-09-14T18:59:27.306437] [DEBUG] [LOCAL ] MFM: Trimmed 15256 records to 10158 (keeping 150 days of data) [2025-09-14T18:59:27.374619] [DEBUG] [LOCAL ] MFM: Primary data saved (10158 records). [2025-09-14T18:59:27.374883] [INFO ] [MAIN ] MFM: Full history saved. [2025-09-14T18:59:27.375032] [INFO ] [MAIN ] Update Progress: 1341/2370 symbols completed. MFM took 38.7s. Estimated remaining: 1h 49m 10s. Rate: 9.4 symbols/min [2025-09-14T18:59:27.554114] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:59:27.578812] [DEBUG] [LOCAL ] MGA: Loaded 22210 existing records from primary storage. [2025-09-14T18:59:27.579065] [INFO ] [MAIN ] MGA: Loaded 22210 existing records. [2025-09-14T18:59:27.763680] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-09-14T18:59:27.764013] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:59:27.764816] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-09-14T18:59:27.765927] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-09-14T18:59:27.766834] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-09-14T18:59:27.766908] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-09-14T18:59:28.023273] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-14T18:59:28.155879] [INFO ] [REMOTE ] MGA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:59:28.512302] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-14T18:59:28.558858] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-09-14T18:59:29.333327] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T18:59:29.335465] [INFO ] [REMOTE ] MFSI: Full fetch complete (10815 records). [2025-09-14T18:59:29.335715] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-09-14T18:59:29.364630] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-09-14T18:59:29.708260] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-09-14T18:59:29.708387] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-09-14T18:59:29.708744] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-09-14T18:59:29.708820] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-09-14T18:59:29.709389] [DEBUG] [LOCAL ] MFSI: Trimmed 10815 records to 8941 (keeping 150 days of data) [2025-09-14T18:59:29.767137] [DEBUG] [LOCAL ] MFSI: Primary data saved (8941 records). [2025-09-14T18:59:29.767325] [INFO ] [MAIN ] MFSI: Full history saved. [2025-09-14T18:59:29.767489] [INFO ] [MAIN ] Update Progress: 1342/2370 symbols completed. MFSI took 16.6s. Estimated remaining: 1h 49m 0s. Rate: 9.4 symbols/min [2025-09-14T18:59:29.948772] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:59:29.953086] [DEBUG] [LOCAL ] MGF: Loaded 2039 existing records from primary storage. [2025-09-14T18:59:29.953209] [INFO ] [MAIN ] MGF: Loaded 2039 existing records. [2025-09-14T18:59:30.144775] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:59:30.145063] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-09-14T18:59:30.145168] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-09-14T18:59:30.145445] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-09-14T18:59:30.145516] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-09-14T18:59:30.167012] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-09-14T18:59:30.565553] [INFO ] [REMOTE ] MGF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:59:30.583383] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-14T18:59:30.958822] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-09-14T18:59:31.712683] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-14T18:59:31.758778] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-09-14T18:59:32.038167] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-14T18:59:32.164567] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-14T18:59:32.558851] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-09-14T18:59:33.243262] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-14T18:59:33.358844] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-09-14T18:59:34.158832] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-09-14T18:59:34.421204] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-14T18:59:34.680077] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-14T18:59:34.958894] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-09-14T18:59:35.758901] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-09-14T18:59:35.980357] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-14T18:59:36.436252] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-14T18:59:36.558881] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-09-14T18:59:37.184165] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-14T18:59:37.358845] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-09-14T18:59:38.158850] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-09-14T18:59:38.958859] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-09-14T18:59:39.078780] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-14T18:59:39.092589] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T18:59:39.619183] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-14T18:59:39.758820] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-09-14T18:59:40.391123] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-14T18:59:40.558959] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-09-14T18:59:41.064899] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T18:59:41.066001] [INFO ] [REMOTE ] MFSV: Full fetch complete (2337 records). [2025-09-14T18:59:41.066089] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-09-14T18:59:41.364044] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-09-14T18:59:41.424319] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-09-14T18:59:41.424440] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-09-14T18:59:41.424576] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-09-14T18:59:41.424634] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-09-14T18:59:41.425045] [DEBUG] [LOCAL ] MFSV: Trimmed 2337 records to 1655 (keeping 150 days of data) [2025-09-14T18:59:41.436285] [DEBUG] [LOCAL ] MFSV: Primary data saved (1655 records). [2025-09-14T18:59:41.436376] [INFO ] [MAIN ] MFSV: Full history saved. [2025-09-14T18:59:41.436470] [INFO ] [MAIN ] Update Progress: 1343/2370 symbols completed. MFSV took 23.5s. Estimated remaining: 1h 48m 58s. Rate: 9.4 symbols/min [2025-09-14T18:59:41.615450] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:59:41.640932] [DEBUG] [LOCAL ] MGM: Loaded 23997 existing records from primary storage. [2025-09-14T18:59:41.641112] [INFO ] [MAIN ] MGM: Loaded 23997 existing records. [2025-09-14T18:59:41.823367] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:59:41.823732] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-09-14T18:59:41.823822] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-09-14T18:59:41.824575] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-09-14T18:59:41.824694] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-09-14T18:59:42.097809] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T18:59:42.115581] [INFO ] [REMOTE ] MGF: Full fetch complete (4461 records). [2025-09-14T18:59:42.136302] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-09-14T18:59:42.167662] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-09-14T18:59:42.187857] [INFO ] [REMOTE ] MGM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:59:42.548697] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-09-14T18:59:42.548821] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-09-14T18:59:42.549007] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-09-14T18:59:42.549059] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-09-14T18:59:42.549519] [DEBUG] [LOCAL ] MGF: Trimmed 4461 records to 3212 (keeping 150 days of data) [2025-09-14T18:59:42.572397] [DEBUG] [LOCAL ] MGF: Primary data saved (3212 records). [2025-09-14T18:59:42.572594] [INFO ] [MAIN ] MGF: Full history saved. [2025-09-14T18:59:42.572742] [INFO ] [MAIN ] Update Progress: 1344/2370 symbols completed. MGF took 12.8s. Estimated remaining: 1h 48m 48s. Rate: 9.4 symbols/min [2025-09-14T18:59:42.756201] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:59:42.760711] [DEBUG] [LOCAL ] MGR: Loaded 2770 existing records from primary storage. [2025-09-14T18:59:42.760818] [INFO ] [MAIN ] MGR: Loaded 2770 existing records. [2025-09-14T18:59:42.938973] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:59:42.939243] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-09-14T18:59:42.939304] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-09-14T18:59:42.939584] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-09-14T18:59:42.939678] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-09-14T18:59:42.970829] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-09-14T18:59:43.299078] [INFO ] [REMOTE ] MGR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:59:43.758883] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-09-14T18:59:44.005406] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-14T18:59:44.206571] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-14T18:59:44.558870] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-09-14T18:59:44.587134] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T18:59:45.358869] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-09-14T18:59:46.158988] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-09-14T18:59:46.335598] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-14T18:59:46.465800] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-14T18:59:46.958888] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-09-14T18:59:47.506774] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-14T18:59:47.758811] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-09-14T18:59:47.892076] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-14T18:59:48.558869] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-09-14T18:59:49.273123] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T18:59:49.275295] [INFO ] [REMOTE ] MG: Full fetch complete (18051 records). [2025-09-14T18:59:49.275411] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-09-14T18:59:49.363993] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-09-14T18:59:49.706452] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-09-14T18:59:49.706706] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-09-14T18:59:49.707502] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-09-14T18:59:49.708281] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-09-14T18:59:49.709381] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-14T18:59:49.721220] [DEBUG] [LOCAL ] MG: Trimmed 18051 records to 11650 (keeping 150 days of data) [2025-09-14T18:59:49.803143] [DEBUG] [LOCAL ] MG: Primary data saved (11650 records). [2025-09-14T18:59:49.803369] [INFO ] [MAIN ] MG: Full history saved. [2025-09-14T18:59:49.803502] [INFO ] [MAIN ] Update Progress: 1345/2370 symbols completed. MG took 25.5s. Estimated remaining: 1h 48m 42s. Rate: 9.4 symbols/min [2025-09-14T18:59:49.980385] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T18:59:49.984302] [DEBUG] [LOCAL ] MGRB: Loaded 1591 existing records from primary storage. [2025-09-14T18:59:49.984401] [INFO ] [MAIN ] MGRB: Loaded 1591 existing records. [2025-09-14T18:59:50.161498] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-14T18:59:50.161079] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-09-14T18:59:50.165664] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T18:59:50.169726] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-09-14T18:59:50.170769] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-09-14T18:59:50.171179] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-09-14T18:59:50.171309] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-09-14T18:59:50.523138] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T18:59:50.958891] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-09-14T18:59:51.654813] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-14T18:59:51.758805] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-09-14T18:59:51.851332] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-14T18:59:52.238311] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-14T18:59:52.558836] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-09-14T18:59:53.358845] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-09-14T18:59:54.158833] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-09-14T18:59:54.629181] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-14T18:59:54.790306] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-14T18:59:54.958885] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-09-14T18:59:55.222289] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T18:59:55.567291] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-14T18:59:55.758892] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-09-14T18:59:56.419481] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-14T18:59:56.558917] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-09-14T18:59:57.358872] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-09-14T18:59:58.154964] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-14T18:59:58.158764] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-09-14T18:59:58.492848] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-14T18:59:58.833043] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-14T18:59:58.958809] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-09-14T18:59:59.570241] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-14T18:59:59.571456] [INFO ] [REMOTE ] MGR: Full fetch complete (5985 records). [2025-09-14T18:59:59.571553] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-09-14T18:59:59.763952] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-09-14T18:59:59.954406] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-09-14T18:59:59.954537] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-09-14T18:59:59.954772] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-09-14T18:59:59.954836] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-09-14T18:59:59.955267] [DEBUG] [LOCAL ] MGR: Trimmed 5985 records to 4180 (keeping 150 days of data) [2025-09-14T18:59:59.981460] [DEBUG] [LOCAL ] MGR: Primary data saved (4180 records). [2025-09-14T18:59:59.981570] [INFO ] [MAIN ] MGR: Full history saved. [2025-09-14T18:59:59.981710] [INFO ] [MAIN ] Update Progress: 1346/2370 symbols completed. MGR took 17.4s. Estimated remaining: 1h 48m 39s. Rate: 9.4 symbols/min [2025-09-14T19:00:00.159118] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:00:00.162543] [DEBUG] [LOCAL ] MGRD: Loaded 963 existing records from primary storage. [2025-09-14T19:00:00.162659] [INFO ] [MAIN ] MGRD: Loaded 963 existing records. [2025-09-14T19:00:00.360006] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:00:00.360354] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-09-14T19:00:00.360421] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-09-14T19:00:00.360726] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-09-14T19:00:00.360793] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-09-14T19:00:00.568192] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-09-14T19:00:00.724442] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:00:01.355981] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-14T19:00:01.360788] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-09-14T19:00:01.362928] [INFO ] [REMOTE ] MGA: Full fetch complete (55097 records). [2025-09-14T19:00:01.363026] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-09-14T19:00:01.765863] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-09-14T19:00:01.766039] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-09-14T19:00:01.767230] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-09-14T19:00:01.767331] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-09-14T19:00:01.769218] [DEBUG] [LOCAL ] MGA: Trimmed 55097 records to 37796 (keeping 150 days of data) [2025-09-14T19:00:02.044200] [DEBUG] [LOCAL ] MGA: Primary data saved (37796 records). [2025-09-14T19:00:02.044423] [INFO ] [MAIN ] MGA: Full history saved. [2025-09-14T19:00:02.044550] [INFO ] [MAIN ] Update Progress: 1347/2370 symbols completed. MGA took 34.7s. Estimated remaining: 1h 48m 29s. Rate: 9.4 symbols/min [2025-09-14T19:00:02.158808] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-09-14T19:00:02.248746] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:00:02.249261] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-14T19:00:02.261599] [DEBUG] [LOCAL ] MGRE: Loaded 3141 existing records from primary storage. [2025-09-14T19:00:02.261923] [INFO ] [MAIN ] MGRE: Loaded 3141 existing records. [2025-09-14T19:00:02.494460] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:00:02.494844] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-09-14T19:00:02.494970] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-09-14T19:00:02.495355] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-09-14T19:00:02.495431] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-09-14T19:00:02.892665] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:00:02.958879] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-09-14T19:00:03.044825] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-14T19:00:03.758843] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-09-14T19:00:04.558917] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-09-14T19:00:06.751257] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (4.59 seconds). [2025-09-14T19:00:06.764431] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-09-14T19:00:06.869040] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (3.11 seconds). [2025-09-14T19:00:06.871500] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-09-14T19:00:07.043493] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (4.08 seconds). [2025-09-14T19:00:07.045525] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-09-14T19:00:07.534672] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (2.98 seconds). [2025-09-14T19:00:07.758815] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-09-14T19:00:10.147029] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-14T19:00:10.148480] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-09-14T19:00:10.415050] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (3.37 seconds). [2025-09-14T19:00:10.417073] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-09-14T19:00:10.733625] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (3.86 seconds). [2025-09-14T19:00:10.735577] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-09-14T19:00:10.843859] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (4.08 seconds). [2025-09-14T19:00:10.958892] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-09-14T19:00:11.179691] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-14T19:00:11.268986] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-14T19:00:11.536051] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-14T19:00:11.758868] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-09-14T19:00:12.374427] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-14T19:00:12.558828] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-09-14T19:00:13.228984] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-14T19:00:13.358854] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-09-14T19:00:14.120275] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-14T19:00:14.158952] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-09-14T19:00:14.280551] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T19:00:14.958911] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-09-14T19:00:15.486055] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-14T19:00:15.758833] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-09-14T19:00:16.291508] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-14T19:00:16.558928] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-09-14T19:00:17.245386] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (3.09 seconds). [2025-09-14T19:00:17.358842] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-09-14T19:00:17.393800] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T19:00:18.158838] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-09-14T19:00:18.699728] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-14T19:00:18.701000] [INFO ] [REMOTE ] MGRB: Full fetch complete (4553 records). [2025-09-14T19:00:18.701114] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-09-14T19:00:18.963990] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-09-14T19:00:19.074257] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-09-14T19:00:19.074391] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-09-14T19:00:19.074544] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-09-14T19:00:19.074596] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-09-14T19:00:19.075093] [DEBUG] [LOCAL ] MGRB: Trimmed 4553 records to 3220 (keeping 150 days of data) [2025-09-14T19:00:19.098972] [DEBUG] [LOCAL ] MGRB: Primary data saved (3220 records). [2025-09-14T19:00:19.099168] [INFO ] [MAIN ] MGRB: Full history saved. [2025-09-14T19:00:19.099277] [INFO ] [MAIN ] Update Progress: 1348/2370 symbols completed. MGRB took 29.3s. Estimated remaining: 1h 48m 31s. Rate: 9.4 symbols/min [2025-09-14T19:00:19.319968] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:00:19.345718] [DEBUG] [LOCAL ] MGY: Loaded 23464 existing records from primary storage. [2025-09-14T19:00:19.345918] [INFO ] [MAIN ] MGY: Loaded 23464 existing records. [2025-09-14T19:00:19.524472] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:00:19.524793] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-09-14T19:00:19.524859] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-09-14T19:00:19.525579] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-09-14T19:00:19.525681] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-09-14T19:00:19.750735] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-14T19:00:19.771010] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-09-14T19:00:19.784730] [INFO ] [REMOTE ] MGRD: Full fetch complete (2525 records). [2025-09-14T19:00:19.813709] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-09-14T19:00:20.004073] [INFO ] [REMOTE ] MGY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:00:20.297252] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-09-14T19:00:20.297415] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-09-14T19:00:20.297724] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-09-14T19:00:20.297863] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-09-14T19:00:20.298425] [DEBUG] [LOCAL ] MGRD: Trimmed 2525 records to 1695 (keeping 150 days of data) [2025-09-14T19:00:20.319104] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T19:00:20.329303] [INFO ] [REMOTE ] MGM: Full fetch complete (58280 records). [2025-09-14T19:00:20.330027] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-09-14T19:00:20.331264] [DEBUG] [LOCAL ] MGRD: Primary data saved (1695 records). [2025-09-14T19:00:20.408523] [INFO ] [MAIN ] MGRD: Full history saved. [2025-09-14T19:00:20.432016] [INFO ] [MAIN ] Update Progress: 1349/2370 symbols completed. MGRD took 20.5s. Estimated remaining: 1h 48m 20s. Rate: 9.4 symbols/min [2025-09-14T19:00:20.582313] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-09-14T19:00:20.770843] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-14T19:00:20.866833] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:00:20.923300] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-09-14T19:00:20.923478] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-09-14T19:00:20.924434] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-09-14T19:00:20.924561] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-09-14T19:00:20.929853] [DEBUG] [LOCAL ] MH: Loaded 10298 existing records from primary storage. [2025-09-14T19:00:20.930205] [INFO ] [MAIN ] MH: Loaded 10298 existing records. [2025-09-14T19:00:21.004058] [DEBUG] [LOCAL ] MGM: Trimmed 58280 records to 40354 (keeping 150 days of data) [2025-09-14T19:00:21.286870] [WARN ] [MAIN ] MH: Insufficient historical data. Have data from 2025-07-24, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:00:21.296390] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-09-14T19:00:21.321961] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-14T19:00:21.329333] [DEBUG] [LOCAL ] MH: Deleted primary data file. [2025-09-14T19:00:21.331296] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-09-14T19:00:21.363887] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-09-14T19:00:21.722798] [INFO ] [REMOTE ] MH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:00:21.741096] [DEBUG] [LOCAL ] MGM: Primary data saved (40354 records). [2025-09-14T19:00:21.741261] [INFO ] [MAIN ] MGM: Full history saved. [2025-09-14T19:00:21.741379] [INFO ] [MAIN ] Update Progress: 1350/2370 symbols completed. MGM took 40.3s. Estimated remaining: 1h 48m 10s. Rate: 9.4 symbols/min [2025-09-14T19:00:21.913895] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:00:21.922008] [DEBUG] [LOCAL ] MHD: Loaded 5132 existing records from primary storage. [2025-09-14T19:00:21.922180] [INFO ] [MAIN ] MHD: Loaded 5132 existing records. [2025-09-14T19:00:22.105689] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:00:22.106011] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-09-14T19:00:22.106102] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-09-14T19:00:22.106495] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-09-14T19:00:22.106573] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-09-14T19:00:22.171565] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-02. [2025-09-14T19:00:22.483970] [INFO ] [REMOTE ] MHD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:00:22.492068] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-14T19:00:22.527159] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-14T19:00:22.650139] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:00:22.650548] [WARN ] [REMOTE ] MH: No data returned for month 2025-02 [2025-09-14T19:00:22.958823] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-09-14T19:00:23.758799] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-09-14T19:00:23.975586] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-14T19:00:24.558842] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-09-14T19:00:25.088149] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T19:00:25.089495] [INFO ] [REMOTE ] MGRE: Full fetch complete (7089 records). [2025-09-14T19:00:25.089603] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-09-14T19:00:25.365831] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-09-14T19:00:25.481874] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-09-14T19:00:25.481999] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-09-14T19:00:25.482213] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-09-14T19:00:25.482269] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-09-14T19:00:25.482771] [DEBUG] [LOCAL ] MGRE: Trimmed 7089 records to 4935 (keeping 150 days of data) [2025-09-14T19:00:25.513609] [DEBUG] [LOCAL ] MGRE: Primary data saved (4935 records). [2025-09-14T19:00:25.513826] [INFO ] [MAIN ] MGRE: Full history saved. [2025-09-14T19:00:25.513951] [INFO ] [MAIN ] Update Progress: 1351/2370 symbols completed. MGRE took 23.5s. Estimated remaining: 1h 48m 2s. Rate: 9.4 symbols/min [2025-09-14T19:00:25.692078] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:00:25.699020] [DEBUG] [LOCAL ] MHF: Loaded 4526 existing records from primary storage. [2025-09-14T19:00:25.699237] [INFO ] [MAIN ] MHF: Loaded 4526 existing records. [2025-09-14T19:00:25.845256] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-14T19:00:25.930806] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:00:25.931101] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-09-14T19:00:25.931165] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-09-14T19:00:25.931450] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-09-14T19:00:25.931509] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-09-14T19:00:26.123825] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-14T19:00:26.164179] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-03. [2025-09-14T19:00:26.364311] [INFO ] [REMOTE ] MHF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:00:26.469549] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:00:26.469989] [WARN ] [REMOTE ] MH: No data returned for month 2025-03 [2025-09-14T19:00:26.958882] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-09-14T19:00:27.758816] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-09-14T19:00:27.785731] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-14T19:00:28.558833] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-09-14T19:00:29.358836] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-09-14T19:00:29.459243] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-14T19:00:29.461004] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-14T19:00:30.158822] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-09-14T19:00:30.401229] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-14T19:00:30.958864] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-04. [2025-09-14T19:00:31.367445] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:00:31.367879] [WARN ] [REMOTE ] MH: No data returned for month 2025-04 [2025-09-14T19:00:31.758825] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-09-14T19:00:32.114337] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-14T19:00:32.558891] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-05. [2025-09-14T19:00:33.358892] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-09-14T19:00:33.365969] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:00:33.366251] [WARN ] [REMOTE ] MH: No data returned for month 2025-05 [2025-09-14T19:00:33.912162] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-14T19:00:34.158859] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-09-14T19:00:34.297620] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-14T19:00:34.958879] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-06. [2025-09-14T19:00:35.223343] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:00:35.223718] [WARN ] [REMOTE ] MH: No data returned for month 2025-06 [2025-09-14T19:00:35.758870] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-07. [2025-09-14T19:00:36.014891] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-14T19:00:36.431730] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-14T19:00:36.558882] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-09-14T19:00:37.358875] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-09-14T19:00:37.466110] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-14T19:00:38.158914] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-09-14T19:00:38.718153] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-14T19:00:38.958854] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-09-14T19:00:39.230348] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-14T19:00:39.758847] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-09-14T19:00:39.784051] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T19:00:40.558877] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-08. [2025-09-14T19:00:40.666327] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-14T19:00:41.358879] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-09-14T19:00:42.031221] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-14T19:00:42.158856] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-09. [2025-09-14T19:00:42.228099] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-14T19:00:42.958927] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-09-14T19:00:43.434690] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-14T19:00:43.440303] [INFO ] [REMOTE ] MH: Full fetch complete (10273 records). [2025-09-14T19:00:43.440541] [DEBUG] [VALIDATOR ] MH: Validating primary data. [2025-09-14T19:00:43.634730] [WARN ] [VALIDATOR ] MH: Validation failed - insufficient historical data. Have 36 unique days, need 150 days [2025-09-14T19:00:43.642778] [FATAL] [MAIN ] MH: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:00:43.643608] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:00:43.643979] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-14T19:00:43.644072] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-14T19:00:43.647266] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-14T19:00:43.647669] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-09-14T19:00:43.647749] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-09-14T19:00:43.647898] [INFO ] [MAIN ] Update Progress: 1352/2370 symbols completed. MH took 23.2s. Estimated remaining: 1h 48m 4s. Rate: 9.4 symbols/min [2025-09-14T19:00:43.763999] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-09-14T19:00:43.819633] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:00:43.842404] [DEBUG] [LOCAL ] MHK: Loaded 19251 existing records from primary storage. [2025-09-14T19:00:43.842579] [INFO ] [MAIN ] MHK: Loaded 19251 existing records. [2025-09-14T19:00:44.030532] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:00:44.031123] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-09-14T19:00:44.031198] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-09-14T19:00:44.032111] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-09-14T19:00:44.032192] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-09-14T19:00:44.412556] [INFO ] [REMOTE ] MHK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:00:44.558894] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-09-14T19:00:44.635188] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-14T19:00:45.358864] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-09-14T19:00:46.158896] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-09-14T19:00:46.203854] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-14T19:00:46.205500] [INFO ] [REMOTE ] MHF: Full fetch complete (9324 records). [2025-09-14T19:00:46.205601] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-09-14T19:00:46.569543] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-09-14T19:00:46.569753] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-09-14T19:00:46.570078] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-09-14T19:00:46.570133] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-09-14T19:00:46.570665] [DEBUG] [LOCAL ] MHF: Trimmed 9324 records to 6860 (keeping 150 days of data) [2025-09-14T19:00:46.640016] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-14T19:00:46.652165] [DEBUG] [LOCAL ] MHF: Primary data saved (6860 records). [2025-09-14T19:00:46.652419] [INFO ] [MAIN ] MHF: Full history saved. [2025-09-14T19:00:46.652815] [INFO ] [MAIN ] Update Progress: 1353/2370 symbols completed. MHF took 21.1s. Estimated remaining: 1h 47m 56s. Rate: 9.4 symbols/min [2025-09-14T19:00:46.779842] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T19:00:46.828805] [INFO ] [REMOTE ] MHD: Full fetch complete (13266 records). [2025-09-14T19:00:46.831288] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:00:46.831775] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-09-14T19:00:46.832009] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-09-14T19:00:46.832562] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-09-14T19:00:46.832751] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-09-14T19:00:46.866300] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-14T19:00:46.899096] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-14T19:00:46.915839] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-09-14T19:00:46.967793] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-09-14T19:00:47.516434] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-09-14T19:00:47.545403] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-09-14T19:00:47.574119] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-09-14T19:00:47.579893] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:00:47.580055] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-09-14T19:00:47.581083] [DEBUG] [LOCAL ] MHD: Trimmed 13266 records to 8816 (keeping 150 days of data) [2025-09-14T19:00:47.636257] [DEBUG] [LOCAL ] MHD: Primary data saved (8816 records). [2025-09-14T19:00:47.636413] [INFO ] [MAIN ] MHD: Full history saved. [2025-09-14T19:00:47.636532] [INFO ] [MAIN ] Update Progress: 1354/2370 symbols completed. MHD took 25.9s. Estimated remaining: 1h 47m 45s. Rate: 9.4 symbols/min [2025-09-14T19:00:47.764002] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-09-14T19:00:47.807609] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:00:47.813229] [DEBUG] [LOCAL ] MHN: Loaded 3438 existing records from primary storage. [2025-09-14T19:00:47.813338] [INFO ] [MAIN ] MHN: Loaded 3438 existing records. [2025-09-14T19:00:47.988405] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:00:47.988710] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-09-14T19:00:47.988768] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-09-14T19:00:47.989041] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-09-14T19:00:47.989097] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-09-14T19:00:48.359418] [INFO ] [REMOTE ] MHN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:00:48.555325] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-14T19:00:48.560815] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-09-14T19:00:48.562779] [INFO ] [REMOTE ] MGY: Full fetch complete (56968 records). [2025-09-14T19:00:48.562898] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-09-14T19:00:48.815244] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-09-14T19:00:48.979132] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-14T19:00:49.001823] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-09-14T19:00:49.002508] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-09-14T19:00:49.003709] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-09-14T19:00:49.003771] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-09-14T19:00:49.006378] [DEBUG] [LOCAL ] MGY: Trimmed 56968 records to 39371 (keeping 150 days of data) [2025-09-14T19:00:49.290505] [DEBUG] [LOCAL ] MGY: Primary data saved (39371 records). [2025-09-14T19:00:49.290790] [INFO ] [MAIN ] MGY: Full history saved. [2025-09-14T19:00:49.290933] [INFO ] [MAIN ] Update Progress: 1355/2370 symbols completed. MGY took 30.2s. Estimated remaining: 1h 47m 35s. Rate: 9.4 symbols/min [2025-09-14T19:00:49.364021] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-09-14T19:00:49.472826] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:00:49.485720] [DEBUG] [LOCAL ] MHO: Loaded 11553 existing records from primary storage. [2025-09-14T19:00:49.485886] [INFO ] [MAIN ] MHO: Loaded 11553 existing records. [2025-09-14T19:00:49.659905] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:00:49.660238] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-09-14T19:00:49.660303] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-09-14T19:00:49.660976] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-09-14T19:00:49.661044] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-09-14T19:00:49.762270] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-14T19:00:50.018319] [INFO ] [REMOTE ] MHO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:00:50.158847] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-09-14T19:00:50.958893] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-09-14T19:00:51.758851] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-09-14T19:00:51.892297] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-14T19:00:51.919382] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-14T19:00:52.558841] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-09-14T19:00:52.782107] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-09-14T19:00:53.182294] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-14T19:00:53.358910] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-09-14T19:00:54.158874] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-09-14T19:00:54.958961] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-09-14T19:00:55.084212] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-14T19:00:55.444855] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-14T19:00:55.758839] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-09-14T19:00:55.811920] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-14T19:00:56.558897] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-09-14T19:00:57.025069] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-14T19:00:57.358844] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-09-14T19:00:57.410825] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-14T19:00:57.625377] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-14T19:00:58.158895] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-09-14T19:00:58.958850] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-09-14T19:00:59.758853] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-09-14T19:00:59.820185] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-14T19:00:59.863484] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-14T19:01:00.558891] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-09-14T19:01:01.057309] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-14T19:01:01.358880] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-09-14T19:01:01.638515] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-14T19:01:02.158891] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-09-14T19:01:02.808180] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-14T19:01:02.829245] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-14T19:01:02.958957] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-09-14T19:01:03.758902] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-09-14T19:01:04.046150] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-14T19:01:04.197576] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-14T19:01:04.558866] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-09-14T19:01:04.806693] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-09-14T19:01:04.807429] [INFO ] [REMOTE ] MHLA: Full fetch complete (1149 records). [2025-09-14T19:01:04.807515] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-09-14T19:01:04.807976] [FATAL] [VALIDATOR ] MHLA: Data is stale - most recent date (2025-09-11) is before last completed trading day (2025-09-12). Symbol may be delisted or halted. [2025-09-14T19:01:04.808053] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:01:04.808101] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:01:04.808150] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-14T19:01:04.808220] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-14T19:01:04.808267] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-09-14T19:01:04.808318] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-09-14T19:01:04.808385] [INFO ] [MAIN ] Update Progress: 1356/2370 symbols completed. MHLA took 18.2s. Estimated remaining: 1h 47m 36s. Rate: 9.4 symbols/min [2025-09-14T19:01:04.989615] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:01:04.998462] [DEBUG] [LOCAL ] MIAX: Loaded 6719 existing records from primary storage. [2025-09-14T19:01:04.998681] [INFO ] [MAIN ] MIAX: Loaded 6719 existing records. [2025-09-14T19:01:05.189634] [WARN ] [MAIN ] MIAX: Insufficient historical data. Have data from 2025-08-14, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:01:05.189980] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-09-14T19:01:05.190045] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-14T19:01:05.190387] [DEBUG] [LOCAL ] MIAX: Deleted primary data file. [2025-09-14T19:01:05.190447] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-09-14T19:01:05.372482] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-09-14T19:01:05.561572] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:01:06.158935] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-02. [2025-09-14T19:01:06.161634] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-14T19:01:06.475771] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:01:06.476157] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-02 [2025-09-14T19:01:06.958831] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-03. [2025-09-14T19:01:07.235083] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:01:07.235445] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-03 [2025-09-14T19:01:07.758836] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-09-14T19:01:08.558868] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-04. [2025-09-14T19:01:08.847322] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:01:08.847772] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-04 [2025-09-14T19:01:09.015419] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-14T19:01:09.358846] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-09-14T19:01:10.158875] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-09-14T19:01:10.911472] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-14T19:01:10.958778] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-09-14T19:01:11.046067] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-14T19:01:11.758841] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-09-14T19:01:12.558904] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-09-14T19:01:12.685717] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-14T19:01:12.991446] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-14T19:01:13.306218] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-14T19:01:13.358845] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-09-14T19:01:14.023683] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T19:01:14.025144] [INFO ] [REMOTE ] MHN: Full fetch complete (8308 records). [2025-09-14T19:01:14.025228] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-09-14T19:01:14.174089] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-09-14T19:01:14.394684] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-09-14T19:01:14.394797] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-09-14T19:01:14.395049] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-09-14T19:01:14.395102] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-09-14T19:01:14.395561] [DEBUG] [LOCAL ] MHN: Trimmed 8308 records to 5568 (keeping 150 days of data) [2025-09-14T19:01:14.429028] [DEBUG] [LOCAL ] MHN: Primary data saved (5568 records). [2025-09-14T19:01:14.429136] [INFO ] [MAIN ] MHN: Full history saved. [2025-09-14T19:01:14.429255] [INFO ] [MAIN ] Update Progress: 1357/2370 symbols completed. MHN took 26.8s. Estimated remaining: 1h 47m 32s. Rate: 9.4 symbols/min [2025-09-14T19:01:14.945382] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-14T19:01:14.949797] [INFO ] [REMOTE ] MHK: Full fetch complete (46283 records). [2025-09-14T19:01:14.949925] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-09-14T19:01:14.963976] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-05. [2025-09-14T19:01:15.346335] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-09-14T19:01:15.343916] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:01:15.346716] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-05 [2025-09-14T19:01:15.346619] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-09-14T19:01:15.347994] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-09-14T19:01:15.348062] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-09-14T19:01:15.349127] [DEBUG] [LOCAL ] MHK: Trimmed 46283 records to 31851 (keeping 150 days of data) [2025-09-14T19:01:15.545733] [DEBUG] [LOCAL ] MHK: Primary data saved (31851 records). [2025-09-14T19:01:15.545899] [INFO ] [MAIN ] MHK: Full history saved. [2025-09-14T19:01:15.546042] [INFO ] [MAIN ] Update Progress: 1358/2370 symbols completed. MHK took 31.9s. Estimated remaining: 1h 47m 22s. Rate: 9.4 symbols/min [2025-09-14T19:01:15.758828] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-09-14T19:01:16.389073] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-14T19:01:16.391871] [INFO ] [REMOTE ] MHO: Full fetch complete (27059 records). [2025-09-14T19:01:16.391971] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-09-14T19:01:16.564228] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-06. [2025-09-14T19:01:16.763053] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-09-14T19:01:16.763180] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-09-14T19:01:16.763782] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-09-14T19:01:16.763846] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-09-14T19:01:16.764586] [DEBUG] [LOCAL ] MHO: Trimmed 27059 records to 17950 (keeping 150 days of data) [2025-09-14T19:01:16.879161] [DEBUG] [LOCAL ] MHO: Primary data saved (17950 records). [2025-09-14T19:01:16.879338] [INFO ] [MAIN ] MHO: Full history saved. [2025-09-14T19:01:16.879440] [INFO ] [MAIN ] Update Progress: 1359/2370 symbols completed. MHO took 27.6s. Estimated remaining: 1h 47m 11s. Rate: 9.4 symbols/min [2025-09-14T19:01:16.977226] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:01:16.977622] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-06 [2025-09-14T19:01:17.358831] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-07. [2025-09-14T19:01:17.614908] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:01:17.615242] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-07 [2025-09-14T19:01:18.158826] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-08. [2025-09-14T19:01:19.466270] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-14T19:01:19.472303] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-09. [2025-09-14T19:01:20.723032] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-14T19:01:20.727151] [INFO ] [REMOTE ] MIAX: Full fetch complete (6709 records). [2025-09-14T19:01:20.727240] [DEBUG] [VALIDATOR ] MIAX: Validating primary data. [2025-09-14T19:01:20.908760] [WARN ] [VALIDATOR ] MIAX: Validation failed - insufficient historical data. Have 21 unique days, need 150 days [2025-09-14T19:01:20.909005] [FATAL] [MAIN ] MIAX: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:01:20.909057] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:01:20.909128] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-14T19:01:20.909201] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-14T19:01:20.909244] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-09-14T19:01:20.909295] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-09-14T19:01:20.909382] [INFO ] [MAIN ] Update Progress: 1360/2370 symbols completed. MIAX took 16.1s. Estimated remaining: 1h 47m 3s. Rate: 9.4 symbols/min [2025-09-14T19:01:21.569776] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:01:21.656174] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:01:21.657558] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:01:21.659737] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:01:21.668507] [DEBUG] [LOCAL ] MITP: Loaded 702 existing records from primary storage. [2025-09-14T19:01:21.666667] [DEBUG] [LOCAL ] MITN: Loaded 434 existing records from primary storage. [2025-09-14T19:01:21.668866] [INFO ] [MAIN ] MITP: Loaded 702 existing records. [2025-09-14T19:01:21.674842] [INFO ] [MAIN ] MITN: Loaded 434 existing records. [2025-09-14T19:01:21.831096] [DEBUG] [LOCAL ] MIN: Loaded 7358 existing records from primary storage. [2025-09-14T19:01:21.888023] [INFO ] [MAIN ] MIN: Loaded 7358 existing records. [2025-09-14T19:01:21.875577] [DEBUG] [LOCAL ] MIR: Loaded 23136 existing records from primary storage. [2025-09-14T19:01:21.963874] [INFO ] [MAIN ] MIR: Loaded 23136 existing records. [2025-09-14T19:01:22.074889] [WARN ] [MAIN ] MITN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:01:22.215713] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-09-14T19:01:22.267951] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:01:22.362804] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-09-14T19:01:22.331492] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-14T19:01:22.368107] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:01:22.371800] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-09-14T19:01:22.372277] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-09-14T19:01:22.372214] [DEBUG] [LOCAL ] MITN: Deleted primary data file. [2025-09-14T19:01:22.383052] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-09-14T19:01:22.377801] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-09-14T19:01:22.377868] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-09-14T19:01:22.412615] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-09-14T19:01:22.459455] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-09-14T19:01:22.490962] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:01:22.510435] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-09-14T19:01:22.613332] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-09-14T19:01:22.684428] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-09-14T19:01:22.860165] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-09-14T19:01:22.944198] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-09-14T19:01:23.713776] [INFO ] [REMOTE ] MITN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:01:23.914694] [INFO ] [REMOTE ] MITP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:01:23.834237] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-09-14T19:01:23.988883] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-09-14T19:01:23.992987] [INFO ] [REMOTE ] MIN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:01:24.009470] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-09-14T19:01:24.094555] [INFO ] [REMOTE ] MIR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:01:24.095148] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-09-14T19:01:24.573829] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-14T19:01:24.575177] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-09-14T19:01:24.587335] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-14T19:01:24.588725] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-09-14T19:01:24.874457] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-14T19:01:24.876921] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-09-14T19:01:25.008044] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-14T19:01:25.112324] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-14T19:01:25.358907] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-09-14T19:01:25.682199] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T19:01:25.723937] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-14T19:01:26.001860] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-14T19:01:26.158869] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-09-14T19:01:26.958975] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-09-14T19:01:27.034828] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-14T19:01:27.506088] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-14T19:01:27.758895] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-09-14T19:01:28.211432] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-14T19:01:28.558868] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-09-14T19:01:28.983179] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-14T19:01:29.358929] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-09-14T19:01:30.158924] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-09-14T19:01:30.249718] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-14T19:01:30.958869] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-09-14T19:01:31.758878] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-09-14T19:01:31.880034] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-14T19:01:31.961335] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-14T19:01:32.379708] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-14T19:01:32.558882] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-09-14T19:01:33.023423] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-14T19:01:33.358884] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-09-14T19:01:34.158872] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-09-14T19:01:34.591741] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-14T19:01:34.601150] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-14T19:01:34.958931] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-09-14T19:01:35.758941] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-09-14T19:01:36.263943] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-14T19:01:36.558874] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-09-14T19:01:36.700309] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-14T19:01:37.358875] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-09-14T19:01:37.591973] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-14T19:01:37.688996] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-14T19:01:38.158851] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-09-14T19:01:38.493380] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-14T19:01:38.494150] [INFO ] [REMOTE ] MITN: Full fetch complete (1941 records). [2025-09-14T19:01:38.494231] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-09-14T19:01:38.667867] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-14T19:01:38.668046] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:01:38.668098] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:01:38.668143] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-14T19:01:38.668209] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-14T19:01:38.668253] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-09-14T19:01:38.668301] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-09-14T19:01:38.668398] [INFO ] [MAIN ] Update Progress: 1361/2370 symbols completed. MITN took 17.8s. Estimated remaining: 1h 47m 5s. Rate: 9.4 symbols/min [2025-09-14T19:01:38.835330] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:01:38.846343] [DEBUG] [LOCAL ] MITT: Loaded 9179 existing records from primary storage. [2025-09-14T19:01:38.846487] [INFO ] [MAIN ] MITT: Loaded 9179 existing records. [2025-09-14T19:01:38.963971] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-09-14T19:01:39.023191] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:01:39.023364] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-09-14T19:01:39.023420] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-09-14T19:01:39.023865] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-09-14T19:01:39.023924] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-09-14T19:01:39.372178] [INFO ] [REMOTE ] MITT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:01:39.758865] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-09-14T19:01:40.558886] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-09-14T19:01:40.803662] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-14T19:01:40.886611] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-14T19:01:40.942733] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-14T19:01:41.358884] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-09-14T19:01:42.158875] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-09-14T19:01:42.601189] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-14T19:01:42.958872] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-09-14T19:01:43.010809] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-14T19:01:43.012599] [INFO ] [REMOTE ] MIN: Full fetch complete (13913 records). [2025-09-14T19:01:43.012707] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-09-14T19:01:43.384854] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T19:01:43.394353] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-09-14T19:01:43.395934] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-09-14T19:01:43.395849] [INFO ] [REMOTE ] MITP: Full fetch complete (2550 records). [2025-09-14T19:01:43.396517] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-09-14T19:01:43.396659] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-09-14T19:01:43.396836] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-09-14T19:01:43.496950] [DEBUG] [LOCAL ] MIN: Trimmed 13913 records to 10736 (keeping 150 days of data) [2025-09-14T19:01:43.761513] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-09-14T19:01:43.837871] [DEBUG] [LOCAL ] MIN: Primary data saved (10736 records). [2025-09-14T19:01:43.838394] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-09-14T19:01:43.838571] [INFO ] [MAIN ] MIN: Full history saved. [2025-09-14T19:01:43.838869] [INFO ] [MAIN ] Update Progress: 1362/2370 symbols completed. MIN took 22.9s. Estimated remaining: 1h 46m 58s. Rate: 9.4 symbols/min [2025-09-14T19:01:43.838931] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-09-14T19:01:43.884404] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-09-14T19:01:43.918665] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-09-14T19:01:43.948166] [DEBUG] [LOCAL ] MITP: Trimmed 2550 records to 1677 (keeping 150 days of data) [2025-09-14T19:01:44.032448] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:01:44.035549] [DEBUG] [LOCAL ] MITP: Primary data saved (1677 records). [2025-09-14T19:01:44.035919] [INFO ] [MAIN ] MITP: Full history saved. [2025-09-14T19:01:44.036066] [INFO ] [MAIN ] Update Progress: 1363/2370 symbols completed. MITP took 23.1s. Estimated remaining: 1h 46m 47s. Rate: 9.4 symbols/min [2025-09-14T19:01:44.135953] [DEBUG] [LOCAL ] MIY: Loaded 2852 existing records from primary storage. [2025-09-14T19:01:44.147480] [INFO ] [MAIN ] MIY: Loaded 2852 existing records. [2025-09-14T19:01:44.360286] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:01:44.420758] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:01:44.421417] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-09-14T19:01:44.421486] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-09-14T19:01:44.421915] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-09-14T19:01:44.421987] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-09-14T19:01:44.559358] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-09-14T19:01:44.698844] [DEBUG] [LOCAL ] MKC: Loaded 23573 existing records from primary storage. [2025-09-14T19:01:44.730408] [INFO ] [MAIN ] MKC: Loaded 23573 existing records. [2025-09-14T19:01:44.934290] [INFO ] [REMOTE ] MIY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:01:45.019762] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:01:45.020119] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-09-14T19:01:45.020210] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-09-14T19:01:45.021099] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-09-14T19:01:45.021185] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-09-14T19:01:45.365278] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-09-14T19:01:45.404213] [INFO ] [REMOTE ] MKC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:01:45.780338] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-14T19:01:45.816448] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-14T19:01:46.158801] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-09-14T19:01:46.159686] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-14T19:01:46.958838] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-09-14T19:01:47.758836] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-09-14T19:01:47.989305] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-14T19:01:48.558805] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-09-14T19:01:48.720084] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-14T19:01:48.947224] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-14T19:01:49.358864] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-09-14T19:01:50.110127] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-14T19:01:50.158856] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-09-14T19:01:50.313002] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-14T19:01:50.938433] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-14T19:01:50.958805] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-09-14T19:01:51.633779] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-14T19:01:51.758875] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-09-14T19:01:52.558857] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-09-14T19:01:53.110738] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-14T19:01:53.358869] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-09-14T19:01:54.081765] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-14T19:01:54.087583] [INFO ] [REMOTE ] MIR: Full fetch complete (55100 records). [2025-09-14T19:01:54.087833] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-09-14T19:01:54.164799] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-09-14T19:01:54.495906] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-09-14T19:01:54.496054] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-09-14T19:01:54.497046] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-09-14T19:01:54.497121] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-09-14T19:01:54.498441] [DEBUG] [LOCAL ] MIR: Trimmed 55100 records to 38381 (keeping 150 days of data) [2025-09-14T19:01:54.751043] [DEBUG] [LOCAL ] MIR: Primary data saved (38381 records). [2025-09-14T19:01:54.751251] [INFO ] [MAIN ] MIR: Full history saved. [2025-09-14T19:01:54.751382] [INFO ] [MAIN ] Update Progress: 1364/2370 symbols completed. MIR took 33.8s. Estimated remaining: 1h 46m 44s. Rate: 9.4 symbols/min [2025-09-14T19:01:54.934308] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:01:54.951916] [DEBUG] [LOCAL ] MKL: Loaded 14573 existing records from primary storage. [2025-09-14T19:01:54.952106] [INFO ] [MAIN ] MKL: Loaded 14573 existing records. [2025-09-14T19:01:54.983691] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-09-14T19:01:55.139402] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:01:55.140276] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-14T19:01:55.142696] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-09-14T19:01:55.142765] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-09-14T19:01:55.143221] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-09-14T19:01:55.143286] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-09-14T19:01:55.492133] [INFO ] [REMOTE ] MKL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:01:55.528015] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-14T19:01:55.758828] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-09-14T19:01:56.169434] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-14T19:01:56.558812] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-09-14T19:01:57.289961] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-14T19:01:57.358824] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-09-14T19:01:58.158860] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-09-14T19:01:58.653210] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-14T19:01:58.884941] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-14T19:01:58.958864] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-09-14T19:01:59.758851] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-09-14T19:02:00.005825] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-14T19:02:00.182035] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-14T19:02:00.558929] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-09-14T19:02:01.358852] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-09-14T19:02:01.616458] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T19:02:01.951296] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-14T19:02:01.952595] [INFO ] [REMOTE ] MIY: Full fetch complete (6339 records). [2025-09-14T19:02:01.952727] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-09-14T19:02:02.164708] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-09-14T19:02:02.316717] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-09-14T19:02:02.316845] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-09-14T19:02:02.317107] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-09-14T19:02:02.317161] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-09-14T19:02:02.317687] [DEBUG] [LOCAL ] MIY: Trimmed 6339 records to 4348 (keeping 150 days of data) [2025-09-14T19:02:02.347452] [DEBUG] [LOCAL ] MIY: Primary data saved (4348 records). [2025-09-14T19:02:02.347623] [INFO ] [MAIN ] MIY: Full history saved. [2025-09-14T19:02:02.347817] [INFO ] [MAIN ] Update Progress: 1365/2370 symbols completed. MIY took 18.5s. Estimated remaining: 1h 46m 39s. Rate: 9.4 symbols/min [2025-09-14T19:02:02.519201] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:02:02.541418] [DEBUG] [LOCAL ] MLI: Loaded 19640 existing records from primary storage. [2025-09-14T19:02:02.541630] [INFO ] [MAIN ] MLI: Loaded 19640 existing records. [2025-09-14T19:02:02.724108] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:02:02.724370] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-09-14T19:02:02.724431] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-09-14T19:02:02.725018] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-09-14T19:02:02.725087] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-09-14T19:02:02.966249] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-09-14T19:02:02.996039] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-14T19:02:03.038022] [INFO ] [REMOTE ] MITT: Full fetch complete (25088 records). [2025-09-14T19:02:03.075418] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-09-14T19:02:03.105396] [INFO ] [REMOTE ] MLI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:02:03.461314] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-09-14T19:02:03.461446] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-09-14T19:02:03.461872] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-09-14T19:02:03.461930] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-09-14T19:02:03.463512] [DEBUG] [LOCAL ] MITT: Trimmed 25088 records to 16045 (keeping 150 days of data) [2025-09-14T19:02:03.563978] [DEBUG] [LOCAL ] MITT: Primary data saved (16045 records). [2025-09-14T19:02:03.564140] [INFO ] [MAIN ] MITT: Full history saved. [2025-09-14T19:02:03.564321] [INFO ] [MAIN ] Update Progress: 1366/2370 symbols completed. MITT took 24.9s. Estimated remaining: 1h 46m 28s. Rate: 9.4 symbols/min [2025-09-14T19:02:03.731806] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:02:03.752339] [DEBUG] [LOCAL ] MLM: Loaded 12656 existing records from primary storage. [2025-09-14T19:02:03.752518] [INFO ] [MAIN ] MLM: Loaded 12656 existing records. [2025-09-14T19:02:03.783950] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-09-14T19:02:03.934791] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:02:03.935136] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-09-14T19:02:03.935200] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-09-14T19:02:03.935803] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-09-14T19:02:03.935867] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-09-14T19:02:04.289148] [INFO ] [REMOTE ] MLM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:02:04.510600] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-14T19:02:04.558775] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-09-14T19:02:04.726211] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-14T19:02:05.358820] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-09-14T19:02:05.454784] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T19:02:06.158788] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-09-14T19:02:06.587072] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-14T19:02:06.824194] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-14T19:02:06.958813] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-09-14T19:02:07.706938] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-14T19:02:07.758858] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-09-14T19:02:08.372989] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-14T19:02:08.558821] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-09-14T19:02:09.358866] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-09-14T19:02:09.545340] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-14T19:02:09.614966] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-14T19:02:10.158877] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-09-14T19:02:10.958829] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-09-14T19:02:10.989312] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T19:02:11.758846] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-09-14T19:02:11.894755] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-14T19:02:12.558822] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-09-14T19:02:12.810220] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-14T19:02:13.358801] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-09-14T19:02:13.434778] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-14T19:02:14.045687] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T19:02:14.158822] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-09-14T19:02:14.958792] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-09-14T19:02:14.987015] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-14T19:02:15.279116] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-14T19:02:15.282797] [INFO ] [REMOTE ] MKL: Full fetch complete (37784 records). [2025-09-14T19:02:15.282914] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-09-14T19:02:15.659247] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-09-14T19:02:15.659383] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-09-14T19:02:15.660232] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-09-14T19:02:15.660313] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-09-14T19:02:15.661416] [DEBUG] [LOCAL ] MKL: Trimmed 37784 records to 25665 (keeping 150 days of data) [2025-09-14T19:02:15.758977] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-09-14T19:02:15.827128] [DEBUG] [LOCAL ] MKL: Primary data saved (25665 records). [2025-09-14T19:02:15.827286] [INFO ] [MAIN ] MKL: Full history saved. [2025-09-14T19:02:15.827416] [INFO ] [MAIN ] Update Progress: 1367/2370 symbols completed. MKL took 21.1s. Estimated remaining: 1h 46m 26s. Rate: 9.4 symbols/min [2025-09-14T19:02:15.996227] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:02:16.009235] [DEBUG] [LOCAL ] MLNK: Loaded 11865 existing records from primary storage. [2025-09-14T19:02:16.009414] [INFO ] [MAIN ] MLNK: Loaded 11865 existing records. [2025-09-14T19:02:16.186602] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:02:16.186891] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-09-14T19:02:16.186951] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-09-14T19:02:16.187402] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-09-14T19:02:16.187465] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-09-14T19:02:16.545929] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:02:16.560386] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-09-14T19:02:16.565916] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-14T19:02:17.358848] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-09-14T19:02:17.509220] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-14T19:02:18.158797] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-09-14T19:02:18.317227] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T19:02:18.748883] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-14T19:02:18.958855] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-09-14T19:02:19.679337] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-14T19:02:19.758873] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-09-14T19:02:20.563976] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-09-14T19:02:20.577548] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-14T19:02:21.358783] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-09-14T19:02:21.425101] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-14T19:02:21.638506] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T19:02:22.158896] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-09-14T19:02:22.456417] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-14T19:02:22.842388] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-14T19:02:22.847323] [INFO ] [REMOTE ] MLI: Full fetch complete (47764 records). [2025-09-14T19:02:22.847502] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-09-14T19:02:22.963936] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-09-14T19:02:23.237828] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-09-14T19:02:23.237942] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-09-14T19:02:23.238746] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-09-14T19:02:23.238803] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-09-14T19:02:23.241187] [DEBUG] [LOCAL ] MLI: Trimmed 47764 records to 32624 (keeping 150 days of data) [2025-09-14T19:02:23.467958] [DEBUG] [LOCAL ] MLI: Primary data saved (32624 records). [2025-09-14T19:02:23.468126] [INFO ] [MAIN ] MLI: Full history saved. [2025-09-14T19:02:23.468239] [INFO ] [MAIN ] Update Progress: 1368/2370 symbols completed. MLI took 21.1s. Estimated remaining: 1h 46m 21s. Rate: 9.4 symbols/min [2025-09-14T19:02:23.637528] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:02:23.640942] [DEBUG] [LOCAL ] MLP: Loaded 1222 existing records from primary storage. [2025-09-14T19:02:23.641041] [INFO ] [MAIN ] MLP: Loaded 1222 existing records. [2025-09-14T19:02:23.762213] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-09-14T19:02:23.827439] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:02:23.827997] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-09-14T19:02:23.828142] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-09-14T19:02:23.833623] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-09-14T19:02:23.842249] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-09-14T19:02:23.848713] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-14T19:02:23.941382] [INFO ] [REMOTE ] MKC: Full fetch complete (56983 records). [2025-09-14T19:02:23.952888] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-09-14T19:02:24.502574] [INFO ] [REMOTE ] MLP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:02:24.561137] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-09-14T19:02:24.597159] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-09-14T19:02:24.597286] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-09-14T19:02:24.598258] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-09-14T19:02:24.598335] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-09-14T19:02:24.600013] [DEBUG] [LOCAL ] MKC: Trimmed 56983 records to 39477 (keeping 150 days of data) [2025-09-14T19:02:24.866430] [DEBUG] [LOCAL ] MKC: Primary data saved (39477 records). [2025-09-14T19:02:24.866634] [INFO ] [MAIN ] MKC: Full history saved. [2025-09-14T19:02:24.866794] [INFO ] [MAIN ] Update Progress: 1369/2370 symbols completed. MKC took 40.8s. Estimated remaining: 1h 46m 11s. Rate: 9.4 symbols/min [2025-09-14T19:02:25.037731] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:02:25.054413] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-14T19:02:25.062711] [DEBUG] [LOCAL ] MLR: Loaded 5552 existing records from primary storage. [2025-09-14T19:02:25.063036] [INFO ] [MAIN ] MLR: Loaded 5552 existing records. [2025-09-14T19:02:25.241075] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:02:25.241418] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-09-14T19:02:25.241486] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-09-14T19:02:25.241924] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-09-14T19:02:25.249283] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-09-14T19:02:25.249509] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-14T19:02:25.322208] [INFO ] [REMOTE ] MLM: Full fetch complete (35400 records). [2025-09-14T19:02:25.344163] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-09-14T19:02:25.376268] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-09-14T19:02:25.821492] [INFO ] [REMOTE ] MLR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:02:26.017849] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-09-14T19:02:26.017961] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-09-14T19:02:26.018606] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-09-14T19:02:26.018674] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-09-14T19:02:26.019560] [DEBUG] [LOCAL ] MLM: Trimmed 35400 records to 21830 (keeping 150 days of data) [2025-09-14T19:02:26.116966] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-14T19:02:26.158800] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-09-14T19:02:26.178778] [DEBUG] [LOCAL ] MLM: Primary data saved (21830 records). [2025-09-14T19:02:26.178917] [INFO ] [MAIN ] MLM: Full history saved. [2025-09-14T19:02:26.179014] [INFO ] [MAIN ] Update Progress: 1370/2370 symbols completed. MLM took 22.6s. Estimated remaining: 1h 46m 1s. Rate: 9.4 symbols/min [2025-09-14T19:02:26.349471] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:02:26.372382] [DEBUG] [LOCAL ] MMC: Loaded 23327 existing records from primary storage. [2025-09-14T19:02:26.372600] [INFO ] [MAIN ] MMC: Loaded 23327 existing records. [2025-09-14T19:02:26.548799] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:02:26.549070] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-09-14T19:02:26.549155] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-09-14T19:02:26.550047] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-09-14T19:02:26.550127] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-09-14T19:02:26.736499] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-14T19:02:26.909333] [INFO ] [REMOTE ] MMC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:02:26.958785] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-09-14T19:02:27.758838] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-09-14T19:02:27.850619] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-14T19:02:28.558884] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-09-14T19:02:28.678937] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-14T19:02:29.167271] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-14T19:02:29.358864] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-09-14T19:02:30.015213] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-14T19:02:30.158840] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-09-14T19:02:30.958814] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-09-14T19:02:31.034175] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-14T19:02:31.758871] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-09-14T19:02:32.121957] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T19:02:32.558907] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-09-14T19:02:32.804813] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-14T19:02:33.306796] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-14T19:02:33.358787] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-09-14T19:02:34.158828] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-09-14T19:02:34.231090] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T19:02:34.819708] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-14T19:02:34.958855] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-09-14T19:02:35.758844] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-09-14T19:02:35.782911] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-14T19:02:36.201028] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-14T19:02:36.558908] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-09-14T19:02:37.000178] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-14T19:02:37.358881] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-09-14T19:02:38.158829] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-09-14T19:02:38.280252] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-14T19:02:38.751200] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T19:02:38.752256] [INFO ] [REMOTE ] MLP: Full fetch complete (3198 records). [2025-09-14T19:02:38.752343] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-09-14T19:02:38.964325] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-09-14T19:02:39.153666] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-09-14T19:02:39.153788] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-09-14T19:02:39.153961] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-09-14T19:02:39.154027] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-09-14T19:02:39.154430] [DEBUG] [LOCAL ] MLP: Trimmed 3198 records to 2297 (keeping 150 days of data) [2025-09-14T19:02:39.168192] [DEBUG] [LOCAL ] MLP: Primary data saved (2297 records). [2025-09-14T19:02:39.168281] [INFO ] [MAIN ] MLP: Full history saved. [2025-09-14T19:02:39.168396] [INFO ] [MAIN ] Update Progress: 1371/2370 symbols completed. MLP took 15.7s. Estimated remaining: 1h 45m 59s. Rate: 9.4 symbols/min [2025-09-14T19:02:39.340794] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:02:39.347554] [DEBUG] [LOCAL ] MMD: Loaded 4639 existing records from primary storage. [2025-09-14T19:02:39.347740] [INFO ] [MAIN ] MMD: Loaded 4639 existing records. [2025-09-14T19:02:39.523967] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:02:39.524222] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-09-14T19:02:39.524282] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-09-14T19:02:39.524620] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-09-14T19:02:39.524728] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-09-14T19:02:39.765830] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-09-14T19:02:39.885028] [INFO ] [REMOTE ] MMD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:02:40.341536] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-14T19:02:40.459227] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-14T19:02:40.558911] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-09-14T19:02:41.358873] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-09-14T19:02:41.445784] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-14T19:02:42.158819] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-09-14T19:02:42.457507] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-14T19:02:42.958882] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-09-14T19:02:43.187807] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-14T19:02:43.758853] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-09-14T19:02:44.251463] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-14T19:02:44.441747] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-14T19:02:44.558844] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-09-14T19:02:45.252378] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-14T19:02:45.358828] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-09-14T19:02:46.158857] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-09-14T19:02:46.259622] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-14T19:02:46.958883] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-09-14T19:02:47.260165] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-14T19:02:47.758864] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-09-14T19:02:47.890747] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-14T19:02:48.558845] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-09-14T19:02:48.649875] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-14T19:02:48.651920] [INFO ] [REMOTE ] MLR: Full fetch complete (14383 records). [2025-09-14T19:02:48.652008] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-09-14T19:02:49.023051] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-09-14T19:02:49.023233] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-09-14T19:02:49.023843] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-09-14T19:02:49.023904] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-09-14T19:02:49.025011] [DEBUG] [LOCAL ] MLR: Trimmed 14383 records to 8560 (keeping 150 days of data) [2025-09-14T19:02:49.082956] [DEBUG] [LOCAL ] MLR: Primary data saved (8560 records). [2025-09-14T19:02:49.083136] [INFO ] [MAIN ] MLR: Full history saved. [2025-09-14T19:02:49.083245] [INFO ] [MAIN ] Update Progress: 1372/2370 symbols completed. MLR took 24.2s. Estimated remaining: 1h 45m 56s. Rate: 9.4 symbols/min [2025-09-14T19:02:49.255985] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:02:49.264273] [DEBUG] [LOCAL ] MMI: Loaded 6339 existing records from primary storage. [2025-09-14T19:02:49.264440] [INFO ] [MAIN ] MMI: Loaded 6339 existing records. [2025-09-14T19:02:49.364732] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-09-14T19:02:49.445197] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:02:49.445566] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-09-14T19:02:49.445658] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-09-14T19:02:49.446001] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-09-14T19:02:49.446063] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-09-14T19:02:49.812932] [INFO ] [REMOTE ] MMI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:02:49.946678] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-14T19:02:50.158855] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-09-14T19:02:50.219807] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-14T19:02:50.828343] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-14T19:02:50.958884] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-09-14T19:02:51.758844] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-09-14T19:02:52.091862] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-14T19:02:52.558866] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-09-14T19:02:52.591442] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-14T19:02:53.306538] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T19:02:53.313438] [INFO ] [REMOTE ] MMC: Full fetch complete (56266 records). [2025-09-14T19:02:53.313707] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-09-14T19:02:53.363916] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-09-14T19:02:53.724509] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-09-14T19:02:53.724673] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-09-14T19:02:53.725761] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-09-14T19:02:53.725866] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-09-14T19:02:53.727358] [DEBUG] [LOCAL ] MMC: Trimmed 56266 records to 38946 (keeping 150 days of data) [2025-09-14T19:02:53.993521] [DEBUG] [LOCAL ] MMC: Primary data saved (38946 records). [2025-09-14T19:02:53.993721] [INFO ] [MAIN ] MMC: Full history saved. [2025-09-14T19:02:53.993826] [INFO ] [MAIN ] Update Progress: 1373/2370 symbols completed. MMC took 27.8s. Estimated remaining: 1h 45m 48s. Rate: 9.4 symbols/min [2025-09-14T19:02:54.129751] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-14T19:02:54.161591] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-09-14T19:02:54.182721] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:02:54.185180] [DEBUG] [LOCAL ] MMKT: Loaded 540 existing records from primary storage. [2025-09-14T19:02:54.185456] [INFO ] [MAIN ] MMKT: Loaded 540 existing records. [2025-09-14T19:02:54.364375] [WARN ] [MAIN ] MMKT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:02:54.364674] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-09-14T19:02:54.364738] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-14T19:02:54.364987] [DEBUG] [LOCAL ] MMKT: Deleted primary data file. [2025-09-14T19:02:54.365047] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-09-14T19:02:54.734330] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:02:54.958820] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-09-14T19:02:55.233418] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-14T19:02:55.385703] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-14T19:02:55.758850] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-09-14T19:02:56.258605] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-14T19:02:56.558822] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-09-14T19:02:57.358842] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-09-14T19:02:57.513398] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-14T19:02:58.158883] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-09-14T19:02:58.363249] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-14T19:02:58.366601] [INFO ] [REMOTE ] MLNK: Full fetch complete (26925 records). [2025-09-14T19:02:58.366714] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-09-14T19:02:58.736829] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-09-14T19:02:58.737005] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-09-14T19:02:58.737561] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-09-14T19:02:58.737617] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-09-14T19:02:58.738327] [DEBUG] [LOCAL ] MLNK: Trimmed 26925 records to 19044 (keeping 150 days of data) [2025-09-14T19:02:58.861506] [DEBUG] [LOCAL ] MLNK: Primary data saved (19044 records). [2025-09-14T19:02:58.861729] [INFO ] [MAIN ] MLNK: Full history saved. [2025-09-14T19:02:58.861839] [INFO ] [MAIN ] Update Progress: 1374/2370 symbols completed. MLNK took 43.0s. Estimated remaining: 1h 45m 41s. Rate: 9.4 symbols/min [2025-09-14T19:02:58.961136] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-09-14T19:02:58.981369] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-14T19:02:59.042159] [INFO ] [REMOTE ] MMD: Full fetch complete (12325 records). [2025-09-14T19:02:59.044975] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-09-14T19:02:59.044791] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:02:59.315096] [DEBUG] [LOCAL ] MMM: Loaded 23725 existing records from primary storage. [2025-09-14T19:02:59.341308] [INFO ] [MAIN ] MMM: Loaded 23725 existing records. [2025-09-14T19:02:59.513270] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-14T19:02:59.531947] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-09-14T19:02:59.561918] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-09-14T19:02:59.576951] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-09-14T19:02:59.599037] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-09-14T19:02:59.599148] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:02:59.599749] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-09-14T19:02:59.599806] [DEBUG] [LOCAL ] MMD: Trimmed 12325 records to 7956 (keeping 150 days of data) [2025-09-14T19:02:59.599911] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-09-14T19:02:59.620926] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-09-14T19:02:59.635204] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-09-14T19:02:59.760205] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-09-14T19:02:59.869799] [DEBUG] [LOCAL ] MMD: Primary data saved (7956 records). [2025-09-14T19:02:59.931132] [INFO ] [MAIN ] MMD: Full history saved. [2025-09-14T19:02:59.941480] [INFO ] [MAIN ] Update Progress: 1375/2370 symbols completed. MMD took 20.8s. Estimated remaining: 1h 45m 31s. Rate: 9.4 symbols/min [2025-09-14T19:03:00.125078] [INFO ] [REMOTE ] MMM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:03:00.220613] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:03:00.238728] [DEBUG] [LOCAL ] MMS: Loaded 15098 existing records from primary storage. [2025-09-14T19:03:00.238972] [INFO ] [MAIN ] MMS: Loaded 15098 existing records. [2025-09-14T19:03:00.435608] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:03:00.436024] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-09-14T19:03:00.436097] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-09-14T19:03:00.436685] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-09-14T19:03:00.436755] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-09-14T19:03:00.536372] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-14T19:03:00.563962] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-09-14T19:03:00.817702] [INFO ] [REMOTE ] MMS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:03:01.358908] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-09-14T19:03:02.025673] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T19:03:02.158938] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-09-14T19:03:02.731884] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-14T19:03:02.958874] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-09-14T19:03:03.758899] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-09-14T19:03:04.397510] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-14T19:03:04.558867] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-09-14T19:03:04.576540] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-14T19:03:05.119847] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-14T19:03:05.358834] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-09-14T19:03:06.158828] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-09-14T19:03:06.591199] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-14T19:03:06.592037] [INFO ] [REMOTE ] MMKT: Full fetch complete (1533 records). [2025-09-14T19:03:06.592134] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-09-14T19:03:06.786250] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-14T19:03:06.786866] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:03:06.787022] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:03:06.787176] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-14T19:03:06.787411] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-14T19:03:06.787511] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-09-14T19:03:06.788231] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-09-14T19:03:06.788450] [INFO ] [MAIN ] Update Progress: 1376/2370 symbols completed. MMKT took 12.8s. Estimated remaining: 1h 45m 25s. Rate: 9.4 symbols/min [2025-09-14T19:03:06.961697] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-09-14T19:03:06.961616] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:03:07.014561] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (3.26 seconds). [2025-09-14T19:03:07.029023] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T19:03:07.037297] [DEBUG] [LOCAL ] MMT: Loaded 4970 existing records from primary storage. [2025-09-14T19:03:07.037837] [INFO ] [MAIN ] MMT: Loaded 4970 existing records. [2025-09-14T19:03:07.217443] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:03:07.217786] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-09-14T19:03:07.217853] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-09-14T19:03:07.218387] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-09-14T19:03:07.218708] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-09-14T19:03:07.569746] [INFO ] [REMOTE ] MMT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:03:07.758803] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-09-14T19:03:08.025082] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-14T19:03:08.558862] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-09-14T19:03:09.358825] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-09-14T19:03:09.477164] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-14T19:03:10.015770] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-14T19:03:10.158845] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-09-14T19:03:10.196712] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-14T19:03:10.958892] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-09-14T19:03:11.511900] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-14T19:03:11.758895] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-09-14T19:03:12.558922] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-09-14T19:03:13.293444] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-14T19:03:13.342633] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-14T19:03:13.358771] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-09-14T19:03:13.758446] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-14T19:03:14.158868] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-09-14T19:03:14.654817] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T19:03:14.656783] [INFO ] [REMOTE ] MMI: Full fetch complete (16820 records). [2025-09-14T19:03:14.656911] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-09-14T19:03:14.961106] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-09-14T19:03:15.041336] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-09-14T19:03:15.041465] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-09-14T19:03:15.041945] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-09-14T19:03:15.052357] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-09-14T19:03:15.059846] [DEBUG] [LOCAL ] MMI: Trimmed 16820 records to 11093 (keeping 150 days of data) [2025-09-14T19:03:15.060888] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-14T19:03:15.134690] [DEBUG] [LOCAL ] MMI: Primary data saved (11093 records). [2025-09-14T19:03:15.134884] [INFO ] [MAIN ] MMI: Full history saved. [2025-09-14T19:03:15.134990] [INFO ] [MAIN ] Update Progress: 1377/2370 symbols completed. MMI took 26.1s. Estimated remaining: 1h 45m 20s. Rate: 9.4 symbols/min [2025-09-14T19:03:15.307576] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:03:15.317339] [DEBUG] [LOCAL ] MMU: Loaded 7800 existing records from primary storage. [2025-09-14T19:03:15.317516] [INFO ] [MAIN ] MMU: Loaded 7800 existing records. [2025-09-14T19:03:15.494705] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:03:15.495001] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-09-14T19:03:15.495062] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-09-14T19:03:15.495864] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-09-14T19:03:15.495932] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-09-14T19:03:15.768926] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-09-14T19:03:15.861744] [INFO ] [REMOTE ] MMU: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:03:16.558843] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-09-14T19:03:17.358897] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-09-14T19:03:17.666458] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-09-14T19:03:18.158885] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-09-14T19:03:18.671782] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (2.90 seconds). [2025-09-14T19:03:18.792972] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-14T19:03:18.930022] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-14T19:03:18.958768] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-09-14T19:03:19.758843] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-09-14T19:03:19.963744] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T19:03:20.062760] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-14T19:03:20.558886] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-09-14T19:03:20.666244] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-14T19:03:21.358826] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-09-14T19:03:21.754029] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-14T19:03:22.158880] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-09-14T19:03:22.190091] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-14T19:03:22.958838] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-09-14T19:03:23.568832] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-14T19:03:23.758874] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-09-14T19:03:24.558890] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-09-14T19:03:24.794848] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-14T19:03:25.096376] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-14T19:03:25.358846] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-09-14T19:03:25.775341] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-14T19:03:26.158842] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-09-14T19:03:26.471019] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-14T19:03:26.958889] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-09-14T19:03:27.596794] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T19:03:27.601117] [INFO ] [REMOTE ] MMS: Full fetch complete (37797 records). [2025-09-14T19:03:27.601271] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-09-14T19:03:27.764352] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-09-14T19:03:27.989529] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-09-14T19:03:27.989723] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-09-14T19:03:27.990752] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-09-14T19:03:27.990852] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-09-14T19:03:27.992153] [DEBUG] [LOCAL ] MMS: Trimmed 37797 records to 24667 (keeping 150 days of data) [2025-09-14T19:03:28.163230] [DEBUG] [LOCAL ] MMS: Primary data saved (24667 records). [2025-09-14T19:03:28.163400] [INFO ] [MAIN ] MMS: Full history saved. [2025-09-14T19:03:28.163519] [INFO ] [MAIN ] Update Progress: 1378/2370 symbols completed. MMS took 28.2s. Estimated remaining: 1h 45m 18s. Rate: 9.4 symbols/min [2025-09-14T19:03:28.335431] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:03:28.348120] [DEBUG] [LOCAL ] MNR: Loaded 11268 existing records from primary storage. [2025-09-14T19:03:28.348308] [INFO ] [MAIN ] MNR: Loaded 11268 existing records. [2025-09-14T19:03:28.526463] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:03:28.526737] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-09-14T19:03:28.526806] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-09-14T19:03:28.527263] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-09-14T19:03:28.527321] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-09-14T19:03:28.563913] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-09-14T19:03:28.849781] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-09-14T19:03:28.941521] [INFO ] [REMOTE ] MNR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:03:28.950549] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-14T19:03:29.197379] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-14T19:03:29.358843] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-09-14T19:03:30.158834] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-09-14T19:03:30.679079] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-14T19:03:30.958832] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-09-14T19:03:31.026501] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-14T19:03:31.031956] [INFO ] [REMOTE ] MMM: Full fetch complete (57928 records). [2025-09-14T19:03:31.032076] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-09-14T19:03:31.427955] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-09-14T19:03:31.428086] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-09-14T19:03:31.428980] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-09-14T19:03:31.429036] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-09-14T19:03:31.430203] [DEBUG] [LOCAL ] MMM: Trimmed 57928 records to 40041 (keeping 150 days of data) [2025-09-14T19:03:31.705416] [DEBUG] [LOCAL ] MMM: Primary data saved (40041 records). [2025-09-14T19:03:31.705593] [INFO ] [MAIN ] MMM: Full history saved. [2025-09-14T19:03:31.705706] [INFO ] [MAIN ] Update Progress: 1379/2370 symbols completed. MMM took 32.8s. Estimated remaining: 1h 45m 10s. Rate: 9.4 symbols/min [2025-09-14T19:03:31.768223] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-09-14T19:03:31.879104] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:03:31.897703] [DEBUG] [LOCAL ] MNSO: Loaded 18541 existing records from primary storage. [2025-09-14T19:03:31.898092] [INFO ] [MAIN ] MNSO: Loaded 18541 existing records. [2025-09-14T19:03:32.140587] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:03:32.152567] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-14T19:03:32.152902] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-09-14T19:03:32.157388] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-09-14T19:03:32.158475] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-09-14T19:03:32.158573] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-09-14T19:03:32.555727] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:03:32.558800] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-09-14T19:03:32.742468] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-14T19:03:32.745001] [INFO ] [REMOTE ] MMU: Full fetch complete (18850 records). [2025-09-14T19:03:32.745099] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-09-14T19:03:33.113300] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-09-14T19:03:33.113426] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-09-14T19:03:33.113877] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-09-14T19:03:33.113947] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-09-14T19:03:33.114548] [DEBUG] [LOCAL ] MMU: Trimmed 18850 records to 12504 (keeping 150 days of data) [2025-09-14T19:03:33.189252] [DEBUG] [LOCAL ] MMU: Primary data saved (12504 records). [2025-09-14T19:03:33.189430] [INFO ] [MAIN ] MMU: Full history saved. [2025-09-14T19:03:33.189556] [INFO ] [MAIN ] Update Progress: 1380/2370 symbols completed. MMU took 18.1s. Estimated remaining: 1h 44m 60s. Rate: 9.4 symbols/min [2025-09-14T19:03:33.360515] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-09-14T19:03:33.363888] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:03:33.386374] [DEBUG] [LOCAL ] MNTN: Loaded 18549 existing records from primary storage. [2025-09-14T19:03:33.386566] [INFO ] [MAIN ] MNTN: Loaded 18549 existing records. [2025-09-14T19:03:33.561543] [WARN ] [MAIN ] MNTN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:03:33.561867] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-09-14T19:03:33.561932] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-14T19:03:33.562535] [DEBUG] [LOCAL ] MNTN: Deleted primary data file. [2025-09-14T19:03:33.562600] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-09-14T19:03:33.916495] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:03:34.158910] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-02. [2025-09-14T19:03:34.410844] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:03:34.411238] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-02 [2025-09-14T19:03:34.714121] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-14T19:03:34.958911] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-09-14T19:03:35.758856] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-09-14T19:03:36.117420] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-14T19:03:36.558844] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-09-14T19:03:36.595403] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-14T19:03:37.358791] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-03. [2025-09-14T19:03:37.619807] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:03:37.620154] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-03 [2025-09-14T19:03:37.713274] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-14T19:03:38.158840] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-09-14T19:03:38.958833] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-09-14T19:03:39.313362] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (6.75 seconds). [2025-09-14T19:03:39.366460] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-14T19:03:39.436742] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-14T19:03:39.438015] [INFO ] [REMOTE ] MMT: Full fetch complete (12378 records). [2025-09-14T19:03:39.438111] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-09-14T19:03:39.771554] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-09-14T19:03:39.811594] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-09-14T19:03:39.811706] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-09-14T19:03:39.812238] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-09-14T19:03:39.812374] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-09-14T19:03:39.812905] [DEBUG] [LOCAL ] MMT: Trimmed 12378 records to 7827 (keeping 150 days of data) [2025-09-14T19:03:39.858276] [DEBUG] [LOCAL ] MMT: Primary data saved (7827 records). [2025-09-14T19:03:39.858441] [INFO ] [MAIN ] MMT: Full history saved. [2025-09-14T19:03:39.858553] [INFO ] [MAIN ] Update Progress: 1381/2370 symbols completed. MMT took 33.1s. Estimated remaining: 1h 44m 54s. Rate: 9.4 symbols/min [2025-09-14T19:03:40.046478] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:03:40.070522] [DEBUG] [LOCAL ] MO: Loaded 24116 existing records from primary storage. [2025-09-14T19:03:40.070709] [INFO ] [MAIN ] MO: Loaded 24116 existing records. [2025-09-14T19:03:40.249985] [WARN ] [MAIN ] MO: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:03:40.250267] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-09-14T19:03:40.250338] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-14T19:03:40.251146] [DEBUG] [LOCAL ] MO: Deleted primary data file. [2025-09-14T19:03:40.251213] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-09-14T19:03:40.572236] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-04. [2025-09-14T19:03:40.610779] [INFO ] [REMOTE ] MO: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:03:40.871486] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-14T19:03:40.871880] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-04 [2025-09-14T19:03:41.028237] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T19:03:41.358848] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-09-14T19:03:42.158864] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-09-14T19:03:42.958875] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-09-14T19:03:43.645193] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-14T19:03:43.758769] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-09-14T19:03:43.863555] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T19:03:44.558929] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-05. [2025-09-14T19:03:45.358962] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-09-14T19:03:46.138404] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-14T19:03:46.158783] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-09-14T19:03:48.318703] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-14T19:03:48.330156] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-09-14T19:03:48.911893] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (5.95 seconds). [2025-09-14T19:03:48.921834] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-09-14T19:03:50.185594] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-14T19:03:50.191297] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-09-14T19:03:50.721316] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-14T19:03:50.738558] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-09-14T19:03:50.893149] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-05 (6.33 seconds). [2025-09-14T19:03:50.896181] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-06. [2025-09-14T19:03:51.156119] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-14T19:03:51.158746] [INFO ] [REMOTE ] MNR: Full fetch complete (28196 records). [2025-09-14T19:03:51.158852] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-09-14T19:03:51.537811] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-09-14T19:03:51.537917] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-09-14T19:03:51.538578] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-09-14T19:03:51.538632] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-09-14T19:03:51.539344] [DEBUG] [LOCAL ] MNR: Trimmed 28196 records to 18817 (keeping 150 days of data) [2025-09-14T19:03:51.655430] [DEBUG] [LOCAL ] MNR: Primary data saved (18817 records). [2025-09-14T19:03:51.655623] [INFO ] [MAIN ] MNR: Full history saved. [2025-09-14T19:03:51.655753] [INFO ] [MAIN ] Update Progress: 1382/2370 symbols completed. MNR took 23.5s. Estimated remaining: 1h 44m 51s. Rate: 9.4 symbols/min [2025-09-14T19:03:51.825062] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:03:51.845072] [DEBUG] [LOCAL ] MOD: Loaded 19552 existing records from primary storage. [2025-09-14T19:03:51.845259] [INFO ] [MAIN ] MOD: Loaded 19552 existing records. [2025-09-14T19:03:52.026891] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:03:52.027170] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-09-14T19:03:52.027235] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-09-14T19:03:52.027953] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-09-14T19:03:52.028019] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-09-14T19:03:52.377377] [INFO ] [REMOTE ] MOD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:03:52.377803] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-09-14T19:03:52.444883] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T19:03:52.452928] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-07. [2025-09-14T19:03:52.878799] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-14T19:03:52.890006] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-09-14T19:03:54.458792] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-14T19:03:54.473887] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-09-14T19:03:55.421450] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-14T19:03:55.433622] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-09-14T19:03:55.944917] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T19:03:55.956258] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-09-14T19:03:57.128597] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (11.77 seconds). [2025-09-14T19:03:57.139875] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-09-14T19:03:57.854271] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-14T19:03:57.866102] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-09-14T19:03:58.763710] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-14T19:03:58.774193] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-09-14T19:04:00.311319] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-14T19:04:00.320422] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-09-14T19:04:02.095250] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T19:04:02.105261] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-09-14T19:04:02.956414] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-07 (10.50 seconds). [2025-09-14T19:04:02.966134] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-08. [2025-09-14T19:04:04.600192] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-14T19:04:04.614837] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-09. [2025-09-14T19:04:06.587816] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-14T19:04:06.592204] [INFO ] [REMOTE ] MNTN: Full fetch complete (22640 records). [2025-09-14T19:04:06.592309] [DEBUG] [VALIDATOR ] MNTN: Validating primary data. [2025-09-14T19:04:06.772086] [WARN ] [VALIDATOR ] MNTN: Validation failed - insufficient historical data. Have 78 unique days, need 150 days [2025-09-14T19:04:06.772470] [FATAL] [MAIN ] MNTN: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:04:06.772526] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:04:06.772575] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-14T19:04:06.772659] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-14T19:04:06.772710] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-09-14T19:04:06.772806] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-09-14T19:04:06.772892] [INFO ] [MAIN ] Update Progress: 1383/2370 symbols completed. MNTN took 33.6s. Estimated remaining: 1h 44m 51s. Rate: 9.4 symbols/min [2025-09-14T19:04:06.941820] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:04:06.964187] [DEBUG] [LOCAL ] MODG: Loaded 23213 existing records from primary storage. [2025-09-14T19:04:06.964367] [INFO ] [MAIN ] MODG: Loaded 23213 existing records. [2025-09-14T19:04:07.154332] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:04:07.154631] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-09-14T19:04:07.154711] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-09-14T19:04:07.155329] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-09-14T19:04:07.155414] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-09-14T19:04:07.508101] [INFO ] [REMOTE ] MODG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:04:07.508456] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-09-14T19:04:09.171266] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-14T19:04:09.181448] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-09-14T19:04:10.894261] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (15.46 seconds). [2025-09-14T19:04:10.906219] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-09-14T19:04:11.111134] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-14T19:04:11.122718] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-09-14T19:04:11.644873] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T19:04:11.650546] [INFO ] [REMOTE ] MO: Full fetch complete (58433 records). [2025-09-14T19:04:11.650748] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-09-14T19:04:12.051819] [DEBUG] [VALIDATOR ] MO: All expected trading days are present. [2025-09-14T19:04:12.052002] [DEBUG] [VALIDATOR ] MO: Primary data validation passed. [2025-09-14T19:04:12.053699] [INFO ] [MAIN ] MO: Fetched primary data is valid. [2025-09-14T19:04:12.053790] [DEBUG] [LOCAL ] MO: Saving primary data. [2025-09-14T19:04:12.055712] [DEBUG] [LOCAL ] MO: Trimmed 58433 records to 40494 (keeping 150 days of data) [2025-09-14T19:04:12.332707] [DEBUG] [LOCAL ] MO: Primary data saved (40494 records). [2025-09-14T19:04:12.332917] [INFO ] [MAIN ] MO: Full history saved. [2025-09-14T19:04:12.333052] [INFO ] [MAIN ] Update Progress: 1384/2370 symbols completed. MO took 32.5s. Estimated remaining: 1h 44m 44s. Rate: 9.4 symbols/min [2025-09-14T19:04:12.529912] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:04:12.553447] [DEBUG] [LOCAL ] MOH: Loaded 21101 existing records from primary storage. [2025-09-14T19:04:12.553710] [INFO ] [MAIN ] MOH: Loaded 21101 existing records. [2025-09-14T19:04:12.738002] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:04:12.738327] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-09-14T19:04:12.738392] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-09-14T19:04:12.739061] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-09-14T19:04:12.739129] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-09-14T19:04:13.107820] [INFO ] [REMOTE ] MOH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:04:13.108392] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-09-14T19:04:13.149355] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-14T19:04:13.161561] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-09-14T19:04:14.965457] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-14T19:04:14.982110] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-09-14T19:04:16.543069] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (18.68 seconds). [2025-09-14T19:04:16.553502] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-09-14T19:04:16.922749] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-14T19:04:16.934676] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-09-14T19:04:18.014667] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-14T19:04:18.024230] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-09-14T19:04:18.510303] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T19:04:18.522499] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-09-14T19:04:19.781437] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-14T19:04:19.792330] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-09-14T19:04:20.240827] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T19:04:20.252509] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-09-14T19:04:20.961672] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-14T19:04:20.967800] [INFO ] [REMOTE ] MODG: Full fetch complete (56152 records). [2025-09-14T19:04:20.967970] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-09-14T19:04:21.377120] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-09-14T19:04:21.377306] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-09-14T19:04:21.378402] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-09-14T19:04:21.378488] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-09-14T19:04:21.389522] [DEBUG] [LOCAL ] MODG: Trimmed 56152 records to 38900 (keeping 150 days of data) [2025-09-14T19:04:21.408299] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-14T19:04:21.504246] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-09-14T19:04:21.541071] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (19.44 seconds). [2025-09-14T19:04:21.556673] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-09-14T19:04:21.714622] [DEBUG] [LOCAL ] MODG: Primary data saved (38900 records). [2025-09-14T19:04:21.714841] [INFO ] [MAIN ] MODG: Full history saved. [2025-09-14T19:04:21.714971] [INFO ] [MAIN ] Update Progress: 1385/2370 symbols completed. MODG took 14.9s. Estimated remaining: 1h 44m 40s. Rate: 9.4 symbols/min [2025-09-14T19:04:21.896095] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:04:21.921808] [DEBUG] [LOCAL ] MOS: Loaded 23937 existing records from primary storage. [2025-09-14T19:04:21.922014] [INFO ] [MAIN ] MOS: Loaded 23937 existing records. [2025-09-14T19:04:22.104685] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:04:22.104987] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-09-14T19:04:22.105059] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-09-14T19:04:22.105829] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-09-14T19:04:22.105905] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-09-14T19:04:22.478762] [INFO ] [REMOTE ] MOS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:04:22.479149] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-09-14T19:04:24.340616] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-14T19:04:24.352857] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-09-14T19:04:25.780175] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (12.67 seconds). [2025-09-14T19:04:25.789022] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-09-14T19:04:26.213424] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-14T19:04:26.230036] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-09-14T19:04:27.285884] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-14T19:04:27.295002] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-09-14T19:04:27.311540] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (5.81 seconds). [2025-09-14T19:04:27.318566] [INFO ] [REMOTE ] MOD: Full fetch complete (50411 records). [2025-09-14T19:04:27.318765] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-09-14T19:04:27.744994] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-09-14T19:04:27.745134] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-09-14T19:04:27.746439] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-09-14T19:04:27.746520] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-09-14T19:04:27.748468] [DEBUG] [LOCAL ] MOD: Trimmed 50411 records to 33695 (keeping 150 days of data) [2025-09-14T19:04:27.984058] [DEBUG] [LOCAL ] MOD: Primary data saved (33695 records). [2025-09-14T19:04:27.984327] [INFO ] [MAIN ] MOD: Full history saved. [2025-09-14T19:04:27.984506] [INFO ] [MAIN ] Update Progress: 1386/2370 symbols completed. MOD took 36.3s. Estimated remaining: 1h 44m 33s. Rate: 9.4 symbols/min [2025-09-14T19:04:28.182467] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:04:28.195219] [DEBUG] [LOCAL ] MOV: Loaded 8311 existing records from primary storage. [2025-09-14T19:04:28.195512] [INFO ] [MAIN ] MOV: Loaded 8311 existing records. [2025-09-14T19:04:28.397244] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:04:28.418081] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-14T19:04:28.418319] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-09-14T19:04:28.429498] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-09-14T19:04:28.430557] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-09-14T19:04:28.430615] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-09-14T19:04:28.431833] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-09-14T19:04:28.808204] [INFO ] [REMOTE ] MOV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:04:28.808709] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-09-14T19:04:28.980637] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (7.42 seconds). [2025-09-14T19:04:28.985504] [INFO ] [REMOTE ] MNSO: Full fetch complete (48460 records). [2025-09-14T19:04:28.985727] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-09-14T19:04:29.339272] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-14T19:04:29.434316] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-09-14T19:04:29.434530] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-09-14T19:04:29.435482] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-09-14T19:04:29.436703] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-09-14T19:04:29.436940] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-09-14T19:04:29.438002] [DEBUG] [LOCAL ] MNSO: Trimmed 48460 records to 32461 (keeping 150 days of data) [2025-09-14T19:04:29.585978] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-14T19:04:29.629422] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-09-14T19:04:29.680702] [DEBUG] [LOCAL ] MNSO: Primary data saved (32461 records). [2025-09-14T19:04:29.680910] [INFO ] [MAIN ] MNSO: Full history saved. [2025-09-14T19:04:29.681040] [INFO ] [MAIN ] Update Progress: 1387/2370 symbols completed. MNSO took 58.0s. Estimated remaining: 1h 44m 24s. Rate: 9.4 symbols/min [2025-09-14T19:04:29.849529] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:04:29.873560] [DEBUG] [LOCAL ] MP: Loaded 24126 existing records from primary storage. [2025-09-14T19:04:29.873757] [INFO ] [MAIN ] MP: Loaded 24126 existing records. [2025-09-14T19:04:30.088816] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:04:30.089107] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-09-14T19:04:30.089171] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-09-14T19:04:30.089946] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-09-14T19:04:30.090011] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-09-14T19:04:30.454576] [INFO ] [REMOTE ] MP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:04:30.455120] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-09-14T19:04:30.506561] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-14T19:04:30.521289] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-09-14T19:04:30.565971] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-14T19:04:30.571853] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-09-14T19:04:31.006457] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-14T19:04:31.014625] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-09-14T19:04:31.647809] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-14T19:04:31.654827] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-09-14T19:04:32.409277] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-14T19:04:32.420603] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-09-14T19:04:32.514997] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-14T19:04:32.525724] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-09-14T19:04:32.577964] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-14T19:04:32.585389] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-09-14T19:04:32.933809] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-14T19:04:32.939402] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-09-14T19:04:34.026028] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-14T19:04:34.031542] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-09-14T19:04:34.496873] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-14T19:04:34.508465] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-09-14T19:04:34.582513] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-14T19:04:34.594335] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-09-14T19:04:35.127606] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-14T19:04:35.132069] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-09-14T19:04:36.308758] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-14T19:04:36.313316] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-09-14T19:04:36.829524] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-14T19:04:36.840911] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-09-14T19:04:36.862860] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T19:04:36.865702] [INFO ] [REMOTE ] MOV: Full fetch complete (24100 records). [2025-09-14T19:04:36.865813] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-09-14T19:04:37.246254] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-09-14T19:04:37.246384] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-09-14T19:04:37.247124] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-09-14T19:04:37.247188] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-09-14T19:04:37.248003] [DEBUG] [LOCAL ] MOV: Trimmed 24100 records to 15954 (keeping 150 days of data) [2025-09-14T19:04:37.352256] [DEBUG] [LOCAL ] MOV: Primary data saved (15954 records). [2025-09-14T19:04:37.352449] [INFO ] [MAIN ] MOV: Full history saved. [2025-09-14T19:04:37.352561] [INFO ] [MAIN ] Update Progress: 1388/2370 symbols completed. MOV took 9.4s. Estimated remaining: 1h 44m 18s. Rate: 9.4 symbols/min [2025-09-14T19:04:37.522727] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:04:37.526835] [DEBUG] [LOCAL ] MPA: Loaded 2071 existing records from primary storage. [2025-09-14T19:04:37.526943] [INFO ] [MAIN ] MPA: Loaded 2071 existing records. [2025-09-14T19:04:37.700052] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:04:37.700286] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-09-14T19:04:37.700350] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-09-14T19:04:37.700605] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-09-14T19:04:37.700690] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-09-14T19:04:38.086911] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (5.67 seconds). [2025-09-14T19:04:38.085024] [INFO ] [REMOTE ] MPA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:04:38.098412] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-09-14T19:04:38.100243] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-09-14T19:04:39.159742] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-14T19:04:39.171365] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-09-14T19:04:41.905314] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (7.40 seconds). [2025-09-14T19:04:41.918632] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-09-14T19:04:42.204513] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (4.11 seconds). [2025-09-14T19:04:42.206370] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-09-14T19:04:42.583175] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-14T19:04:42.588396] [INFO ] [REMOTE ] MOH: Full fetch complete (45376 records). [2025-09-14T19:04:42.588537] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-09-14T19:04:42.697836] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-14T19:04:42.720036] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-09-14T19:04:42.969002] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-09-14T19:04:42.969133] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-09-14T19:04:42.969981] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-09-14T19:04:42.970045] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-09-14T19:04:42.971234] [DEBUG] [LOCAL ] MOH: Trimmed 45376 records to 32109 (keeping 150 days of data) [2025-09-14T19:04:43.174706] [DEBUG] [LOCAL ] MOH: Primary data saved (32109 records). [2025-09-14T19:04:43.174881] [INFO ] [MAIN ] MOH: Full history saved. [2025-09-14T19:04:43.174981] [INFO ] [MAIN ] Update Progress: 1389/2370 symbols completed. MOH took 30.8s. Estimated remaining: 1h 44m 11s. Rate: 9.4 symbols/min [2025-09-14T19:04:43.362341] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:04:43.387310] [DEBUG] [LOCAL ] MPC: Loaded 23106 existing records from primary storage. [2025-09-14T19:04:43.387496] [INFO ] [MAIN ] MPC: Loaded 23106 existing records. [2025-09-14T19:04:43.567366] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:04:43.567667] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-09-14T19:04:43.567726] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-09-14T19:04:43.568634] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-09-14T19:04:43.568730] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-09-14T19:04:43.701167] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-14T19:04:43.755829] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-09-14T19:04:43.938833] [INFO ] [REMOTE ] MPC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:04:43.939203] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-09-14T19:04:44.621354] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-14T19:04:44.623894] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-09-14T19:04:45.282294] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-14T19:04:45.284351] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-09-14T19:04:45.755002] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-14T19:04:45.765334] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-09-14T19:04:46.030032] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-14T19:04:46.032108] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-09-14T19:04:46.410381] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (8.31 seconds). [2025-09-14T19:04:46.423122] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-09-14T19:04:46.649421] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-14T19:04:46.651082] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-09-14T19:04:46.925735] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-14T19:04:46.931358] [INFO ] [REMOTE ] MOS: Full fetch complete (58191 records). [2025-09-14T19:04:46.931514] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-09-14T19:04:47.292742] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-14T19:04:47.311018] [INFO ] [REMOTE ] MPA: Full fetch complete (5702 records). [2025-09-14T19:04:47.329502] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-09-14T19:04:47.329664] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-09-14T19:04:47.330281] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-09-14T19:04:47.363168] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-09-14T19:04:47.405984] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-09-14T19:04:47.517747] [DEBUG] [LOCAL ] MOS: Trimmed 58191 records to 40283 (keeping 150 days of data) [2025-09-14T19:04:47.799734] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-09-14T19:04:47.800698] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-09-14T19:04:47.801975] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-09-14T19:04:47.803163] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-09-14T19:04:47.806506] [DEBUG] [LOCAL ] MPA: Trimmed 5702 records to 4029 (keeping 150 days of data) [2025-09-14T19:04:47.873097] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-14T19:04:47.885735] [DEBUG] [LOCAL ] MPA: Primary data saved (4029 records). [2025-09-14T19:04:47.886931] [INFO ] [MAIN ] MPA: Full history saved. [2025-09-14T19:04:47.888150] [INFO ] [MAIN ] Update Progress: 1390/2370 symbols completed. MPA took 10.5s. Estimated remaining: 1h 44m 4s. Rate: 9.4 symbols/min [2025-09-14T19:04:47.889680] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-09-14T19:04:48.073739] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:04:48.192812] [DEBUG] [LOCAL ] MPLX: Loaded 22476 existing records from primary storage. [2025-09-14T19:04:48.193511] [INFO ] [MAIN ] MPLX: Loaded 22476 existing records. [2025-09-14T19:04:48.383194] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:04:48.383674] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-09-14T19:04:48.384482] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-09-14T19:04:48.386023] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-09-14T19:04:48.386413] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-09-14T19:04:48.824183] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:04:48.825478] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-09-14T19:04:48.834188] [DEBUG] [LOCAL ] MOS: Primary data saved (40283 records). [2025-09-14T19:04:48.834382] [INFO ] [MAIN ] MOS: Full history saved. [2025-09-14T19:04:48.834504] [INFO ] [MAIN ] Update Progress: 1391/2370 symbols completed. MOS took 27.1s. Estimated remaining: 1h 43m 54s. Rate: 9.4 symbols/min [2025-09-14T19:04:49.007304] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:04:49.011082] [DEBUG] [LOCAL ] MPV: Loaded 1770 existing records from primary storage. [2025-09-14T19:04:49.011187] [INFO ] [MAIN ] MPV: Loaded 1770 existing records. [2025-09-14T19:04:49.188569] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:04:49.188858] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-09-14T19:04:49.188916] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-09-14T19:04:49.189174] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-09-14T19:04:49.189232] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-09-14T19:04:49.545666] [INFO ] [REMOTE ] MPV: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:04:49.546027] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-09-14T19:04:50.012139] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-14T19:04:50.025276] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-09-14T19:04:50.049348] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-14T19:04:50.051484] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-09-14T19:04:50.942059] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T19:04:50.944532] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-09-14T19:04:51.669783] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-14T19:04:51.671815] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-09-14T19:04:52.256433] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (13.09 seconds). [2025-09-14T19:04:52.269563] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-09-14T19:04:52.329967] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-14T19:04:52.331909] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-09-14T19:04:53.026779] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-14T19:04:53.028763] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-09-14T19:04:53.740609] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-14T19:04:53.742366] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-09-14T19:04:55.151549] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-09-14T19:04:55.163827] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-09-14T19:04:57.613057] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-14T19:04:57.626532] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-09-14T19:04:58.387751] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T19:04:58.393343] [INFO ] [REMOTE ] MP: Full fetch complete (58246 records). [2025-09-14T19:04:58.393488] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-09-14T19:04:58.775745] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-09-14T19:04:58.775869] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-09-14T19:04:58.776831] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-09-14T19:04:58.776911] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-09-14T19:04:58.778221] [DEBUG] [LOCAL ] MP: Trimmed 58246 records to 40484 (keeping 150 days of data) [2025-09-14T19:04:59.034367] [DEBUG] [LOCAL ] MP: Primary data saved (40484 records). [2025-09-14T19:04:59.034519] [INFO ] [MAIN ] MP: Full history saved. [2025-09-14T19:04:59.034617] [INFO ] [MAIN ] Update Progress: 1392/2370 symbols completed. MP took 29.4s. Estimated remaining: 1h 43m 50s. Rate: 9.4 symbols/min [2025-09-14T19:04:59.205493] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:04:59.227466] [DEBUG] [LOCAL ] MPW: Loaded 23996 existing records from primary storage. [2025-09-14T19:04:59.227628] [INFO ] [MAIN ] MPW: Loaded 23996 existing records. [2025-09-14T19:04:59.403182] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:04:59.403460] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-09-14T19:04:59.403520] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-09-14T19:04:59.404257] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-09-14T19:04:59.404319] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-09-14T19:04:59.754579] [INFO ] [REMOTE ] MPW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:04:59.754956] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-09-14T19:05:00.092538] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (11.27 seconds). [2025-09-14T19:05:00.103107] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-09-14T19:05:01.589000] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-14T19:05:01.599525] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-09-14T19:05:01.852429] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-14T19:05:01.869148] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-09-14T19:05:03.879187] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-14T19:05:03.891468] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-09-14T19:05:04.000929] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-14T19:05:04.012858] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-09-14T19:05:05.480372] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (15.46 seconds). [2025-09-14T19:05:05.492080] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-09-14T19:05:05.806541] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-14T19:05:05.821924] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-09-14T19:05:06.213915] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (12.47 seconds). [2025-09-14T19:05:06.215914] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-09-14T19:05:06.504806] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-14T19:05:06.516430] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-09-14T19:05:06.799242] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-14T19:05:06.800472] [INFO ] [REMOTE ] MPV: Full fetch complete (5856 records). [2025-09-14T19:05:06.800565] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-09-14T19:05:07.157405] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-09-14T19:05:07.157516] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-09-14T19:05:07.157747] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-09-14T19:05:07.157807] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-09-14T19:05:07.158267] [DEBUG] [LOCAL ] MPV: Trimmed 5856 records to 3390 (keeping 150 days of data) [2025-09-14T19:05:07.179950] [DEBUG] [LOCAL ] MPV: Primary data saved (3390 records). [2025-09-14T19:05:07.180061] [INFO ] [MAIN ] MPV: Full history saved. [2025-09-14T19:05:07.180163] [INFO ] [MAIN ] Update Progress: 1393/2370 symbols completed. MPV took 18.3s. Estimated remaining: 1h 43m 45s. Rate: 9.4 symbols/min [2025-09-14T19:05:07.349599] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:05:07.353076] [DEBUG] [LOCAL ] MPX: Loaded 1680 existing records from primary storage. [2025-09-14T19:05:07.353181] [INFO ] [MAIN ] MPX: Loaded 1680 existing records. [2025-09-14T19:05:07.565337] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:05:07.566289] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-09-14T19:05:07.566381] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-09-14T19:05:07.566813] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-09-14T19:05:07.566888] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-09-14T19:05:07.941216] [INFO ] [REMOTE ] MPX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:05:07.941787] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-09-14T19:05:08.274856] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-14T19:05:08.286298] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-09-14T19:05:13.273800] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (7.78 seconds). [2025-09-14T19:05:13.284569] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-09-14T19:05:15.322991] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-14T19:05:15.334588] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-09-14T19:05:22.222256] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (16.40 seconds). [2025-09-14T19:05:22.233761] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-09-14T19:05:23.260715] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (15.32 seconds). [2025-09-14T19:05:23.262802] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-09-14T19:05:24.010401] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-14T19:05:24.012425] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-09-14T19:05:24.206286] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-14T19:05:24.217778] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-09-14T19:05:24.751241] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-14T19:05:24.753253] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-09-14T19:05:25.400765] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-14T19:05:25.402473] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-09-14T19:05:26.032033] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-14T19:05:26.033685] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-09-14T19:05:26.203549] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-14T19:05:26.215341] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-09-14T19:05:26.703072] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-14T19:05:26.705264] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-09-14T19:05:27.289813] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-14T19:05:27.291407] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-09-14T19:05:27.495020] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (19.21 seconds). [2025-09-14T19:05:27.505779] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-09-14T19:05:27.850819] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T19:05:27.852034] [INFO ] [REMOTE ] MPX: Full fetch complete (4902 records). [2025-09-14T19:05:27.852132] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-09-14T19:05:28.218140] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-09-14T19:05:28.218249] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-09-14T19:05:28.218423] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-09-14T19:05:28.218474] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-09-14T19:05:28.218899] [DEBUG] [LOCAL ] MPX: Trimmed 4902 records to 2890 (keeping 150 days of data) [2025-09-14T19:05:28.236889] [DEBUG] [LOCAL ] MPX: Primary data saved (2890 records). [2025-09-14T19:05:28.236963] [INFO ] [MAIN ] MPX: Full history saved. [2025-09-14T19:05:28.237049] [INFO ] [MAIN ] Update Progress: 1394/2370 symbols completed. MPX took 21.1s. Estimated remaining: 1h 43m 49s. Rate: 9.4 symbols/min [2025-09-14T19:05:28.405277] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:05:28.410669] [DEBUG] [LOCAL ] MQT: Loaded 3345 existing records from primary storage. [2025-09-14T19:05:28.410777] [INFO ] [MAIN ] MQT: Loaded 3345 existing records. [2025-09-14T19:05:28.585340] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:05:28.585608] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-09-14T19:05:28.585685] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-09-14T19:05:28.585983] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-09-14T19:05:28.586041] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-09-14T19:05:28.938000] [INFO ] [REMOTE ] MQT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:05:28.938664] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-09-14T19:05:29.229161] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-14T19:05:29.240222] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-09-14T19:05:29.756873] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-14T19:05:29.759722] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-09-14T19:05:30.580315] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T19:05:30.583072] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-09-14T19:05:30.742265] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-14T19:05:30.747614] [INFO ] [REMOTE ] MPLX: Full fetch complete (55399 records). [2025-09-14T19:05:30.747861] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-09-14T19:05:31.152744] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-09-14T19:05:31.152907] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-09-14T19:05:31.154326] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-09-14T19:05:31.154407] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-09-14T19:05:31.156318] [DEBUG] [LOCAL ] MPLX: Trimmed 55399 records to 37896 (keeping 150 days of data) [2025-09-14T19:05:31.421808] [DEBUG] [LOCAL ] MPLX: Primary data saved (37896 records). [2025-09-14T19:05:31.422031] [INFO ] [MAIN ] MPLX: Full history saved. [2025-09-14T19:05:31.422161] [INFO ] [MAIN ] Update Progress: 1395/2370 symbols completed. MPLX took 43.5s. Estimated remaining: 1h 43m 40s. Rate: 9.4 symbols/min [2025-09-14T19:05:31.625591] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-14T19:05:31.624851] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:05:31.630091] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-09-14T19:05:31.640059] [DEBUG] [LOCAL ] MQY: Loaded 7188 existing records from primary storage. [2025-09-14T19:05:31.640211] [INFO ] [MAIN ] MQY: Loaded 7188 existing records. [2025-09-14T19:05:31.818413] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:05:31.818744] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-09-14T19:05:31.818810] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-09-14T19:05:31.819210] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-09-14T19:05:31.819271] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-09-14T19:05:32.159763] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (16.83 seconds). [2025-09-14T19:05:32.220925] [INFO ] [REMOTE ] MQY: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:05:32.221676] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-09-14T19:05:32.222740] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-09-14T19:05:32.301831] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-14T19:05:32.303824] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-09-14T19:05:32.891608] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T19:05:32.897121] [INFO ] [REMOTE ] MPC: Full fetch complete (56795 records). [2025-09-14T19:05:32.897292] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-09-14T19:05:33.178797] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-14T19:05:33.219572] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-09-14T19:05:33.294864] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-09-14T19:05:33.295023] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-09-14T19:05:33.296101] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-09-14T19:05:33.296218] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-09-14T19:05:33.308826] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-14T19:05:33.312910] [DEBUG] [LOCAL ] MPC: Trimmed 56795 records to 39139 (keeping 150 days of data) [2025-09-14T19:05:33.313446] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-09-14T19:05:33.599139] [DEBUG] [LOCAL ] MPC: Primary data saved (39139 records). [2025-09-14T19:05:33.599385] [INFO ] [MAIN ] MPC: Full history saved. [2025-09-14T19:05:33.599526] [INFO ] [MAIN ] Update Progress: 1396/2370 symbols completed. MPC took 50.4s. Estimated remaining: 1h 43m 31s. Rate: 9.4 symbols/min [2025-09-14T19:05:33.787567] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:05:33.804671] [DEBUG] [LOCAL ] MRC: Loaded 16300 existing records from primary storage. [2025-09-14T19:05:33.804843] [INFO ] [MAIN ] MRC: Loaded 16300 existing records. [2025-09-14T19:05:33.996744] [WARN ] [MAIN ] MRC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:05:33.997008] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-09-14T19:05:33.997066] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-09-14T19:05:33.997602] [DEBUG] [LOCAL ] MRC: Deleted primary data file. [2025-09-14T19:05:33.997687] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-09-14T19:05:34.391083] [INFO ] [REMOTE ] MRC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:05:34.391486] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-09-14T19:05:34.454836] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-14T19:05:34.459378] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-09-14T19:05:35.195898] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (8.98 seconds). [2025-09-14T19:05:35.207497] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-09-14T19:05:35.508051] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-14T19:05:35.510923] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-09-14T19:05:35.524729] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-14T19:05:35.529914] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-09-14T19:05:35.880741] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-14T19:05:35.889542] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-09-14T19:05:35.904780] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-14T19:05:35.910741] [INFO ] [REMOTE ] MPW: Full fetch complete (58153 records). [2025-09-14T19:05:35.910941] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-09-14T19:05:36.034601] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-14T19:05:36.076403] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-09-14T19:05:36.315377] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-09-14T19:05:36.315577] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-09-14T19:05:36.316490] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-09-14T19:05:36.316658] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-09-14T19:05:36.326329] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-14T19:05:36.330183] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-09-14T19:05:36.331186] [DEBUG] [LOCAL ] MPW: Trimmed 58153 records to 40288 (keeping 150 days of data) [2025-09-14T19:05:36.609922] [DEBUG] [LOCAL ] MPW: Primary data saved (40288 records). [2025-09-14T19:05:36.610086] [INFO ] [MAIN ] MPW: Full history saved. [2025-09-14T19:05:36.610186] [INFO ] [MAIN ] Update Progress: 1397/2370 symbols completed. MPW took 37.6s. Estimated remaining: 1h 43m 22s. Rate: 9.4 symbols/min [2025-09-14T19:05:36.676246] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-14T19:05:36.678069] [INFO ] [REMOTE ] MQT: Full fetch complete (9466 records). [2025-09-14T19:05:36.678200] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-09-14T19:05:37.050233] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-09-14T19:05:37.050345] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-09-14T19:05:37.050593] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-09-14T19:05:37.050664] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-09-14T19:05:37.051123] [DEBUG] [LOCAL ] MQT: Trimmed 9466 records to 5655 (keeping 150 days of data) [2025-09-14T19:05:37.086470] [DEBUG] [LOCAL ] MQT: Primary data saved (5655 records). [2025-09-14T19:05:37.086678] [INFO ] [MAIN ] MQT: Full history saved. [2025-09-14T19:05:37.086838] [INFO ] [MAIN ] Update Progress: 1398/2370 symbols completed. MQT took 8.8s. Estimated remaining: 1h 43m 12s. Rate: 9.4 symbols/min [2025-09-14T19:05:37.217141] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T19:05:37.225829] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-09-14T19:05:37.375164] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-14T19:05:37.379065] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-09-14T19:05:38.586477] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-14T19:05:38.590524] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-09-14T19:05:38.919315] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-14T19:05:38.928085] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-09-14T19:05:39.262693] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-14T19:05:39.267822] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-09-14T19:05:40.186842] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-14T19:05:40.189578] [INFO ] [REMOTE ] MQY: Full fetch complete (18419 records). [2025-09-14T19:05:40.189721] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-09-14T19:05:40.560964] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-09-14T19:05:40.561097] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-09-14T19:05:40.561576] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-09-14T19:05:40.561657] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-09-14T19:05:40.562498] [DEBUG] [LOCAL ] MQY: Trimmed 18419 records to 11827 (keeping 150 days of data) [2025-09-14T19:05:40.637912] [DEBUG] [LOCAL ] MQY: Primary data saved (11827 records). [2025-09-14T19:05:40.638104] [INFO ] [MAIN ] MQY: Full history saved. [2025-09-14T19:05:40.638241] [INFO ] [MAIN ] Update Progress: 1399/2370 symbols completed. MQY took 9.2s. Estimated remaining: 1h 43m 3s. Rate: 9.4 symbols/min [2025-09-14T19:05:41.530047] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-09-14T19:05:41.537934] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-09-14T19:05:43.007397] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-14T19:05:43.014959] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-09-14T19:05:44.631576] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-14T19:05:44.641572] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-09-14T19:05:46.232130] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-14T19:05:46.239968] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-09-14T19:05:47.318264] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-14T19:05:47.321711] [INFO ] [REMOTE ] MRC: Full fetch complete (41119 records). [2025-09-14T19:05:47.321827] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-09-14T19:05:47.694172] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-09-14T19:05:47.694319] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-09-14T19:05:47.695083] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-09-14T19:05:47.695149] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-09-14T19:05:47.696181] [DEBUG] [LOCAL ] MRC: Trimmed 41119 records to 27384 (keeping 150 days of data) [2025-09-14T19:05:47.874269] [DEBUG] [LOCAL ] MRC: Primary data saved (27384 records). [2025-09-14T19:05:47.874456] [INFO ] [MAIN ] MRC: Full history saved. [2025-09-14T19:05:47.874590] [INFO ] [MAIN ] Update Progress: 1400/2370 symbols completed. MRC took 14.3s. Estimated remaining: 1h 42m 58s. Rate: 9.4 symbols/min [2025-09-14T19:05:48.516802] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:05:48.579885] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:05:48.627794] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:05:48.660748] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:05:48.673687] [DEBUG] [LOCAL ] MSA: Loaded 8101 existing records from primary storage. [2025-09-14T19:05:48.684406] [INFO ] [MAIN ] MSA: Loaded 8101 existing records. [2025-09-14T19:05:48.802467] [DEBUG] [LOCAL ] MRK: Loaded 24152 existing records from primary storage. [2025-09-14T19:05:48.812986] [DEBUG] [LOCAL ] MRP: Loaded 21045 existing records from primary storage. [2025-09-14T19:05:48.831367] [INFO ] [MAIN ] MRP: Loaded 21045 existing records. [2025-09-14T19:05:48.831036] [INFO ] [MAIN ] MRK: Loaded 24152 existing records. [2025-09-14T19:05:48.858086] [DEBUG] [LOCAL ] MS: Loaded 24065 existing records from primary storage. [2025-09-14T19:05:48.904818] [INFO ] [MAIN ] MS: Loaded 24065 existing records. [2025-09-14T19:05:49.022248] [WARN ] [MAIN ] MSA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:05:49.177149] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-09-14T19:05:49.241699] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-09-14T19:05:49.399708] [DEBUG] [LOCAL ] MSA: Deleted primary data file. [2025-09-14T19:05:49.408132] [WARN ] [MAIN ] MRK: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:05:49.432566] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-09-14T19:05:49.458905] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-09-14T19:05:49.452501] [WARN ] [MAIN ] MRP: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:05:49.509981] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-09-14T19:05:49.510066] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-09-14T19:05:49.587515] [DEBUG] [LOCAL ] MRK: Deleted primary data file. [2025-09-14T19:05:49.582260] [WARN ] [MAIN ] MS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:05:49.606749] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-14T19:05:49.612221] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-09-14T19:05:49.624570] [DEBUG] [LOCAL ] MRP: Deleted primary data file. [2025-09-14T19:05:49.619148] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-09-14T19:05:49.645420] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-09-14T19:05:49.645487] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-09-14T19:05:49.743551] [DEBUG] [LOCAL ] MS: Deleted primary data file. [2025-09-14T19:05:49.837458] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-09-14T19:05:50.782658] [INFO ] [REMOTE ] MSA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:05:50.884771] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-09-14T19:05:50.904401] [INFO ] [REMOTE ] MRK: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:05:50.979145] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-09-14T19:05:51.014114] [INFO ] [REMOTE ] MRP: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:05:51.039464] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-02. [2025-09-14T19:05:51.044145] [INFO ] [REMOTE ] MS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:05:51.045272] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-09-14T19:05:52.002120] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-14T19:05:52.012590] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-09-14T19:05:52.367496] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-14T19:05:52.371165] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-09-14T19:05:52.705132] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-14T19:05:52.713354] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-03. [2025-09-14T19:05:52.823917] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T19:05:52.835142] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-09-14T19:05:53.734816] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.76 seconds). [2025-09-14T19:05:53.745296] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-09-14T19:05:53.810528] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-14T19:05:53.822048] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-09-14T19:05:53.947461] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-14T19:05:53.951397] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-09-14T19:05:54.650403] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-14T19:05:54.661140] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-04. [2025-09-14T19:05:54.790247] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-14T19:05:54.802082] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-09-14T19:05:55.277778] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-14T19:05:55.283431] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-09-14T19:05:55.394363] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-14T19:05:55.405873] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-09-14T19:05:55.804956] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-14T19:05:55.816304] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-09-14T19:05:55.864744] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-14T19:05:55.875170] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-05. [2025-09-14T19:05:56.071374] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-14T19:05:56.075951] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-09-14T19:05:56.625251] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-14T19:05:56.638634] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-09-14T19:05:56.912422] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-14T19:05:56.916939] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-09-14T19:05:57.146874] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-14T19:05:57.157722] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-06. [2025-09-14T19:05:57.586793] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-14T19:05:57.598978] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-09-14T19:05:57.622468] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-14T19:05:57.626858] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-09-14T19:05:58.157677] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-14T19:05:58.169228] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-09-14T19:05:58.342358] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-14T19:05:58.348111] [INFO ] [REMOTE ] MS: Full fetch complete (58373 records). [2025-09-14T19:05:58.348314] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-09-14T19:05:58.743610] [DEBUG] [VALIDATOR ] MS: All expected trading days are present. [2025-09-14T19:05:58.743850] [DEBUG] [VALIDATOR ] MS: Primary data validation passed. [2025-09-14T19:05:58.744922] [INFO ] [MAIN ] MS: Fetched primary data is valid. [2025-09-14T19:05:58.745098] [DEBUG] [LOCAL ] MS: Saving primary data. [2025-09-14T19:05:58.746799] [DEBUG] [LOCAL ] MS: Trimmed 58373 records to 40437 (keeping 150 days of data) [2025-09-14T19:05:58.867527] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-14T19:05:58.885560] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-07. [2025-09-14T19:05:58.913421] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-14T19:05:58.920994] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-09-14T19:05:59.069261] [DEBUG] [LOCAL ] MS: Primary data saved (40437 records). [2025-09-14T19:05:59.069454] [INFO ] [MAIN ] MS: Full history saved. [2025-09-14T19:05:59.069576] [INFO ] [MAIN ] Update Progress: 1401/2370 symbols completed. MS took 11.2s. Estimated remaining: 1h 42m 55s. Rate: 9.4 symbols/min [2025-09-14T19:05:59.238190] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:05:59.243857] [DEBUG] [LOCAL ] MSB: Loaded 3850 existing records from primary storage. [2025-09-14T19:05:59.243997] [INFO ] [MAIN ] MSB: Loaded 3850 existing records. [2025-09-14T19:05:59.426755] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:05:59.427688] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-14T19:05:59.427976] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-09-14T19:05:59.430241] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-09-14T19:05:59.430347] [INFO ] [REMOTE ] MSA: Full fetch complete (20209 records). [2025-09-14T19:05:59.430597] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-09-14T19:05:59.430835] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-09-14T19:05:59.500852] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-09-14T19:06:00.122612] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present. [2025-09-14T19:06:00.133443] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed. [2025-09-14T19:06:00.149729] [INFO ] [MAIN ] MSA: Fetched primary data is valid. [2025-09-14T19:06:00.179702] [DEBUG] [LOCAL ] MSA: Saving primary data. [2025-09-14T19:06:00.202377] [INFO ] [REMOTE ] MSB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:06:00.202832] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-09-14T19:06:00.204316] [DEBUG] [LOCAL ] MSA: Trimmed 20209 records to 14092 (keeping 150 days of data) [2025-09-14T19:06:00.305582] [DEBUG] [LOCAL ] MSA: Primary data saved (14092 records). [2025-09-14T19:06:00.305926] [INFO ] [MAIN ] MSA: Full history saved. [2025-09-14T19:06:00.306146] [INFO ] [MAIN ] Update Progress: 1402/2370 symbols completed. MSA took 12.4s. Estimated remaining: 1h 42m 45s. Rate: 9.4 symbols/min [2025-09-14T19:06:00.482321] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:06:00.486100] [DEBUG] [LOCAL ] MSC: Loaded 882 existing records from primary storage. [2025-09-14T19:06:00.486218] [INFO ] [MAIN ] MSC: Loaded 882 existing records. [2025-09-14T19:06:00.709349] [WARN ] [MAIN ] MSC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:06:00.712931] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-09-14T19:06:00.713442] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-09-14T19:06:00.725391] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-14T19:06:00.726157] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-09-14T19:06:00.726301] [DEBUG] [LOCAL ] MSC: Deleted primary data file. [2025-09-14T19:06:00.726440] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-09-14T19:06:01.036939] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-14T19:06:01.092258] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-08. [2025-09-14T19:06:01.154599] [INFO ] [REMOTE ] MSC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:06:01.155071] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-09-14T19:06:01.687550] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-14T19:06:01.690567] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-09-14T19:06:03.618886] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.89 seconds). [2025-09-14T19:06:03.630067] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-09-14T19:06:04.477254] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (3.32 seconds). [2025-09-14T19:06:04.478881] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-09-14T19:06:04.601963] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-08 (3.51 seconds). [2025-09-14T19:06:04.612903] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-09. [2025-09-14T19:06:05.001874] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (3.31 seconds). [2025-09-14T19:06:05.004338] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-09-14T19:06:05.166062] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-14T19:06:05.171139] [INFO ] [REMOTE ] MRP: Full fetch complete (51838 records). [2025-09-14T19:06:05.171306] [DEBUG] [VALIDATOR ] MRP: Validating primary data. [2025-09-14T19:06:05.557488] [DEBUG] [VALIDATOR ] MRP: All expected trading days are present. [2025-09-14T19:06:05.557599] [DEBUG] [VALIDATOR ] MRP: Primary data validation passed. [2025-09-14T19:06:05.558496] [INFO ] [MAIN ] MRP: Fetched primary data is valid. [2025-09-14T19:06:05.558555] [DEBUG] [LOCAL ] MRP: Saving primary data. [2025-09-14T19:06:05.561118] [DEBUG] [LOCAL ] MRP: Trimmed 51838 records to 34842 (keeping 150 days of data) [2025-09-14T19:06:05.791266] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-14T19:06:05.793366] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-09-14T19:06:05.799441] [DEBUG] [LOCAL ] MRP: Primary data saved (34842 records). [2025-09-14T19:06:05.799586] [INFO ] [MAIN ] MRP: Full history saved. [2025-09-14T19:06:05.800990] [INFO ] [MAIN ] Update Progress: 1403/2370 symbols completed. MRP took 17.9s. Estimated remaining: 1h 42m 38s. Rate: 9.4 symbols/min [2025-09-14T19:06:05.931451] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-14T19:06:05.965350] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-09-14T19:06:05.984257] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:06:06.003585] [DEBUG] [LOCAL ] MSCI: Loaded 16641 existing records from primary storage. [2025-09-14T19:06:06.003809] [INFO ] [MAIN ] MSCI: Loaded 16641 existing records. [2025-09-14T19:06:06.186805] [WARN ] [MAIN ] MSCI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:06:06.187107] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-09-14T19:06:06.187275] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-09-14T19:06:06.187932] [DEBUG] [LOCAL ] MSCI: Deleted primary data file. [2025-09-14T19:06:06.187993] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-09-14T19:06:06.250217] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-14T19:06:06.277011] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-09-14T19:06:06.597285] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:06:06.599677] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-09-14T19:06:06.599968] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-09-14T19:06:06.709446] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-14T19:06:06.715593] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-14T19:06:06.958829] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-09-14T19:06:07.386962] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-14T19:06:07.758820] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-09-14T19:06:08.119948] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-14T19:06:08.558840] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-09-14T19:06:08.735284] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-14T19:06:09.006621] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-14T19:06:09.358897] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-09-14T19:06:10.158933] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-09-14T19:06:10.621531] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-14T19:06:10.958844] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-09-14T19:06:11.758833] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-09-14T19:06:11.806070] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-14T19:06:11.849253] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-14T19:06:12.126979] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-14T19:06:12.128072] [INFO ] [REMOTE ] MSC: Full fetch complete (1871 records). [2025-09-14T19:06:12.128155] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-09-14T19:06:12.313009] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 143 unique days, need 150 days [2025-09-14T19:06:12.313218] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-09-14T19:06:12.313287] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-09-14T19:06:12.313376] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-14T19:06:12.313467] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-14T19:06:12.313533] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-09-14T19:06:12.313627] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-09-14T19:06:12.313751] [INFO ] [MAIN ] Update Progress: 1404/2370 symbols completed. MSC took 12.0s. Estimated remaining: 1h 42m 31s. Rate: 9.4 symbols/min [2025-09-14T19:06:12.528292] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:06:12.542159] [DEBUG] [LOCAL ] MSD: Loaded 8141 existing records from primary storage. [2025-09-14T19:06:12.542320] [INFO ] [MAIN ] MSD: Loaded 8141 existing records. [2025-09-14T19:06:12.563887] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-09-14T19:06:12.725156] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:06:12.725424] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-09-14T19:06:12.725485] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-09-14T19:06:12.725918] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-09-14T19:06:12.725988] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-09-14T19:06:13.084051] [INFO ] [REMOTE ] MSD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:06:13.358837] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-09-14T19:06:14.158852] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-09-14T19:06:14.227422] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-14T19:06:14.620120] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-14T19:06:14.958856] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-09-14T19:06:15.758876] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-09-14T19:06:16.202662] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-14T19:06:16.209270] [INFO ] [REMOTE ] MRK: Full fetch complete (58469 records). [2025-09-14T19:06:16.209468] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-09-14T19:06:16.565448] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-09-14T19:06:16.623709] [DEBUG] [VALIDATOR ] MRK: All expected trading days are present. [2025-09-14T19:06:16.623833] [DEBUG] [VALIDATOR ] MRK: Primary data validation passed. [2025-09-14T19:06:16.625062] [INFO ] [MAIN ] MRK: Fetched primary data is valid. [2025-09-14T19:06:16.625131] [DEBUG] [LOCAL ] MRK: Saving primary data. [2025-09-14T19:06:16.627042] [DEBUG] [LOCAL ] MRK: Trimmed 58469 records to 40530 (keeping 150 days of data) [2025-09-14T19:06:16.702817] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-14T19:06:16.731826] [INFO ] [REMOTE ] MSB: Full fetch complete (9232 records). [2025-09-14T19:06:16.734962] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-09-14T19:06:17.129283] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-09-14T19:06:17.133094] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-09-14T19:06:17.134004] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-09-14T19:06:17.135381] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-09-14T19:06:17.150211] [DEBUG] [LOCAL ] MSB: Trimmed 9232 records to 6124 (keeping 150 days of data) [2025-09-14T19:06:17.300839] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-14T19:06:17.347703] [DEBUG] [LOCAL ] MSB: Primary data saved (6124 records). [2025-09-14T19:06:17.349459] [INFO ] [MAIN ] MSB: Full history saved. [2025-09-14T19:06:17.350411] [INFO ] [MAIN ] Update Progress: 1405/2370 symbols completed. MSB took 18.3s. Estimated remaining: 1h 42m 24s. Rate: 9.4 symbols/min [2025-09-14T19:06:17.367559] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-09-14T19:06:17.400559] [DEBUG] [LOCAL ] MRK: Primary data saved (40530 records). [2025-09-14T19:06:17.441497] [INFO ] [MAIN ] MRK: Full history saved. [2025-09-14T19:06:17.462728] [INFO ] [MAIN ] Update Progress: 1406/2370 symbols completed. MRK took 29.6s. Estimated remaining: 1h 42m 14s. Rate: 9.4 symbols/min [2025-09-14T19:06:17.647790] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:06:17.721072] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:06:17.740460] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-14T19:06:17.754517] [DEBUG] [LOCAL ] MSDL: Loaded 17394 existing records from primary storage. [2025-09-14T19:06:17.758937] [DEBUG] [LOCAL ] MSGE: Loaded 11998 existing records from primary storage. [2025-09-14T19:06:17.759010] [INFO ] [MAIN ] MSDL: Loaded 17394 existing records. [2025-09-14T19:06:17.790449] [INFO ] [MAIN ] MSGE: Loaded 11998 existing records. [2025-09-14T19:06:18.122388] [WARN ] [MAIN ] MSDL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:06:18.144781] [WARN ] [MAIN ] MSGE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:06:18.139021] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-09-14T19:06:18.145177] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-09-14T19:06:18.145226] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-09-14T19:06:18.145341] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-09-14T19:06:18.145993] [DEBUG] [LOCAL ] MSGE: Deleted primary data file. [2025-09-14T19:06:18.146065] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-09-14T19:06:18.146097] [DEBUG] [LOCAL ] MSDL: Deleted primary data file. [2025-09-14T19:06:18.168239] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-09-14T19:06:18.184876] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-09-14T19:06:18.780434] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:06:18.871453] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:06:18.888815] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-14T19:06:18.958831] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-09-14T19:06:19.242162] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-14T19:06:19.758846] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-09-14T19:06:20.471680] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T19:06:20.558773] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-09-14T19:06:20.749608] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-14T19:06:21.358839] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-09-14T19:06:21.999506] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-14T19:06:22.036023] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-14T19:06:22.158837] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-09-14T19:06:22.958861] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-09-14T19:06:23.275629] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-14T19:06:23.758887] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-09-14T19:06:24.204373] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-14T19:06:24.558824] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-09-14T19:06:25.013911] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-14T19:06:25.358901] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-09-14T19:06:25.854679] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-14T19:06:26.158914] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-09-14T19:06:26.771250] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-14T19:06:26.958912] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-09-14T19:06:27.563202] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-14T19:06:27.758919] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-09-14T19:06:28.321759] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-14T19:06:28.558944] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-09-14T19:06:28.902256] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-14T19:06:29.358882] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-09-14T19:06:29.441205] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-14T19:06:30.158871] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-09-14T19:06:30.821151] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-14T19:06:30.958870] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-09-14T19:06:31.382721] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-14T19:06:31.758872] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-09-14T19:06:32.443952] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-14T19:06:32.558850] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-09-14T19:06:32.738611] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-14T19:06:33.358862] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-09-14T19:06:34.134053] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T19:06:34.158778] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-09-14T19:06:34.521482] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-14T19:06:34.958881] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-09-14T19:06:35.703872] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-14T19:06:35.758842] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-09-14T19:06:36.156013] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-14T19:06:36.558911] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-09-14T19:06:36.913396] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-14T19:06:36.918199] [INFO ] [REMOTE ] MSDL: Full fetch complete (41535 records). [2025-09-14T19:06:36.918317] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-09-14T19:06:37.319327] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-09-14T19:06:37.319454] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-09-14T19:06:37.320296] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-09-14T19:06:37.320359] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-09-14T19:06:37.321529] [DEBUG] [LOCAL ] MSDL: Trimmed 41535 records to 27502 (keeping 150 days of data) [2025-09-14T19:06:37.377818] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-09-14T19:06:37.521628] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-14T19:06:37.533058] [DEBUG] [LOCAL ] MSDL: Primary data saved (27502 records). [2025-09-14T19:06:37.533272] [INFO ] [MAIN ] MSDL: Full history saved. [2025-09-14T19:06:37.533411] [INFO ] [MAIN ] Update Progress: 1407/2370 symbols completed. MSDL took 20.2s. Estimated remaining: 1h 42m 17s. Rate: 9.4 symbols/min [2025-09-14T19:06:37.711370] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:06:37.722041] [DEBUG] [LOCAL ] MSGS: Loaded 8288 existing records from primary storage. [2025-09-14T19:06:37.722243] [INFO ] [MAIN ] MSGS: Loaded 8288 existing records. [2025-09-14T19:06:37.906371] [WARN ] [MAIN ] MSGS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:06:37.906671] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-09-14T19:06:37.906730] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-09-14T19:06:37.907113] [DEBUG] [LOCAL ] MSGS: Deleted primary data file. [2025-09-14T19:06:37.907173] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-09-14T19:06:38.159299] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-09-14T19:06:38.267475] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:06:38.394412] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-14T19:06:38.396934] [INFO ] [REMOTE ] MSD: Full fetch complete (16782 records). [2025-09-14T19:06:38.397021] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-09-14T19:06:38.798377] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-09-14T19:06:38.798512] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-09-14T19:06:38.799014] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-09-14T19:06:38.799094] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-09-14T19:06:38.799831] [DEBUG] [LOCAL ] MSD: Trimmed 16782 records to 12044 (keeping 150 days of data) [2025-09-14T19:06:38.884813] [DEBUG] [LOCAL ] MSD: Primary data saved (12044 records). [2025-09-14T19:06:38.885178] [INFO ] [MAIN ] MSD: Full history saved. [2025-09-14T19:06:38.885378] [INFO ] [MAIN ] Update Progress: 1408/2370 symbols completed. MSD took 26.6s. Estimated remaining: 1h 42m 7s. Rate: 9.4 symbols/min [2025-09-14T19:06:38.960320] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-09-14T19:06:39.003106] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-14T19:06:39.025678] [INFO ] [REMOTE ] MSCI: Full fetch complete (37934 records). [2025-09-14T19:06:39.065364] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-09-14T19:06:39.118773] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:06:39.389383] [DEBUG] [LOCAL ] MSI: Loaded 17771 existing records from primary storage. [2025-09-14T19:06:39.392280] [INFO ] [MAIN ] MSI: Loaded 17771 existing records. [2025-09-14T19:06:39.605877] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present. [2025-09-14T19:06:39.616248] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed. [2025-09-14T19:06:39.627504] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-09-14T19:06:39.627619] [DEBUG] [LOCAL ] MSCI: Saving primary data. [2025-09-14T19:06:39.693467] [WARN ] [MAIN ] MSI: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:06:39.694078] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-09-14T19:06:39.694204] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-09-14T19:06:39.694615] [DEBUG] [LOCAL ] MSCI: Trimmed 37934 records to 25461 (keeping 150 days of data) [2025-09-14T19:06:39.695680] [DEBUG] [LOCAL ] MSI: Deleted primary data file. [2025-09-14T19:06:39.695807] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-09-14T19:06:39.786728] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-09-14T19:06:40.185896] [INFO ] [REMOTE ] MSI: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:06:40.213182] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-14T19:06:40.255735] [DEBUG] [LOCAL ] MSCI: Primary data saved (25461 records). [2025-09-14T19:06:40.255966] [INFO ] [MAIN ] MSCI: Full history saved. [2025-09-14T19:06:40.256110] [INFO ] [MAIN ] Update Progress: 1409/2370 symbols completed. MSCI took 34.5s. Estimated remaining: 1h 41m 57s. Rate: 9.4 symbols/min [2025-09-14T19:06:40.430579] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:06:40.441710] [DEBUG] [LOCAL ] MSIF: Loaded 8040 existing records from primary storage. [2025-09-14T19:06:40.441922] [INFO ] [MAIN ] MSIF: Loaded 8040 existing records. [2025-09-14T19:06:40.564011] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-09-14T19:06:40.626320] [WARN ] [MAIN ] MSIF: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:06:40.626663] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-09-14T19:06:40.626733] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-14T19:06:40.627138] [DEBUG] [LOCAL ] MSIF: Deleted primary data file. [2025-09-14T19:06:40.627204] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-09-14T19:06:41.036317] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:06:41.037748] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-14T19:06:41.041979] [INFO ] [REMOTE ] MSGE: Full fetch complete (29356 records). [2025-09-14T19:06:41.042112] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-09-14T19:06:41.364103] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-02. [2025-09-14T19:06:41.451891] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-09-14T19:06:41.452055] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-09-14T19:06:41.453779] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-09-14T19:06:41.453868] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-09-14T19:06:41.455246] [DEBUG] [LOCAL ] MSGE: Trimmed 29356 records to 19384 (keeping 150 days of data) [2025-09-14T19:06:41.590091] [DEBUG] [LOCAL ] MSGE: Primary data saved (19384 records). [2025-09-14T19:06:41.590346] [INFO ] [MAIN ] MSGE: Full history saved. [2025-09-14T19:06:41.590493] [INFO ] [MAIN ] Update Progress: 1410/2370 symbols completed. MSGE took 24.1s. Estimated remaining: 1h 41m 47s. Rate: 9.4 symbols/min [2025-09-14T19:06:41.776538] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:06:41.790521] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-14T19:06:41.813193] [DEBUG] [LOCAL ] MSM: Loaded 16024 existing records from primary storage. [2025-09-14T19:06:41.813421] [INFO ] [MAIN ] MSM: Loaded 16024 existing records. [2025-09-14T19:06:42.014536] [WARN ] [MAIN ] MSM: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:06:42.014917] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-09-14T19:06:42.015030] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-09-14T19:06:42.015670] [DEBUG] [LOCAL ] MSM: Deleted primary data file. [2025-09-14T19:06:42.015738] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-09-14T19:06:42.163997] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-09-14T19:06:42.365676] [INFO ] [REMOTE ] MSM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:06:42.445349] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-14T19:06:42.958808] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-09-14T19:06:43.256011] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-14T19:06:43.765576] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-03. [2025-09-14T19:06:43.767176] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-14T19:06:44.558852] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-09-14T19:06:44.654872] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-14T19:06:45.358798] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-04. [2025-09-14T19:06:45.464122] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-14T19:06:46.117529] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-14T19:06:46.158805] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-05. [2025-09-14T19:06:46.805897] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-14T19:06:46.958891] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-09-14T19:06:47.758824] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-06. [2025-09-14T19:06:48.023235] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-14T19:06:48.558839] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-09-14T19:06:48.820940] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-14T19:06:49.358851] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-09-14T19:06:49.404230] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-14T19:06:50.158888] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-07. [2025-09-14T19:06:50.792850] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-14T19:06:50.958848] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-09-14T19:06:50.998561] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-14T19:06:51.758886] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-09-14T19:06:52.424987] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-14T19:06:52.558927] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-09-14T19:06:52.906047] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-14T19:06:53.358881] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-09-14T19:06:53.408776] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-14T19:06:54.158845] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-09-14T19:06:54.404810] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-14T19:06:54.958834] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-09-14T19:06:55.398028] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-14T19:06:55.589800] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-14T19:06:55.758836] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-09-14T19:06:56.558860] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-08. [2025-09-14T19:06:56.855329] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-14T19:06:57.358809] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-09-14T19:06:57.733128] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-14T19:06:57.893882] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-14T19:06:57.896593] [INFO ] [REMOTE ] MSGS: Full fetch complete (17758 records). [2025-09-14T19:06:57.896754] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-09-14T19:06:58.163912] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-09. [2025-09-14T19:06:58.269751] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-09-14T19:06:58.269896] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-09-14T19:06:58.270470] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-09-14T19:06:58.270551] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-09-14T19:06:58.271382] [DEBUG] [LOCAL ] MSGS: Trimmed 17758 records to 12313 (keeping 150 days of data) [2025-09-14T19:06:58.360965] [DEBUG] [LOCAL ] MSGS: Primary data saved (12313 records). [2025-09-14T19:06:58.361192] [INFO ] [MAIN ] MSGS: Full history saved. [2025-09-14T19:06:58.361344] [INFO ] [MAIN ] Update Progress: 1411/2370 symbols completed. MSGS took 20.8s. Estimated remaining: 1h 41m 48s. Rate: 9.4 symbols/min [2025-09-14T19:06:58.536098] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:06:58.559865] [DEBUG] [LOCAL ] MT: Loaded 22650 existing records from primary storage. [2025-09-14T19:06:58.560110] [INFO ] [MAIN ] MT: Loaded 22650 existing records. [2025-09-14T19:06:58.785013] [WARN ] [MAIN ] MT: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:06:58.785394] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-09-14T19:06:58.785477] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-09-14T19:06:58.786268] [DEBUG] [LOCAL ] MT: Deleted primary data file. [2025-09-14T19:06:58.786350] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-09-14T19:06:58.965604] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-09-14T19:06:59.154774] [INFO ] [REMOTE ] MT: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:06:59.191921] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-14T19:06:59.195115] [INFO ] [REMOTE ] MSIF: Full fetch complete (14231 records). [2025-09-14T19:06:59.195252] [DEBUG] [VALIDATOR ] MSIF: Validating primary data. [2025-09-14T19:06:59.603453] [DEBUG] [VALIDATOR ] MSIF: All expected trading days are present. [2025-09-14T19:06:59.603587] [DEBUG] [VALIDATOR ] MSIF: Primary data validation passed. [2025-09-14T19:06:59.604316] [INFO ] [MAIN ] MSIF: Fetched primary data is valid. [2025-09-14T19:06:59.604393] [DEBUG] [LOCAL ] MSIF: Saving primary data. [2025-09-14T19:06:59.605044] [DEBUG] [LOCAL ] MSIF: Trimmed 14231 records to 10482 (keeping 150 days of data) [2025-09-14T19:06:59.677323] [DEBUG] [LOCAL ] MSIF: Primary data saved (10482 records). [2025-09-14T19:06:59.677582] [INFO ] [MAIN ] MSIF: Full history saved. [2025-09-14T19:06:59.677730] [INFO ] [MAIN ] Update Progress: 1412/2370 symbols completed. MSIF took 19.4s. Estimated remaining: 1h 41m 38s. Rate: 9.4 symbols/min [2025-09-14T19:06:59.764065] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-09-14T19:06:59.864759] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:06:59.885764] [DEBUG] [LOCAL ] MTAL: Loaded 17696 existing records from primary storage. [2025-09-14T19:06:59.886081] [INFO ] [MAIN ] MTAL: Loaded 17696 existing records. [2025-09-14T19:07:00.067026] [WARN ] [MAIN ] MTAL: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:07:00.067357] [INFO ] [MAIN ] MTAL: Wiping existing primary data before full refresh. [2025-09-14T19:07:00.067512] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-09-14T19:07:00.075795] [DEBUG] [LOCAL ] MTAL: Deleted primary data file. [2025-09-14T19:07:00.089771] [INFO ] [MAIN ] MTAL: Starting full primary refresh. [2025-09-14T19:07:00.167202] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-14T19:07:00.459213] [INFO ] [REMOTE ] MTAL: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:07:00.558843] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-09-14T19:07:01.358796] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-09-14T19:07:01.445562] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-14T19:07:01.994589] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-14T19:07:02.158854] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-02. [2025-09-14T19:07:02.817844] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-14T19:07:02.958903] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-09-14T19:07:03.193354] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-14T19:07:03.684080] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T19:07:03.688711] [INFO ] [REMOTE ] MSI: Full fetch complete (44516 records). [2025-09-14T19:07:03.688910] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-09-14T19:07:03.764050] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-09-14T19:07:04.121097] [DEBUG] [VALIDATOR ] MSI: All expected trading days are present. [2025-09-14T19:07:04.121239] [DEBUG] [VALIDATOR ] MSI: Primary data validation passed. [2025-09-14T19:07:04.122062] [INFO ] [MAIN ] MSI: Fetched primary data is valid. [2025-09-14T19:07:04.122139] [DEBUG] [LOCAL ] MSI: Saving primary data. [2025-09-14T19:07:04.123510] [DEBUG] [LOCAL ] MSI: Trimmed 44516 records to 30154 (keeping 150 days of data) [2025-09-14T19:07:04.327142] [DEBUG] [LOCAL ] MSI: Primary data saved (30154 records). [2025-09-14T19:07:04.327350] [INFO ] [MAIN ] MSI: Full history saved. [2025-09-14T19:07:04.327495] [INFO ] [MAIN ] Update Progress: 1413/2370 symbols completed. MSI took 25.4s. Estimated remaining: 1h 41m 31s. Rate: 9.4 symbols/min [2025-09-14T19:07:04.507210] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:07:04.529202] [DEBUG] [LOCAL ] MTB: Loaded 20709 existing records from primary storage. [2025-09-14T19:07:04.529408] [INFO ] [MAIN ] MTB: Loaded 20709 existing records. [2025-09-14T19:07:04.563918] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-03. [2025-09-14T19:07:04.711544] [WARN ] [MAIN ] MTB: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:07:04.711898] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-09-14T19:07:04.711979] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-09-14T19:07:04.712835] [DEBUG] [LOCAL ] MTB: Deleted primary data file. [2025-09-14T19:07:04.712914] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-09-14T19:07:05.067444] [INFO ] [REMOTE ] MTB: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:07:05.358778] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-09-14T19:07:05.844622] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-14T19:07:06.070197] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-14T19:07:06.158866] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-09-14T19:07:06.958835] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-04. [2025-09-14T19:07:07.001914] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-14T19:07:07.758826] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-09-14T19:07:08.229921] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-14T19:07:08.511143] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-14T19:07:08.558858] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-09-14T19:07:09.358843] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-09-14T19:07:09.666862] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-14T19:07:10.158828] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-05. [2025-09-14T19:07:10.336094] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-14T19:07:10.958827] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-09-14T19:07:10.995938] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-14T19:07:11.603244] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-14T19:07:11.758841] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-09-14T19:07:12.558861] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-06. [2025-09-14T19:07:13.073072] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-14T19:07:13.256490] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-14T19:07:13.358834] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-09-14T19:07:14.163940] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-09-14T19:07:14.177459] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-14T19:07:14.958833] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-07. [2025-09-14T19:07:15.335823] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-14T19:07:15.758833] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-09-14T19:07:15.993170] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-14T19:07:16.558832] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-09-14T19:07:16.783074] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-14T19:07:17.358846] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-09-14T19:07:17.663463] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-14T19:07:17.806595] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-14T19:07:17.812576] [INFO ] [REMOTE ] MSM: Full fetch complete (38168 records). [2025-09-14T19:07:17.812899] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-09-14T19:07:18.160733] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-08. [2025-09-14T19:07:18.196495] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-09-14T19:07:18.196627] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-09-14T19:07:18.197489] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-09-14T19:07:18.197687] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-09-14T19:07:18.198591] [DEBUG] [LOCAL ] MSM: Trimmed 38168 records to 25777 (keeping 150 days of data) [2025-09-14T19:07:18.359782] [DEBUG] [LOCAL ] MSM: Primary data saved (25777 records). [2025-09-14T19:07:18.360008] [INFO ] [MAIN ] MSM: Full history saved. [2025-09-14T19:07:18.360137] [INFO ] [MAIN ] Update Progress: 1414/2370 symbols completed. MSM took 36.8s. Estimated remaining: 1h 41m 29s. Rate: 9.4 symbols/min [2025-09-14T19:07:18.532957] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:07:18.541852] [DEBUG] [LOCAL ] MTD: Loaded 5898 existing records from primary storage. [2025-09-14T19:07:18.542200] [INFO ] [MAIN ] MTD: Loaded 5898 existing records. [2025-09-14T19:07:18.745358] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:07:18.769336] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-09-14T19:07:18.769514] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-09-14T19:07:18.770058] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-09-14T19:07:18.770567] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-09-14T19:07:18.773185] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-14T19:07:18.967171] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-09-14T19:07:19.169319] [INFO ] [REMOTE ] MTD: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:07:19.764055] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-09-14T19:07:19.776968] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-14T19:07:20.558850] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-09-14T19:07:20.834451] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-14T19:07:20.968117] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-14T19:07:21.358935] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-09-14T19:07:22.158865] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-09. [2025-09-14T19:07:22.302996] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-14T19:07:22.349897] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-14T19:07:22.958853] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-09-14T19:07:23.516895] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-14T19:07:23.521476] [INFO ] [REMOTE ] MTAL: Full fetch complete (37975 records). [2025-09-14T19:07:23.521616] [DEBUG] [VALIDATOR ] MTAL: Validating primary data. [2025-09-14T19:07:23.764218] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-09-14T19:07:23.908160] [DEBUG] [VALIDATOR ] MTAL: All expected trading days are present. [2025-09-14T19:07:23.908277] [DEBUG] [VALIDATOR ] MTAL: Primary data validation passed. [2025-09-14T19:07:23.909119] [INFO ] [MAIN ] MTAL: Fetched primary data is valid. [2025-09-14T19:07:23.909181] [DEBUG] [LOCAL ] MTAL: Saving primary data. [2025-09-14T19:07:23.910168] [DEBUG] [LOCAL ] MTAL: Trimmed 37975 records to 27726 (keeping 150 days of data) [2025-09-14T19:07:24.076948] [DEBUG] [LOCAL ] MTAL: Primary data saved (27726 records). [2025-09-14T19:07:24.077154] [INFO ] [MAIN ] MTAL: Full history saved. [2025-09-14T19:07:24.077296] [INFO ] [MAIN ] Update Progress: 1415/2370 symbols completed. MTAL took 24.4s. Estimated remaining: 1h 41m 23s. Rate: 9.4 symbols/min [2025-09-14T19:07:24.248229] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:07:24.271812] [DEBUG] [LOCAL ] MTDR: Loaded 22974 existing records from primary storage. [2025-09-14T19:07:24.271996] [INFO ] [MAIN ] MTDR: Loaded 22974 existing records. [2025-09-14T19:07:24.457044] [WARN ] [MAIN ] MTDR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:07:24.457351] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-09-14T19:07:24.457561] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-09-14T19:07:24.464072] [DEBUG] [LOCAL ] MTDR: Deleted primary data file. [2025-09-14T19:07:24.472186] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-09-14T19:07:24.478521] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-14T19:07:24.555052] [INFO ] [REMOTE ] MT: Full fetch complete (55453 records). [2025-09-14T19:07:24.560301] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-09-14T19:07:24.582999] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-09-14T19:07:25.137184] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:07:25.277549] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-09-14T19:07:25.279036] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-09-14T19:07:25.278927] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-14T19:07:25.280134] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-09-14T19:07:25.285098] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-09-14T19:07:25.287420] [DEBUG] [LOCAL ] MT: Trimmed 55453 records to 37882 (keeping 150 days of data) [2025-09-14T19:07:25.382202] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-09-14T19:07:25.545951] [DEBUG] [LOCAL ] MT: Primary data saved (37882 records). [2025-09-14T19:07:25.546197] [INFO ] [MAIN ] MT: Full history saved. [2025-09-14T19:07:25.546339] [INFO ] [MAIN ] Update Progress: 1416/2370 symbols completed. MT took 27.2s. Estimated remaining: 1h 41m 13s. Rate: 9.4 symbols/min [2025-09-14T19:07:25.733109] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:07:25.757883] [DEBUG] [LOCAL ] MTG: Loaded 22867 existing records from primary storage. [2025-09-14T19:07:25.758111] [INFO ] [MAIN ] MTG: Loaded 22867 existing records. [2025-09-14T19:07:25.953084] [WARN ] [MAIN ] MTG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:07:25.953417] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-09-14T19:07:25.953486] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-09-14T19:07:25.954506] [DEBUG] [LOCAL ] MTG: Deleted primary data file. [2025-09-14T19:07:25.954586] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-09-14T19:07:26.163989] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-09-14T19:07:26.347620] [INFO ] [REMOTE ] MTG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:07:26.618795] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-14T19:07:26.655022] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-14T19:07:26.958848] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-09-14T19:07:27.758850] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-09-14T19:07:28.035076] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-14T19:07:28.076180] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-14T19:07:28.558856] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-09-14T19:07:29.366401] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-09-14T19:07:29.368579] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-14T19:07:30.158909] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-09-14T19:07:30.297130] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-14T19:07:30.318973] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-14T19:07:30.686952] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-14T19:07:30.691675] [INFO ] [REMOTE ] MTB: Full fetch complete (51245 records). [2025-09-14T19:07:30.691817] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-09-14T19:07:30.963924] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-09-14T19:07:31.085326] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present. [2025-09-14T19:07:31.085466] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed. [2025-09-14T19:07:31.086486] [INFO ] [MAIN ] MTB: Fetched primary data is valid. [2025-09-14T19:07:31.086552] [DEBUG] [LOCAL ] MTB: Saving primary data. [2025-09-14T19:07:31.088840] [DEBUG] [LOCAL ] MTB: Trimmed 51245 records to 35024 (keeping 150 days of data) [2025-09-14T19:07:31.328153] [DEBUG] [LOCAL ] MTB: Primary data saved (35024 records). [2025-09-14T19:07:31.328372] [INFO ] [MAIN ] MTB: Full history saved. [2025-09-14T19:07:31.328504] [INFO ] [MAIN ] Update Progress: 1417/2370 symbols completed. MTB took 27.0s. Estimated remaining: 1h 41m 6s. Rate: 9.4 symbols/min [2025-09-14T19:07:31.524722] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:07:31.544064] [DEBUG] [LOCAL ] MTH: Loaded 19603 existing records from primary storage. [2025-09-14T19:07:31.544233] [INFO ] [MAIN ] MTH: Loaded 19603 existing records. [2025-09-14T19:07:31.720093] [WARN ] [MAIN ] MTH: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:07:31.720393] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-09-14T19:07:31.720465] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-09-14T19:07:31.721066] [DEBUG] [LOCAL ] MTH: Deleted primary data file. [2025-09-14T19:07:31.721131] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-09-14T19:07:31.763996] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-09-14T19:07:32.004853] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-14T19:07:32.094044] [INFO ] [REMOTE ] MTH: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:07:32.558849] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-09-14T19:07:33.082389] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-14T19:07:33.084269] [INFO ] [REMOTE ] MTD: Full fetch complete (16962 records). [2025-09-14T19:07:33.084360] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-09-14T19:07:33.364057] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-09-14T19:07:33.451491] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-09-14T19:07:33.451624] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-09-14T19:07:33.452095] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-09-14T19:07:33.452150] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-09-14T19:07:33.452844] [DEBUG] [LOCAL ] MTD: Trimmed 16962 records to 11405 (keeping 150 days of data) [2025-09-14T19:07:33.536051] [DEBUG] [LOCAL ] MTD: Primary data saved (11405 records). [2025-09-14T19:07:33.536269] [INFO ] [MAIN ] MTD: Full history saved. [2025-09-14T19:07:33.536404] [INFO ] [MAIN ] Update Progress: 1418/2370 symbols completed. MTD took 15.2s. Estimated remaining: 1h 40m 57s. Rate: 9.4 symbols/min [2025-09-14T19:07:33.715019] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-14T19:07:33.747485] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:07:33.766225] [DEBUG] [LOCAL ] MTN: Loaded 17157 existing records from primary storage. [2025-09-14T19:07:33.766417] [INFO ] [MAIN ] MTN: Loaded 17157 existing records. [2025-09-14T19:07:33.944784] [WARN ] [MAIN ] MTN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:07:33.945081] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-09-14T19:07:33.945142] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-09-14T19:07:33.945698] [DEBUG] [LOCAL ] MTN: Deleted primary data file. [2025-09-14T19:07:33.945759] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-09-14T19:07:34.167904] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-09-14T19:07:34.304891] [INFO ] [REMOTE ] MTN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:07:34.958822] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-09-14T19:07:35.103961] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-14T19:07:35.758897] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-09-14T19:07:35.977845] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-14T19:07:36.472415] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-14T19:07:36.558846] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-09-14T19:07:37.358866] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-09-14T19:07:37.552396] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T19:07:37.902763] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-14T19:07:38.158900] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-09-14T19:07:38.692559] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-14T19:07:38.958840] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-09-14T19:07:39.758869] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-09-14T19:07:40.169885] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-14T19:07:40.558868] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-09-14T19:07:40.734335] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-14T19:07:41.111005] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-14T19:07:41.358920] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-09-14T19:07:42.158840] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-09-14T19:07:42.193668] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-14T19:07:42.958858] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-09-14T19:07:43.127336] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-14T19:07:43.758824] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-09-14T19:07:43.872606] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-14T19:07:44.558869] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-09-14T19:07:44.670180] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-14T19:07:45.309290] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-14T19:07:45.358772] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-09-14T19:07:46.158819] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-09-14T19:07:46.275772] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-14T19:07:46.649036] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-14T19:07:46.958831] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-09-14T19:07:47.758865] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-09-14T19:07:47.847211] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-14T19:07:48.558901] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-09-14T19:07:48.728311] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-14T19:07:48.875185] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-14T19:07:49.358899] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-09-14T19:07:49.782945] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-14T19:07:49.788166] [INFO ] [REMOTE ] MTDR: Full fetch complete (55876 records). [2025-09-14T19:07:49.788345] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-09-14T19:07:50.162868] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-09-14T19:07:50.182837] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-09-14T19:07:50.182948] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-09-14T19:07:50.184070] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-09-14T19:07:50.184188] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-09-14T19:07:50.185981] [DEBUG] [LOCAL ] MTDR: Trimmed 55876 records to 38772 (keeping 150 days of data) [2025-09-14T19:07:50.332414] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-14T19:07:50.518979] [DEBUG] [LOCAL ] MTDR: Primary data saved (38772 records). [2025-09-14T19:07:50.519233] [INFO ] [MAIN ] MTDR: Full history saved. [2025-09-14T19:07:50.519398] [INFO ] [MAIN ] Update Progress: 1419/2370 symbols completed. MTDR took 26.4s. Estimated remaining: 1h 40m 58s. Rate: 9.4 symbols/min [2025-09-14T19:07:50.694745] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:07:50.697833] [DEBUG] [LOCAL ] MTR: Loaded 1194 existing records from primary storage. [2025-09-14T19:07:50.697926] [INFO ] [MAIN ] MTR: Loaded 1194 existing records. [2025-09-14T19:07:50.882563] [WARN ] [MAIN ] MTR: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:07:50.882866] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-09-14T19:07:50.882939] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-14T19:07:50.883167] [DEBUG] [LOCAL ] MTR: Deleted primary data file. [2025-09-14T19:07:50.883227] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-09-14T19:07:50.963991] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-09-14T19:07:51.260280] [INFO ] [REMOTE ] MTR: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:07:51.758867] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-09-14T19:07:51.897459] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-14T19:07:52.100705] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-14T19:07:52.558885] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-09-14T19:07:52.825621] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-14T19:07:53.358866] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-09-14T19:07:54.011715] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-14T19:07:54.018356] [INFO ] [REMOTE ] MTG: Full fetch complete (55856 records). [2025-09-14T19:07:54.018825] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-09-14T19:07:54.162145] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-09-14T19:07:54.359680] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-14T19:07:54.465393] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-09-14T19:07:54.465923] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-09-14T19:07:54.467309] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-09-14T19:07:54.467404] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-09-14T19:07:54.469289] [DEBUG] [LOCAL ] MTG: Trimmed 55856 records to 38305 (keeping 150 days of data) [2025-09-14T19:07:54.723611] [DEBUG] [LOCAL ] MTG: Primary data saved (38305 records). [2025-09-14T19:07:54.723876] [INFO ] [MAIN ] MTG: Full history saved. [2025-09-14T19:07:54.724024] [INFO ] [MAIN ] Update Progress: 1420/2370 symbols completed. MTG took 29.2s. Estimated remaining: 1h 40m 50s. Rate: 9.4 symbols/min [2025-09-14T19:07:54.895417] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:07:54.912561] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-14T19:07:54.920222] [INFO ] [REMOTE ] MTN: Full fetch complete (42249 records). [2025-09-14T19:07:54.924468] [DEBUG] [LOCAL ] MTRN: Loaded 8223 existing records from primary storage. [2025-09-14T19:07:54.924682] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-09-14T19:07:54.924979] [INFO ] [MAIN ] MTRN: Loaded 8223 existing records. [2025-09-14T19:07:54.969446] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-09-14T19:07:55.286829] [WARN ] [MAIN ] MTRN: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:07:55.288392] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-09-14T19:07:55.288475] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-09-14T19:07:55.309696] [DEBUG] [LOCAL ] MTRN: Deleted primary data file. [2025-09-14T19:07:55.363012] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-09-14T19:07:55.547917] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-14T19:07:55.717266] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-09-14T19:07:55.768051] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-09-14T19:07:55.773365] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-09-14T19:07:55.804223] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-09-14T19:07:55.809535] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-09-14T19:07:55.849738] [DEBUG] [LOCAL ] MTN: Trimmed 42249 records to 29044 (keeping 150 days of data) [2025-09-14T19:07:55.927133] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:07:56.185432] [DEBUG] [LOCAL ] MTN: Primary data saved (29044 records). [2025-09-14T19:07:56.185714] [INFO ] [MAIN ] MTN: Full history saved. [2025-09-14T19:07:56.185839] [INFO ] [MAIN ] Update Progress: 1421/2370 symbols completed. MTN took 22.6s. Estimated remaining: 1h 40m 40s. Rate: 9.4 symbols/min [2025-09-14T19:07:56.437755] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:07:56.457899] [DEBUG] [LOCAL ] MTUS: Loaded 11943 existing records from primary storage. [2025-09-14T19:07:56.458176] [INFO ] [MAIN ] MTUS: Loaded 11943 existing records. [2025-09-14T19:07:56.561201] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-09-14T19:07:56.772702] [WARN ] [MAIN ] MTUS: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:07:56.773100] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-09-14T19:07:56.773172] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-09-14T19:07:56.773737] [DEBUG] [LOCAL ] MTUS: Deleted primary data file. [2025-09-14T19:07:56.773801] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-09-14T19:07:57.077228] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-14T19:07:57.245707] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:07:57.344750] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-14T19:07:57.358811] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-09-14T19:07:58.158794] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-09-14T19:07:58.547866] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-14T19:07:58.621170] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-14T19:07:58.958898] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-09-14T19:07:59.758850] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-09-14T19:07:59.773855] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-14T19:08:00.558863] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-09-14T19:08:00.721690] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-14T19:08:01.358881] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-09-14T19:08:02.158914] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-09-14T19:08:02.407362] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-14T19:08:02.705964] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-14T19:08:02.958806] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-09-14T19:08:03.496146] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-14T19:08:03.758893] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-09-14T19:08:04.020116] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-14T19:08:04.343734] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-14T19:08:04.558834] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-09-14T19:08:05.072095] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-14T19:08:05.358881] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-09-14T19:08:06.025707] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-14T19:08:06.030200] [INFO ] [REMOTE ] MTH: Full fetch complete (47974 records). [2025-09-14T19:08:06.030303] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-09-14T19:08:06.173432] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-09-14T19:08:06.441413] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-09-14T19:08:06.441572] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-09-14T19:08:06.442921] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-09-14T19:08:06.443016] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-09-14T19:08:06.444453] [DEBUG] [LOCAL ] MTH: Trimmed 47974 records to 32732 (keeping 150 days of data) [2025-09-14T19:08:06.660036] [DEBUG] [LOCAL ] MTH: Primary data saved (32732 records). [2025-09-14T19:08:06.660270] [INFO ] [MAIN ] MTH: Full history saved. [2025-09-14T19:08:06.660406] [INFO ] [MAIN ] Update Progress: 1422/2370 symbols completed. MTH took 35.3s. Estimated remaining: 1h 40m 37s. Rate: 9.4 symbols/min [2025-09-14T19:08:06.843488] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:08:06.858604] [DEBUG] [LOCAL ] MTW: Loaded 11799 existing records from primary storage. [2025-09-14T19:08:06.858887] [INFO ] [MAIN ] MTW: Loaded 11799 existing records. [2025-09-14T19:08:06.964065] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-09-14T19:08:07.060963] [WARN ] [MAIN ] MTW: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:08:07.061427] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-09-14T19:08:07.061500] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-09-14T19:08:07.061957] [DEBUG] [LOCAL ] MTW: Deleted primary data file. [2025-09-14T19:08:07.062050] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-09-14T19:08:07.438939] [INFO ] [REMOTE ] MTW: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:08:07.534186] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-14T19:08:07.556928] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-14T19:08:07.557923] [INFO ] [REMOTE ] MTR: Full fetch complete (1927 records). [2025-09-14T19:08:07.558026] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-09-14T19:08:07.766364] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-09-14T19:08:07.925672] [DEBUG] [VALIDATOR ] MTR: All expected trading days are present. [2025-09-14T19:08:07.925793] [DEBUG] [VALIDATOR ] MTR: Primary data validation passed. [2025-09-14T19:08:07.925903] [INFO ] [MAIN ] MTR: Fetched primary data is valid. [2025-09-14T19:08:07.925958] [DEBUG] [LOCAL ] MTR: Saving primary data. [2025-09-14T19:08:07.926316] [DEBUG] [LOCAL ] MTR: Trimmed 1927 records to 1606 (keeping 150 days of data) [2025-09-14T19:08:07.936232] [DEBUG] [LOCAL ] MTR: Primary data saved (1606 records). [2025-09-14T19:08:07.936313] [INFO ] [MAIN ] MTR: Full history saved. [2025-09-14T19:08:07.936404] [INFO ] [MAIN ] Update Progress: 1423/2370 symbols completed. MTR took 17.4s. Estimated remaining: 1h 40m 27s. Rate: 9.4 symbols/min [2025-09-14T19:08:08.106174] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:08:08.118870] [DEBUG] [LOCAL ] MTX: Loaded 10604 existing records from primary storage. [2025-09-14T19:08:08.119044] [INFO ] [MAIN ] MTX: Loaded 10604 existing records. [2025-09-14T19:08:08.300870] [WARN ] [MAIN ] MTX: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:08:08.301187] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-09-14T19:08:08.301253] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-09-14T19:08:08.301786] [DEBUG] [LOCAL ] MTX: Deleted primary data file. [2025-09-14T19:08:08.301853] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-09-14T19:08:08.569159] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-09-14T19:08:08.663308] [INFO ] [REMOTE ] MTX: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:08:09.226584] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-14T19:08:09.358864] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-09-14T19:08:09.957388] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-14T19:08:10.158897] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-09-14T19:08:10.958946] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-09-14T19:08:10.964095] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-14T19:08:11.192334] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-14T19:08:11.758935] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-09-14T19:08:11.991385] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-14T19:08:12.558862] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-09-14T19:08:12.993800] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-14T19:08:13.358888] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-09-14T19:08:13.509332] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-14T19:08:14.158872] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-09-14T19:08:14.872588] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-14T19:08:14.958863] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-09-14T19:08:15.303602] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-14T19:08:15.758888] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-09-14T19:08:16.087260] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-14T19:08:16.171822] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-14T19:08:16.174263] [INFO ] [REMOTE ] MTRN: Full fetch complete (18815 records). [2025-09-14T19:08:16.174352] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-09-14T19:08:16.536359] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-09-14T19:08:16.536468] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-09-14T19:08:16.536909] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-09-14T19:08:16.536964] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-09-14T19:08:16.537713] [DEBUG] [LOCAL ] MTRN: Trimmed 18815 records to 13788 (keeping 150 days of data) [2025-09-14T19:08:16.576381] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-09-14T19:08:16.628077] [DEBUG] [LOCAL ] MTRN: Primary data saved (13788 records). [2025-09-14T19:08:16.628244] [INFO ] [MAIN ] MTRN: Full history saved. [2025-09-14T19:08:16.628362] [INFO ] [MAIN ] Update Progress: 1424/2370 symbols completed. MTRN took 21.9s. Estimated remaining: 1h 40m 22s. Rate: 9.4 symbols/min [2025-09-14T19:08:16.805296] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:08:16.826826] [DEBUG] [LOCAL ] MTZ: Loaded 19166 existing records from primary storage. [2025-09-14T19:08:16.827017] [INFO ] [MAIN ] MTZ: Loaded 19166 existing records. [2025-09-14T19:08:17.005427] [WARN ] [MAIN ] MTZ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:08:17.005767] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-09-14T19:08:17.005841] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-09-14T19:08:17.006532] [DEBUG] [LOCAL ] MTZ: Deleted primary data file. [2025-09-14T19:08:17.006604] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-09-14T19:08:17.366387] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-09-14T19:08:17.371515] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:08:18.158890] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-09-14T19:08:18.221391] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-14T19:08:18.632170] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-14T19:08:18.958885] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-09-14T19:08:19.758873] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-09-14T19:08:19.802076] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-14T19:08:20.263058] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-14T19:08:20.558877] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-09-14T19:08:21.117065] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-14T19:08:21.358920] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-09-14T19:08:22.158882] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-09-14T19:08:22.254571] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-14T19:08:22.280756] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-14T19:08:22.958799] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-09-14T19:08:23.340389] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-14T19:08:23.758800] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-09-14T19:08:24.156783] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-14T19:08:24.558888] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-09-14T19:08:25.358849] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-09-14T19:08:25.551111] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-14T19:08:25.617763] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-14T19:08:26.158864] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-09-14T19:08:26.742666] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-14T19:08:26.958833] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-09-14T19:08:27.134954] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-14T19:08:27.758884] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-09-14T19:08:28.558855] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-09-14T19:08:28.752311] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-14T19:08:28.805249] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-14T19:08:29.115119] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-14T19:08:29.117913] [INFO ] [REMOTE ] MTX: Full fetch complete (25065 records). [2025-09-14T19:08:29.118054] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-09-14T19:08:29.368562] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-09-14T19:08:29.503573] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-09-14T19:08:29.503702] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-09-14T19:08:29.504227] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-09-14T19:08:29.504297] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-09-14T19:08:29.505007] [DEBUG] [LOCAL ] MTX: Trimmed 25065 records to 17744 (keeping 150 days of data) [2025-09-14T19:08:29.628447] [DEBUG] [LOCAL ] MTX: Primary data saved (17744 records). [2025-09-14T19:08:29.628633] [INFO ] [MAIN ] MTX: Full history saved. [2025-09-14T19:08:29.628793] [INFO ] [MAIN ] Update Progress: 1425/2370 symbols completed. MTX took 21.7s. Estimated remaining: 1h 40m 20s. Rate: 9.4 symbols/min [2025-09-14T19:08:29.796667] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:08:29.803605] [DEBUG] [LOCAL ] MUA: Loaded 5091 existing records from primary storage. [2025-09-14T19:08:29.803765] [INFO ] [MAIN ] MUA: Loaded 5091 existing records. [2025-09-14T19:08:29.982682] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:08:29.983080] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-09-14T19:08:29.983221] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-09-14T19:08:29.990885] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-09-14T19:08:29.991582] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-09-14T19:08:29.991876] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-14T19:08:30.073780] [INFO ] [REMOTE ] MTUS: Full fetch complete (31864 records). [2025-09-14T19:08:30.094194] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-09-14T19:08:30.163968] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-09-14T19:08:30.664037] [INFO ] [REMOTE ] MUA: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:08:30.748972] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present. [2025-09-14T19:08:30.749095] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed. [2025-09-14T19:08:30.749794] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-09-14T19:08:30.749851] [DEBUG] [LOCAL ] MTUS: Saving primary data. [2025-09-14T19:08:30.750633] [DEBUG] [LOCAL ] MTUS: Trimmed 31864 records to 21091 (keeping 150 days of data) [2025-09-14T19:08:30.877327] [DEBUG] [LOCAL ] MTUS: Primary data saved (21091 records). [2025-09-14T19:08:30.877504] [INFO ] [MAIN ] MTUS: Full history saved. [2025-09-14T19:08:30.877628] [INFO ] [MAIN ] Update Progress: 1426/2370 symbols completed. MTUS took 34.7s. Estimated remaining: 1h 40m 10s. Rate: 9.4 symbols/min [2025-09-14T19:08:30.964040] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-09-14T19:08:31.050943] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:08:31.062926] [DEBUG] [LOCAL ] MUC: Loaded 9560 existing records from primary storage. [2025-09-14T19:08:31.063094] [INFO ] [MAIN ] MUC: Loaded 9560 existing records. [2025-09-14T19:08:31.240339] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:08:31.240660] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-09-14T19:08:31.240727] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-09-14T19:08:31.241206] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-09-14T19:08:31.241270] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-09-14T19:08:31.591968] [INFO ] [REMOTE ] MUC: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:08:31.758838] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-09-14T19:08:31.844981] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-14T19:08:32.085008] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-14T19:08:32.558856] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-09-14T19:08:32.754828] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-14T19:08:33.358853] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-09-14T19:08:34.158875] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-09-14T19:08:34.264390] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-14T19:08:34.311408] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-14T19:08:34.958891] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-09-14T19:08:34.978599] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-14T19:08:35.758914] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-09-14T19:08:36.069259] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-14T19:08:36.558884] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-09-14T19:08:37.358867] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-09-14T19:08:37.518193] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-14T19:08:37.593548] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-14T19:08:38.158866] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-09-14T19:08:38.399403] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-14T19:08:38.402140] [INFO ] [REMOTE ] MTW: Full fetch complete (29452 records). [2025-09-14T19:08:38.402239] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-09-14T19:08:38.771612] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-09-14T19:08:38.771764] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-09-14T19:08:38.772404] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-09-14T19:08:38.772457] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-09-14T19:08:38.773248] [DEBUG] [LOCAL ] MTW: Trimmed 29452 records to 20093 (keeping 150 days of data) [2025-09-14T19:08:38.899796] [DEBUG] [LOCAL ] MTW: Primary data saved (20093 records). [2025-09-14T19:08:38.899957] [INFO ] [MAIN ] MTW: Full history saved. [2025-09-14T19:08:38.900131] [INFO ] [MAIN ] Update Progress: 1427/2370 symbols completed. MTW took 32.2s. Estimated remaining: 1h 40m 5s. Rate: 9.4 symbols/min [2025-09-14T19:08:38.964095] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-09-14T19:08:39.079620] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:08:39.087776] [DEBUG] [LOCAL ] MUE: Loaded 5608 existing records from primary storage. [2025-09-14T19:08:39.087928] [INFO ] [MAIN ] MUE: Loaded 5608 existing records. [2025-09-14T19:08:39.266663] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-14T19:08:39.286955] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:08:39.291615] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-09-14T19:08:39.291709] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-09-14T19:08:39.292110] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-09-14T19:08:39.292176] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-09-14T19:08:39.663018] [INFO ] [REMOTE ] MUE: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:08:39.690785] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-14T19:08:39.695887] [INFO ] [REMOTE ] MTZ: Full fetch complete (47558 records). [2025-09-14T19:08:39.696001] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-09-14T19:08:39.763996] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-09-14T19:08:40.077746] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-09-14T19:08:40.077865] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-09-14T19:08:40.078798] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-09-14T19:08:40.078858] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-09-14T19:08:40.079963] [DEBUG] [LOCAL ] MTZ: Trimmed 47558 records to 32078 (keeping 150 days of data) [2025-09-14T19:08:40.297930] [DEBUG] [LOCAL ] MTZ: Primary data saved (32078 records). [2025-09-14T19:08:40.298114] [INFO ] [MAIN ] MTZ: Full history saved. [2025-09-14T19:08:40.298236] [INFO ] [MAIN ] Update Progress: 1428/2370 symbols completed. MTZ took 23.7s. Estimated remaining: 1h 39m 55s. Rate: 9.4 symbols/min [2025-09-14T19:08:40.468041] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:08:40.492433] [DEBUG] [LOCAL ] MUFG: Loaded 23443 existing records from primary storage. [2025-09-14T19:08:40.492605] [INFO ] [MAIN ] MUFG: Loaded 23443 existing records. [2025-09-14T19:08:40.565853] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-09-14T19:08:40.670794] [WARN ] [MAIN ] MUFG: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:08:40.675773] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-14T19:08:40.675870] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-09-14T19:08:40.677910] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-09-14T19:08:40.678683] [DEBUG] [LOCAL ] MUFG: Deleted primary data file. [2025-09-14T19:08:40.678748] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-09-14T19:08:41.038214] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:08:41.358822] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-09-14T19:08:41.649440] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-14T19:08:42.158854] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-09-14T19:08:42.303285] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-14T19:08:42.958872] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-09-14T19:08:43.301240] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-14T19:08:43.758896] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-09-14T19:08:43.775217] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-14T19:08:44.558853] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-09-14T19:08:44.955257] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-14T19:08:45.358849] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-09-14T19:08:45.542987] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-14T19:08:46.158859] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-09-14T19:08:46.958915] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-09-14T19:08:47.059896] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-14T19:08:47.062440] [INFO ] [REMOTE ] MUC: Full fetch complete (21397 records). [2025-09-14T19:08:47.062537] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-09-14T19:08:47.468113] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-09-14T19:08:47.468277] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-09-14T19:08:47.468786] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-09-14T19:08:47.468893] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-09-14T19:08:47.481300] [DEBUG] [LOCAL ] MUC: Trimmed 21397 records to 14665 (keeping 150 days of data) [2025-09-14T19:08:47.539967] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-14T19:08:47.603442] [DEBUG] [LOCAL ] MUC: Primary data saved (14665 records). [2025-09-14T19:08:47.603633] [INFO ] [MAIN ] MUC: Full history saved. [2025-09-14T19:08:47.603777] [INFO ] [MAIN ] Update Progress: 1429/2370 symbols completed. MUC took 16.7s. Estimated remaining: 1h 39m 50s. Rate: 9.4 symbols/min [2025-09-14T19:08:47.771764] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-09-14T19:08:47.774339] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:08:47.784494] [DEBUG] [LOCAL ] MUJ: Loaded 6955 existing records from primary storage. [2025-09-14T19:08:47.784675] [INFO ] [MAIN ] MUJ: Loaded 6955 existing records. [2025-09-14T19:08:47.919724] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-14T19:08:47.976194] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-06-16, but need from 2025-02-07 for 150 day retention. Performing full refresh. [2025-09-14T19:08:47.976506] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-09-14T19:08:47.976586] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-09-14T19:08:47.977005] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-09-14T19:08:47.977083] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-09-14T19:08:48.325402] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-14T19:08:48.558828] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-09-14T19:08:49.358850] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-09-14T19:08:49.455194] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-14T19:08:49.747782] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-14T19:08:50.158895] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-09-14T19:08:50.220766] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-14T19:08:50.958838] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-09-14T19:08:51.758883] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-09-14T19:08:51.851346] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-14T19:08:52.264259] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-14T19:08:52.558859] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-09-14T19:08:52.572015] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-14T19:08:53.358837] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-09-14T19:08:53.422459] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-14T19:08:54.158881] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-09-14T19:08:54.180772] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-14T19:08:54.958871] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-09-14T19:08:55.036654] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-14T19:08:55.758850] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-09-14T19:08:56.518534] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-14T19:08:56.520403] [INFO ] [REMOTE ] MUA: Full fetch complete (13671 records). [2025-09-14T19:08:56.520526] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-09-14T19:08:56.564337] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-09-14T19:08:56.887742] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-09-14T19:08:56.887906] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-09-14T19:08:56.888380] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-09-14T19:08:56.888606] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-09-14T19:08:56.889364] [DEBUG] [LOCAL ] MUA: Trimmed 13671 records to 8490 (keeping 150 days of data) [2025-09-14T19:08:56.943795] [DEBUG] [LOCAL ] MUA: Primary data saved (8490 records). [2025-09-14T19:08:56.943999] [INFO ] [MAIN ] MUA: Full history saved. [2025-09-14T19:08:56.944334] [INFO ] [MAIN ] Update Progress: 1430/2370 symbols completed. MUA took 27.3s. Estimated remaining: 1h 39m 45s. Rate: 9.4 symbols/min [2025-09-14T19:08:57.095904] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-14T19:08:57.179406] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-04 to 2025-09-12. [2025-09-14T19:08:57.203011] [DEBUG] [LOCAL ] MUR: Loaded 23573 existing records from primary storage. [2025-09-14T19:08:57.203225] [INFO ] [MAIN ] MUR: Loaded 23573 existing records. [2025-09-14T19:08:57.356200] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-14T19:08:57.364202] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [